How to reduce GPU memory usage when fine-tuning a large transformer model?

“I’m fine-tuning a transformer with batch size 8 and getting CUDA out-of-memory errors. Would gradient checkpointing or mixed precision help?”