Checkpointing
2 articles
Articles
23 February 2026
Maximizing VRAM: Gradient Checkpointing Memory Savings Guide
16 September 2026
Checkpoint Resume Loss Spikes: Fixing Optimizer & LR State
When a long training run is interrupted, resuming from a checkpoint often triggers a massive loss spike. The most common culprits are missing optimizer moment buffers, reset learning rate schedulers, or mismapped FSDP shards - here is the triage order and recovery checklist.