Modal's Nan Jiang details cross-datacenter reinforcement learning

Nan Jiang explains a method to reduce checkpoint transfer sizes from 500 GB to 500 MB, enabling faster weight updates across distributed regions. The technique uses a rollout engine to reconstruct model weights bitwise, bypassing the latency of shipping full frontier-scale checkpoints.

Featured · Nan Jiang