Distributed Training via Local Updates and Infrequent Communication

Name: Distributed Training via Local Updates and Infrequent Communication
Uploaded: 2026-01-01
Description: Talk at the Protocol Learning Workshop at ICLR 2026 in Rio on why distributed training can be effective for large-scale foundation model training.