Name: Training with Efficient Optimizers - Mixed precision training with 8-bit Adam
Uploaded: 2026-06-16T00:00:00Z
Description: You'll focus on optimizers as levers to improve distributed training efficiency, highlighting tradeoffs between AdamW, Adafactor, and 8-bit Adam. Reducing the number of parameters or using low precision helps to decrease a model's memory footprint.