Name: Training with Efficient Optimizers - Balanced training with AdamW
Uploaded: 2026-03-05T00:00:00Z
Description: You'll focus on optimizers as levers to improve distributed training efficiency, highlighting tradeoffs between AdamW, Adafactor, and 8-bit Adam. Reducing the number of parameters or using low precision helps to decrease a model's memory footprint.