Name: Training with Efficient Optimizers - Adafactor を使ったメモリ効率の高いトレーニング
Uploaded: 2026-05-29T00:00:00Z
Description: You'll focus on optimizers as levers to improve distributed training efficiency, highlighting tradeoffs between AdamW, Adafactor, and 8-bit Adam. Reducing the number of parameters or using low precision helps to decrease a model's memory footprint.