1. Learn
    2. /
  2. Courses
    3. /
  3. Efficient AI Model Training with PyTorch
Connected

Exercise

8-bit Adam with Trainer

You've set up an 8-bit Adam optimizer, and you're ready to use it for training. Prepare the Trainer for 8-bit Adam!

Some data has been pre-loaded:

  • The adam_bnb_optim optimizer
  • Training objects like model, train_dataset, and training_args

Instructions

100 XP
  • Pass the 8-bit Adam optimizer to the Trainer.