1. Learn
  2. /
  3. Courses
  4. /
  5. Efficient AI Model Training with PyTorch

Connected

Exercise

Prepare a model for distributed training

You've decided to use the Hugging Face Accelerator library to train your language translation model. Now it's time to prepare your model for distributed training!

Some data has been pre-loaded:

  • accelerator is an instance of Accelerator
  • model, optimizer, train_dataloader, and lr_scheduler have been defined

Instructions

100 XP
  • Call a method to prepare objects for distributed training.
  • Pass in the training objects to the method, matching the order of the output.