Automatic device placement with Accelerator
Your conversational AI model needs to train on a massive dataset, so you've decided to move the model to a GPU. You're leveraging Accelerator for automatic device placement. Note this exercise actually runs on the CPU, but the code remains the same for running on the GPU.
A BERT-based model has been preloaded as model.
Deze oefening maakt deel uit van de cursus
Efficient AI Model Training with PyTorch
Oefeninstructies
- Declare an
acceleratorobject by instantiating the appropriate class. - Use the
acceleratorobject to prepare the model for distributed training with GPU.
Praktische interactieve oefening
Probeer deze oefening eens door deze voorbeeldcode in te vullen.
from accelerate import Accelerator
# Declare an accelerator object
accelerator = ____()
# Prepare the model for distributed training
model = accelerator.____(model)
print(accelerator.device)