8-bit Adam with Trainer
You've set up an 8-bit Adam optimizer, and you're ready to use it for training. Prepare the Trainer for 8-bit Adam!
Some data has been pre-loaded:
- The
adam_bnb_optimoptimizer - Training objects like
model,train_dataset, andtraining_args
Bu egzersiz
Efficient AI Model Training with PyTorch
kursunun bir parçasıdırEgzersiz talimatları
- Pass the 8-bit Adam optimizer to the
Trainer.
Uygulamalı interaktif egzersiz
Bu örnek kodu tamamlayarak bu egzersizi bitirin.
# Pass 8-bit Adam to the Trainer
trainer = Trainer(model=model,
args=training_args,
train_dataset=train_dataset,
eval_dataset=validation_dataset,
compute_metrics=compute_metrics,
____=(____, None))