Mixed precision training with Trainer

You want to simplify your training interface for mixed precision training. As an alternative to training loops with Accelerator, you've decided to build Trainer since your model doesn't require custom training loops. Set up Trainer to use mixed precision training! The exercise will take some time to run with the call to trainer.train().

本练习是课程的一部分

Efficient AI Model Training with PyTorch

查看课程

练习说明

Enable mixed precision training for Trainer.

交互式实操练习

通过完成这段示例代码来试试这个练习。

training_args = TrainingArguments(
    output_dir="./results",
    evaluation_strategy="epoch",
    # Enable mixed precision training
    ____=____
)
trainer = Trainer(model=model,
                  args=training_args,
                  train_dataset=dataset["train"],
                  eval_dataset=dataset["validation"],
                  compute_metrics=compute_metrics)
trainer.train()

编辑并运行代码