1. Learn
    2. /
  2. Courses
    3. /
  3. Efficient AI Model Training with PyTorch
Connected

Exercise

Loading and inspecting pre-trained models

You're building a conversational AI assistant that can engage in human-like dialog across a wide range of topics, leveraging the powerful BERT model that has been pre-trained on a large corpus of text data.

You'll print the configuration to verify that you've loaded a conversational AI model with certain parameters like model_type: bert, num_attention_heads: 12, and num_hidden_layers: 12.

Instructions

100 XP
  • Initialize the model parameters with the appropriate AutoModel class to load the bert-base-uncased model.
  • Print the model's configuration.