Rete con livello lineare

Le reti neurali spesso contengono molti livelli, ma la maggior parte sono livelli lineari. Capire un singolo livello lineare ti aiuta a coglierne il funzionamento prima di aggiungere complessità.

Applica un livello lineare a un tensore di input e osserva l'output.

Questo esercizio fa parte del corso

Introduzione al Deep Learning con PyTorch

Visualizza il corso

Istruzioni dell'esercizio

Crea un livello Linear che prende 3 feature in input e restituisce 2 output.
Fai passare input_tensor attraverso il livello lineare.

Esercizio pratico interattivo

Prova a risolvere questo esercizio completando il codice di esempio.

import torch
import torch.nn as nn

input_tensor = torch.tensor([[0.3471, 0.4547, -0.2356]])

# Create a Linear layer
linear_layer = nn.____(
                         in_features=____, 
                         out_features=____
                         )

# Pass input_tensor through the linear layer
output = ____(____)

print(output)

Modifica ed esegui il codice

Questo esercizio fa parte del corso

Introduzione al Deep Learning con PyTorch

IntermediárioNível de habilidade

4.8+

Inizia il corso gratis

Self-driving cars, smartphones, search engines... Deep learning is now everywhere. Before you begin building complex models, you will become familiar with PyTorch, a deep learning framework. You will learn how to manipulate tensors, create PyTorch data structures, and build your first neural network in PyTorch with linear layers.

Exercise 1: Introduzione al deep learning con PyTorch Exercise 2: Prime mosse con i tensori PyTorch Exercise 3: Verificare e sommare i tensori Exercise 4: Reti neurali e layer Exercise 5: Rete con livello lineare

Esercizio in corso

Exercise 6: Capire i pesi Exercise 7: Strati nascosti e parametri Exercise 8: Il tuo primo neural network Exercise 9: Impilare livelli lineari Exercise 10: Contare il numero di parametri

To train a neural network in PyTorch, you will first need to understand additional components, such as activation and loss functions. You will then realize that training a network requires minimizing that loss function, which is done by calculating gradients. You will learn how to use these gradients to update your model's parameters.

Exercise 1: Discovering activation functions Exercise 2: Activate your understanding!Exercise 3: The sigmoid and softmax functions Exercise 4: Running a forward pass Exercise 5: Building a binary classifier in PyTorch Exercise 6: From regression to multi-class classification Exercise 7: Using loss functions to assess model predictions Exercise 8: Creating one-hot encoded labels Exercise 9: Calculating cross entropy loss Exercise 10: Using derivatives to update model parameters Exercise 11: Accessing the model parameters Exercise 12: Updating the weights manually Exercise 13: Using the PyTorch optimizer

Now that you've learned the key components of a neural network, you'll train one using a training loop. You'll explore potential issues like vanishing gradients and learn strategies to address them, such as alternative activation functions and tuning learning rate and momentum.

Exercise 1: A deeper dive into loading data Exercise 2: Using TensorDataset Exercise 3: Using DataLoader Exercise 4: Writing our first training loop Exercise 5: Using the MSELoss Exercise 6: Writing a training loop Exercise 7: ReLU activation functions Exercise 8: Implementing ReLU Exercise 9: Implementing leaky ReLU Exercise 10: Understanding activation functions Exercise 11: Learning rate and momentum Exercise 12: Experimenting with learning rate Exercise 13: Experimenting with momentum

Training a deep learning model is an art, and to make sure our model is trained correctly, we need to keep track of certain metrics during training, such as the loss or the accuracy. We will learn how to calculate such metrics and how to reduce overfitting.

Exercise 1: Layer initialization and transfer learning Exercise 2: Fine-tuning process Exercise 3: Freeze layers of a model Exercise 4: Layer initialization Exercise 5: Evaluating model performance Exercise 6: Writing the evaluation loop Exercise 7: Calculating accuracy using torchmetrics Exercise 8: Fighting overfitting Exercise 9: Experimenting with dropout Exercise 10: Understanding overfitting Exercise 11: Improving model performance Exercise 12: Implementing random search Exercise 13: Wrap-up video