Get startedGet started for free

Apply pruning to a linear layer

We've trained an image classification model using a fully connected (linear) layer. Now, we're tasked with applying unstructured pruning to this layer to reduce model size without significantly impacting performance. We'll use PyTorch's l1_unstructured method for this task.

Model is pre-loaded as in model variable.

This exercise is part of the course

Scalable AI Models with PyTorch Lightning

View Course

Exercise instructions

  • Import the pruning module from torch.nn.utils.
  • Apply l1_unstructured pruning to model[3], the final layer, and prune 30% of the weights.

Hands-on interactive exercise

Have a go at this exercise by completing this sample code.

# Import pruning module
import torch.nn.utils.prune as ____
# Before pruning
print(model)
# Apply L1 unstructured pruning to model[3]
prune.____(model[3], name="____", amount=____)
# After pruning
print(model)
Edit and Run Code