Finalize pruning by removing the mask
After pruning a model, you need to finalize it before saving or deploying. This means removing the pruning mask so the model no longer tracks which weights were zeroed. You'll use prune.remove() to complete this step.
This exercise is part of the course
Scalable AI Models with PyTorch Lightning
Exercise instructions
- Finalize the pruning of the weight parameter.
- Use
prune.remove()to remove the mask and store the final weights. - Print the model to confirm pruning removal.
Hands-on interactive exercise
Have a go at this exercise by completing this sample code.
import torch.nn.utils.prune as prune
# Before pruning
print(model)
# Finalize pruning by removing the pruning mask
prune.____(model[3], "____")
# Print model structure after pruning
print(____)