Quiz 3 - Question 1

Assume you have a pre-trained model with 1 billion parameters. You are considering fine-tuning the model with LoRA. The LoRA matrices A and B together constitute 0.1% of the total weights. For performing inference, you need to store 4 bytes for each parameter. For training, on the other hand, you need to store 16 bytes per parameter. 1 KB is 1,000 bytes, and 1 GB is 1,000,000,000 bytes. How much memory do you need to fine-tune this 1 billion parameter model with LoRA?

यह अभ्यास पाठ्यक्रम का हिस्सा है

Google DeepMind: Fine-Tune Your Model

पाठ्यक्रम देखें

इंटरैक्टिव व्यावहारिक अभ्यास

हमारे इंटरैक्टिव अभ्यासों में से किसी एक के साथ सिद्धांत को व्यवहार में बदलें

अभ्यास शुरू करें

यह अभ्यास पाठ्यक्रम का हिस्सा है

Google DeepMind: Fine-Tune Your Model

SkillTag.level.intermediateSkillTag.label

4.8+

17 reviews

पाठ्यक्रम मुफ्त में शुरू करें

In this module, you will explore the motivation for fine-tuning. Even when a pre-trained large language model is available, it may not always do exactly what you want it to do. Here, you will investigate the capabilities and limitations of a pre-trained language model to better understand why it is necessary to fine-tune models to new tasks.

Exercise 1: The importance of specialization Exercise 2: How will your model respond?Exercise 3: Learning objectives Exercise 4: How to get the most out of this course Exercise 5: Lab: Prompt Your SLM with Questions Exercise 6: Gemma: Fine-tuning the model for specific tasks

In this module, you will appreciate the power and importance of formatting for fine-tuning large language models. You will explore the various formats required to achieve different tasks. You will pre-process a dataset derived from the Africa Galore dataset and transform it into a question-and-answer format. This will then be used in later modules to fine-tune your language model so that it can generate revision study flashcards—a task which it was not pre-trained to do.

Exercise 1: Formatting Exercise 2: Lab: Format Text for Turn-Based Dialogue Exercise 3: Input and output formats Exercise 4: Quiz 1 - Question 1 Exercise 5: Quiz 1 - Question 2

In this module, you will learn full-parameter fine-tuning: a straightforward method for adapting pre-trained models. To gain an understanding, you will first take the small language model you built in course 04 Discover The Transformer Architecture. Then you will continue its training on a small, specialized dataset to generate the revision study flashcards you created in the previous module. This process will allow you to compare fine-tuning to training from scratch, observing the key similarities and differences in the development pipeline. Here, you will also consider how AI is made sense of within cultural contexts by reading a story about AI and then creating your own short piece of fiction. The aim here is to explore how narrative can act as a complementary approach to anticipation and reflection for revealing cultural meaning and values.

Exercise 1: The advantages of fine-tuning Exercise 2: Full-parameter fine-tuning Exercise 3: Lab: Fine-Tune All The Parameters of Your SLM Exercise 4: When to stop fine-tuning Exercise 5: What makes a "good" flashcard?Exercise 6: Imagining AI in cultural contexts Exercise 7: Write your own piece of AI fiction Exercise 8: Quiz 2 - Question 1 Exercise 9: Quiz 2 - Question 2

In this module, you will explore low-rank adaptation (LoRA), a more computationally efficient alternative to full-parameter fine-tuning. LoRA is a popular parameter-efficient fine-tuning (PEFT) technique. You will investigate LoRA by applying it to fine-tune the Gemma3-1B model, which has one billion parameters. This will enable you to experience first-hand how it is able to achieve excellent results with a fraction of the computational cost of full-parameter fine-tuning.

Exercise 1: Foundation models Exercise 2: Lab: Full-Parameter Fine-Tuning of Gemma Exercise 3: Low-rank adaptation (LoRA)Exercise 4: Lab: Implement LoRA for Parameter-Efficient Fine-Tuning Exercise 5: Lab: Fine-Tuning Gemma3-1B with LoRA Exercise 6: Quiz 3 - Question 1

वर्तमान अभ्यास

Exercise 7: Quiz 3 - Question 2

In this module, you will consider the limitations of supervised fine-tuning. You will then be given a brief overview of advanced techniques based on reinforcement learning (RL). This will introduce you to how these approaches can better align a model's behavior with human values and preferences.

Exercise 1: Opportunities and limitations of SFT Exercise 2: Reinforcement learning from human feedback Exercise 3: Quiz 4 - Question 1 Exercise 4: Quiz 4 - Question 2

In this module, you will explore foresight and governance. You will consider how the values and meanings revealed through storytelling can inform foresight reporting and help you to design governance responses, including enforceable rules, transparency, and accountability. This equips you to think about how strong governance can protect communities, ensure equity, and align AI with societal values.

Exercise 1: Foresight and governance Exercise 2: Designing a governance blueprint for your LLM Exercise 3: Quiz 5 - Question 1 Exercise 4: Quiz 5 - Question 2

Critically evaluate and design governance approaches that include enforcement, bright-line rules, and burden of proof.

Exercise 1: Summary Exercise 2: Looking forward Exercise 3: Additional resources and further reading Exercise 4: Glossary Exercise 5: Feedback