Lavorare con la CLI di Git

Immagina di iniziare un nuovo progetto di Machine Learning. Vuoi usare Git per tracciare le modifiche al codice e collaborare in modo efficace. In questo esercizio creerai un repository Git, aprirai un nuovo branch, aggiungerai un file iniziale e farai il tuo primo commit. Questi comandi di base di Git ti torneranno utili più avanti, quando li useremo insieme a DVC. Puoi estendere l’esercizio aggiungendo altri file, creando nuovi branch e facendo commit di quelle modifiche per approfondire la comprensione.

Questo esercizio fa parte del corso

Introduzione al versionamento dei dati con DVC

Visualizza il corso

Esercizio pratico interattivo

Passa dalla teoria alla pratica con uno dei nostri esercizi interattivi

Inizia esercizio

Questo esercizio fa parte del corso

Introduzione al versionamento dei dati con DVC

IntermediárioNível de habilidade

4.8+

323 reviews

Inizia il corso gratis

This chapter provides a comprehensive introduction to Data Version Control (DVC), a tool essential for data versioning in machine learning. Learners will explore the motivation behind data versioning, understand its differences from code versioning, and experiment with a simple classification problem. They will review basic Git commands, learn about DVC, and practice setting up a repository. The chapter concludes with an overview of DVC’s features and use cases, including versioning data and models, CI/CD for machine learning, experiment tracking, pipelines, and more.

Exercise 1: Motivazioni del data versioning Exercise 2: Anatomia di un modello di Machine Learning Exercise 3: Differenze tra versionamento dei dati e del codice Exercise 4: Capire gli iperparametri Exercise 5: Introduzione a DVC Exercise 6: Lavorare con la CLI di Git

Esercizio in corso

Exercise 7: Ripasso della CLI di DVC Exercise 8: Funzionalità e casi d'uso di DVC Exercise 9: Pipeline DVC Exercise 10: CI/CD per il machine learning

This chapter delves into the setup of DVC, encompassing aspects such as installation, initialization of the repository, and the utilization of the .dvcignore file. It further navigates through the exploration of DVC cache and staging files, imparting knowledge on how to add and remove files, manage caches, and comprehend the underlying mechanisms using the MD5 hash. The chapter also elucidates on DVC remotes, distinguishing them from Git remotes, and guides you on how to add, list, and modify them. Lastly, it teaches you how to interact with these remotes by pushing and pulling data, checking out specific versions, and fetching data to the cache.

Exercise 1: DVC Setup and Initialization Exercise 2: Setting up DVC Exercise 3: .dvcignore Patterns Exercise 4: DVC Cache and Staging Files Exercise 5: Working with DVC Cache Exercise 6: Understanding .dvc Files Exercise 7: Configuring DVC Remotes Exercise 8: Purpose of DVC Remotes Exercise 9: Setup a DVC Remote Exercise 10: Interacting with DVC Remotes Exercise 11: Versioning Data using DVC Remote Exercise 12: Checking out Versioned Data

This chapter focuses on automating ML pipelines using DVC. Learners create a configuration file containing settings and hyperparameters. They also learn about pipeline visualization using directed acyclic graphs and use commands to describe dependencies, commands, and outputs. Execution of DVC pipelines is covered, including local model training and how Git tracks DVC metadata. Additionally, learners explore metrics and plots tracking in DVC, including how to print metrics, create plot files, and compare metrics and plots across different pipeline stages.

Exercise 1: Code organization and refactoring Exercise 2: Understanding parameter files in DVC Exercise 3: Write a parameter file Exercise 4: Writing and visualizing DVC pipelines Exercise 5: Designing a DVC pipeline Exercise 6: Visualizing a DVC pipeline Exercise 7: Executing DVC pipelines Exercise 8: DVC pipeline execution concepts Exercise 9: Execute a ML model training pipeline Exercise 10: Evaluation: Metrics and plots in DVC Exercise 11: Tracking DVC Metrics Exercise 12: Adding plots to dvc.yaml Exercise 13: Congratulations!