Membuat pipeline DVC

Bayangkan contoh sederhana sebuah alur kerja ketika sebuah dokumen dicetak lalu dipindai untuk membuat dokumen PDF bertanda tangan, dengan DVC mengelola dependensi dan keluaran di setiap tahap.

Tahap print bergantung pada instruksi pencetakan di print.sh dan menghasilkan keluaran pages. Tahap scan bergantung pada instruksi di scan.sh dan pages (keluaran dari printer) serta menghasilkan keluaran signed.pdf.

Tugas Anda adalah merancang pipeline DVC yang menguraikan alur kerja menggunakan perintah dvc stage add. Sintaksnya adalah

dvc stage add -n <stage_name> -d <dependency> -o <output> <command>

Anda dapat menambahkan beberapa dependensi dan keluaran dengan mengulang penggunaan flag -d dan -o masing-masing.

CATATAN: DVC sudah diinisialisasi dalam penyiapan latihan. Tidak perlu menjalankan dvc init lagi.

Latihan ini adalah bagian dari kursus

CI/CD untuk Machine Learning

Latihan interaktif praktis

Ubah teori menjadi tindakan dengan salah satu latihan interaktif kami.

Mulai berolahraga

Latihan ini adalah bagian dari kursus

CI/CD untuk Machine Learning

SkillTag.level.advancedSkillTag.label

4.8+

Mulai Kursus Gratis

In this chapter, you will explore the essential principles of Continuous Integration/Continuous Delivery (CI/CD) and YAML. You'll grasp the software development life cycle and key terms like build, test, and deploy. Discover the differences between Continuous Integration, Continuous Delivery, and Continuous Deployment. Moreover, you'll investigate the significance of CI/CD in machine learning and experimentation.

Exercise 1: Introduction to Continuous Integration/Continuous Delivery for Machine Learning Exercise 2: Continuous deployment and delivery Exercise 3: Machine learning workflow Exercise 4: Introduction to YAML Exercise 5: YAML syntax Exercise 6: YAML mappings and sequences Exercise 7: Introduction to GitHub Actions Exercise 8: Utility of GitHub Actions Exercise 9: Anatomy of GitHub Actions

Get ready to explore GitHub Actions (GHA), an influential platform for executing CI/CD workflows. Uncover the diverse components of GHA, encompassing events, actions, jobs, steps, runners, and context. Gain insights into crafting workflows that activate upon events like push and pull requests, and tailor runner machines. Dive into hands-on learning as you establish fundamental CI pipelines and grasp the intricacies of the GHA log.

Exercise 1: Intermediate YAML Exercise 2: Find the correct combination Exercise 3: Design a Continuous Integration workflow Exercise 4: Setting a basic CI pipeline Exercise 5: Interpret GitHub Actions Workflow Exercise 6: Write a GitHub Actions Workflow Exercise 7: Running repository code Exercise 8: Feature branches in shared repository model Exercise 9: Running Python code in GitHub Actions Exercise 10: Environment Variables and Secrets Exercise 11: What is GITHUB_TOKEN?Exercise 12: Working with environment variables Exercise 13: Working with secrets

In this chapter, you'll explore the integration of machine learning model training into a GitHub Action pipeline using Continuous Machine Learning GitHub Action. You'll generate a comprehensive markdown report including model metrics and plots. You will also delve into data versioning in Machine Learning by adopting Data Version Control (DVC) to track data changes. The chapter also covers setting DVC remotes and dataset transfers. Finally, you'll explore DVC pipelines, configuring a DVC YAML file to orchestrate reproducible model training.

Exercise 1: Pelatihan model dengan GitHub Actions Exercise 2: Kembangkan model klasifikasi Exercise 3: Latih model klasifikasi Exercise 4: Menyiapkan pelatihan model menggunakan CML Exercise 5: Versioning himpunan data dengan Data Version Control Exercise 6: Mengapa berkas .dvc dibutuhkan?Exercise 7: Data versioning secara langsung Exercise 8: Berinteraksi dengan remote DVC Exercise 9: Menjelajahi Manfaat DVC Remote Exercise 10: DVC remote dalam praktik Exercise 11: Pipelines DVC Exercise 12: Membuat pipeline DVC

Latihan Saat Ini

Exercise 13: Latih model ML dengan DVC

In this chapter, you will direct your attention towards the analysis of model performance and the fine-tuning of hyperparameters. You will acquire practical expertise in comparing metrics and visualizations across different branches to assess changes in model performance. You will conduct hyperparameter tuning using scikit-learn's GridSearchCV. Furthermore, you will delve into the automation of pull requests using the optimal model configuration.

Exercise 1: Comparing metrics and plots in DVC Exercise 2: Adding metrics and plots to dvc.yaml Exercise 3: Comparing metrics across Git branches Exercise 4: Run DVC pipeline in GitHub Actions Exercise 5: Hyperparameter Tuning with DVC Exercise 6: Adding Hyperparameter tuning to dvc.yaml Exercise 7: Running Hyperparameter tuning DVC pipelines Exercise 8: GitHub Actions workflow for Hyperparameter Tuning Exercise 9: Loose Coupling Exercise 10: Setup Hyperparameter Tuning in GitHub Actions Exercise 11: Congratulations!