Menjelajah data dengan privacy budget accountant

Sistem eksplorasi data yang menyediakan differential privacy harus mengelola anggaran privasi yang mengukur jumlah privasi yang hilang di berbagai kueri.

Dalam latihan ini, Anda akan mengeksplorasi himpunan data IBM HR Analytics Employee Attrition & Performance sambil melacak anggaran privasi. Ingat bahwa jika sebuah kueri melampaui anggaran privasi yang ditetapkan di accountant, akan muncul galat.

Histogram adalah alat yang berharga untuk memvisualisasikan data secara diferensial privat. Sintaksnya sama dengan fungsi terkait di numpy, dengan parameter epsilon.

Himpunan data lengkap tersedia sebagai hr dan atribut usia karyawan sebagai ages. Sebuah fungsi kustom telah dibuat dan dimuat sebagai show_histogram() untuk memplot histogram seperti yang telah Anda lakukan sebelumnya dalam kursus.

Latihan ini adalah bagian dari kursus

Privasi Data dan Anonimisasi di Python

Petunjuk latihan

Buat BudgetAccountant privasi dengan epsilon sebesar 1.5, menggunakan konstruktornya.
Hasilkan histogram privat dari kolom ages dengan nilai epsilon sebesar 0.1.
Ambil dan tampilkan rata-rata privat dari ages, menggunakan epsilon sebesar 0.9, dan bounds dari 10 hingga 100 sebagai tuple.
Cetak sisa anggaran privasi untuk dua kueri baru berikutnya.

Latihan interaktif praktis

Cobalah latihan ini dengan menyelesaikan kode contoh berikut.

# Create the privacy Budget Accountant with epsilon of 1.5
acc = ____

# Use the Budget Accountant acc to draw a private histogram of ages with epsilon 0.1
dp_hist, dp_bins = tools.___(____, epsilon=____, range=[10,100], accountant=____)
show_histogram(dp_hist, dp_bins)

# Get and show the private average of the age variable
print("Mean: ", tools.mean(____))

# Show privacy budget remaining for 2 queries
print("Remaining budget for 2 queries: ", ____)
print("Number of queries recorded: ", len(acc))

Edit dan Jalankan Kode

Latihan ini adalah bagian dari kursus

Privasi Data dan Anonimisasi di Python

SkillTag.level.advancedSkillTag.label

4.9+

Mulai Kursus Gratis

Get ready to apply anonymization techniques such as data suppression, masking, synthetic data generation, and generalization. In this chapter, you’ll learn how to distinguish between sensitive and non-sensitive personally identifiable information (PII), quasi-identifiers, and the basics of the GDPR. You'll also encounter real-life examples of what can go wrong if you don't follow these best practices.

Exercise 1: What's private, and why do we care?Exercise 2: Privacy is power Exercise 3: Is it sensitive or non-sensitive?Exercise 4: Suppression of sensitive attributes Exercise 5: Data masking and data generation with Faker Exercise 6: Masking sensitive PII Exercise 7: Removing names with faker Exercise 8: Anonymizing with data generalization Exercise 9: Reducing identification risk with generalization Exercise 10: Data aggregation and data generalization Exercise 11: Top and bottom coding White House salaries

Discover how to anonymize data by sampling from datasets following the probability distribution of the columns. You’ll then learn how to apply the k-anonymity privacy model to prevent linkage or re-identification attacks and use hierarchies to perform data generalization in categorical variables.

Exercise 1: Anonymizing categorical data Exercise 2: Explore the distribution of data Exercise 3: Sampling from the same probability distribution Exercise 4: Anonymizing continuous data Exercise 5: Different distributions Exercise 6: Sampling from the best continuous distribution Exercise 7: Introduction to K-anonymity Exercise 8: Privacy attributes Exercise 9: Generalizing into ranges Exercise 10: Generalizing data using hierarchies Exercise 11: Using hierarchies for categorical data Exercise 12: K-anonymizing a dataset

Learn about differential privacy, the model used by major technology companies such as Apple, Google, and Uber. In this chapter, you’ll explore data by generating private histograms and computing private averages in data. You’ll also create differentially private machine learning models that allow businesses to increase the utility of their data.

Exercise 1: Pengantar differential privacy Exercise 2: Epsilon (ϵ): angka ajaib Exercise 3: Histogram dengan differential privacy Exercise 4: Anggaran privasi Exercise 5: Menggunakan privacy budget Exercise 6: Saat tidak ada anggaran tersisa Exercise 7: Menjelajah data dengan privacy budget accountant

Latihan Saat Ini

Exercise 8: Model Machine Learning dengan differential privacy Exercise 9: Membangun classifier yang differentially private Exercise 10: Memprediksi gaji Exercise 11: Model klastering dengan differential privacy Exercise 12: Pra-pemrosesan data Exercise 13: Segmentasi pelanggan

In this final chapter, you’ll learn how to apply dimensionality reduction methods such as principal component analysis (PCA) to anonymize large multi-column datasets. You’ll then use Faker to generate realistic and consistent datasets, and scikit-learn to create synthetic datasets that follow a normal distribution. Lastly, you’ll tie everything you learned in this course together as you combine multiple techniques to safely release datasets to the public.

Exercise 1: PCA for anonymization Exercise 2: Anonymization of high-dimensional data Exercise 3: Data masking with PCA Exercise 4: Generating realistic datasets with Faker Exercise 5: Consistent synthetic dataset Exercise 6: Datasets with the same probabilistic distribution Exercise 7: Creating synthetic datasets using scikit-learn Exercise 8: Generating datasets for classification Exercise 9: Generating datasets for clustering Exercise 10: Safely release datasets to the public Exercise 11: Exploring and pseudonymizing a dataset Exercise 12: Preparing employee data for safe release Exercise 13: Great work!