CountingBykeys
For many datasets, it is important to count the number of keys in a key/value dataset. For example, counting the number of countries where the product was sold or to show the most popular baby names. In this simple exercise, you'll use the Rdd that you created earlier and count the number of unique keys in that pair RDD.
Remember, you already have a SparkContext sc and Rdd available in your workspace.
Deze oefening maakt deel uit van de cursus
Big Data Fundamentals with PySpark
Oefeninstructies
countByKeyand assign the result to a variabletotal.- What is the type of
total? - Iterate over the
totaland print the keys and their counts.
Praktische interactieve oefening
Probeer deze oefening eens door deze voorbeeldcode in te vullen.
# Count the unique keys
total = Rdd.____()
# What is the type of total?
print("The type of total is", ____(total))
# Iterate over the total and print the output
for k, v in total.___():
print("key", ____, "has", ____, "counts")