Creating RDDs
In PySpark, you can create an RDD (Resilient Distributed Dataset) in a few different ways. Since you are already familiar with DataFrames, you will set this up using a DataFrame. Remember, there's already a SparkSession called spark in your workspace!
Deze oefening maakt deel uit van de cursus
Introduction to PySpark
Oefeninstructies
- Create a DataFrame from the provided list called
df. - Convert the DataFrame to an RDD.
- Collect and print the resulting RDD.
Praktische interactieve oefening
Probeer deze oefening eens door deze voorbeeldcode in te vullen.
# Create a DataFrame
df = spark.____("salaries.csv", header=True, inferSchema=True)
# Convert DataFrame to RDD
rdd = df.____
# Show the RDD's contents
rdd.____
print(rdd)