Creating RDDs
In PySpark, you can create an RDD (Resilient Distributed Dataset) in a few different ways. Since you are already familiar with DataFrames, you will set this up using a DataFrame. Remember, there's already a SparkSession called spark in your workspace!
Este exercício faz parte do curso
Introduction to PySpark
Instruções do exercício
- Create a DataFrame from the provided list called
df. - Convert the DataFrame to an RDD.
- Collect and print the resulting RDD.
Exercício interativo prático
Experimente este exercício completando este código de exemplo.
# Create a DataFrame
df = spark.____("salaries.csv", header=True, inferSchema=True)
# Convert DataFrame to RDD
rdd = df.____
# Show the RDD's contents
rdd.____
print(rdd)