Loading CSV into DataFrame
In the previous exercise, you have seen a method for creating a DataFrame from an RDD. Generally, loading data from CSV file is the most common method of creating DataFrames. In this exercise, you'll create a PySpark DataFrame from the people.csv file that is already provided to you as a file_path and confirm the created object is a PySpark DataFrame.
Remember, you already have a SparkSession spark and a variable file_path (the path to the people.csv file) available in your workspace.
Latihan ini adalah bagian dari kursus
Big Data Fundamentals with PySpark
Petunjuk latihan
- Create a DataFrame from
file_pathvariable which is the path to thepeople.csvfile. - Confirm the output as PySpark DataFrame.
Latihan interaktif praktis
Cobalah latihan ini dengan menyelesaikan kode contoh berikut.
# Create an DataFrame from file_path
people_df = spark.____(file_path, header=True, inferSchema=True)
# Check the type of people_df
print("The type of people_df is", ____(people_df))