Create a SQL table from a dataframe
A dataframe can be used to create a temporary table. A temporary table is one that will not exist after the session ends. Spark documentation also refers to this type of table as a SQL temporary view. In the documentation this is referred to as to register the dataframe as a SQL temporary view. This command is called on the dataframe itself, and creates a table if it does not already exist, replacing it with the current data from the dataframe if it does already exist.
Este exercício faz parte do curso
Introduction to Spark SQL in Python
Instruções do exercício
- Load csv data from the file
trainsched.txtinto a dataframe stored in a variable nameddf. - Create a temporary table from
df. Call the table "table1".
Exercício interativo prático
Experimente este exercício completando este código de exemplo.
# Load trainsched.txt
df = spark.____.____("trainsched.txt", header=True)
# Create temporary table called table1
df.____(____)