Join the DataFrames
In the next two chapters you'll be working to build a model that predicts whether or not a flight will be delayed based on the flights data we've been working with. This model will also include information about the plane that flew the route, so the first step is to join the two tables: flights and planes!
Это упражнение является частью курса
Foundations of PySpark
Инструкции к упражнению
- First, rename the
yearcolumn ofplanestoplane_yearto avoid duplicate column names. - Create a new DataFrame called
model_databy joining theflightstable withplanesusing thetailnumcolumn as the key.
Интерактивное практическое упражнение
Попробуйте выполнить это упражнение, дополнив этот пример кода.
# Rename year column
planes = planes.withColumnRenamed(____)
# Join the DataFrames
model_data = flights.join(____, on=____, how="leftouter")