Load .csv files into a lakehouse.

On the Fabric portal, select the workspace on the left navigation pane.
Click on + New item.
On the New item dialog, scroll to the Store data section and select Lakehouse. Name it TADF_Lakehouse.
Once the lakehouse has been created, click on Get data and select Upload files from the drop-down menu.
Click on the folder icon under Files, browse to the folder Datasets\chapter_3 under Desktop and select the following files:
- dim_videogames.csv
- dim_genres.csv
- dim_publishers.csv
Click Upload.

Create a notebok and connect that notebook to your lakehouse

After creating the lakehouse and uploading the files, you should be in the lakehouse explorer window.
On the lakehouse explorer window, select Open notebook > New Notebook from the menu.
Once the notebook opens, the list of data sources should show Lakehouses | 1 item(s) added. Click here to browse to the lakehouse TADF_Lakehouse.

Load the data from the lakehouse into your notebook

Locate the Files folder in the lakehouse explorer.
Click on the ellipsis (…) next to the file dim_videogames.csv and select Load data > Spark from the pop-up menu.
You should see a new cell in the notebook with the following code being auto-generated:

df = spark.read.format("csv").option("header","true").load("Files/dim_videogames.csv")
# df now is a Spark DataFrame containing CSV data from "Files/dim_videogames.csv".
display(df)

Repeat the same process for the files dim_genres.csv and dim_publishers.csv

Rename the DataFrames and run the cells

For each cell, replace df with the new name according to the table given in the instructions. For example, the cell that loads the dim_videogames.csv file should look like this:

df_videogames = spark.read.format("csv").option("header","true").load("Files/dim_videogames.csv")
# df_videogames now is a Spark DataFrame containing CSV data from "Files/dim_videogames.csv".
display(df_videogames)

The run button is located to the left side of the cell, with the common 'Play' triangle icon.
Alternatively, you can run the cell by pressing Ctrl + ENTER while the text cursor is in the cell.

Joining using SQL

Transform and Analyze Data with Microsoft Fabric

Hands-on interactive exercise