CommencerCommencer gratuitement

Applying a UDF to vector data

A dataframe is available called df having a column output of type vector. Its first five rows are shown in the console.

A UDF get_first_udf is available that selects the first element of a vector column.

Cet exercice fait partie du cours

Introduction to Spark SQL in Python

Afficher le cours

Instructions

  • Create a new dataframe called df_new by adding a new column to df. Call the new column label .
  • Show the first five rows of df_new.

Exercice interactif pratique

Essayez cet exercice en complétant cet exemple de code.

# Add label by applying the get_first_udf to output column
df_new = df.____('____', ____('____'))

# Show the first five rows 
df_new.____
Modifier et exécuter le code