1. Learn
    2. /
  2. Courses
    3. /
  3. Introduction to Spark SQL in Python

Exercise

Applying a UDF to vector data

A dataframe is available called df having a column output of type vector. Its first five rows are shown in the console.

A UDF get_first_udf is available that selects the first element of a vector column.

Instructions

100 XP
  • Create a new dataframe called df_new by adding a new column to df. Call the new column label .
  • Show the first five rows of df_new.