Split the data
A dataframe df_examples is available having columns endword: string, features: vector, outvec: vector, and label: int. You're going to split it to obtain training and testing set, which you will use to train and test a classifier.
This exercise is part of the course
Introduction to Spark SQL in Python
Exercise instructions
- Split the examples into train and test using a 80/20 split.
- Print the number of training examples.
- Print the number of test examples.
Hands-on interactive exercise
Have a go at this exercise by completing this sample code.
# Split the examples into train and test, use 80/20 split
df_trainset, df_testset = df_examples.____((____), 42)
# Print the number of training examples
print("Number training: ", ____.____)
# Print the number of test examples
print("Number test: ", ____.____)