Check Version
Checking the version of which Spark and Python installed is important as it changes very quickly and drastically. Reading the wrong documentation can cause lots of lost time and unnecessary frustration!
This course touches on a lot of concepts you may have forgotten, so if you ever need a quick refresher, download the PySpark Cheat Sheet and keep it handy!
This exercise is part of the course
Feature Engineering with PySpark
Exercise instructions
- Print the Spark
version. - Print the Python
version_info.
Hands-on interactive exercise
Have a go at this exercise by completing this sample code.
# Return spark version
print(spark.____)
# Return python version
import sys
print(sys.____)