DataFrames

As the lead data engineer at Sierra Publishing, you are leading your team in migrating into Databricks for their data pipelines. Some of your newer data engineers are concerned that they won't be able to work with Databricks since they are unfamiliar with DataFrames. They currently work in Python and SQL and will learn Spark as they continue using Databricks.

Which of the following points should you tell your team so they feel comfortable about the transition?