Loading in hosted files
Your data engineering team at Sierra Publishing has been looking into different features of Databricks for their data engineering pipelines. One of your data engineers has posed a problem to you:
Right now, I am reading in several CSV files from an external data lake location. It has been really hard to keep my tables accurate because I never know when the new data files come in, and I cannot easily remember which files I have already loaded into my tables.
You want to use built-in Databricks functionality to solve this problem. Which of the following options would help solve the problem?
This exercise is part of the course
Databricks Concepts
Hands-on interactive exercise
Turn theory into action with one of our interactive exercises
