Quiz 1 Question 9
You have a data pipeline that requires you to monitor a Cloud Storage bucket for a file, start a Dataflow job to process data in the file, run a shell script to validate the processed data in BigQuery, and then delete the original file. You need to orchestrate this pipeline by using recommended tools. Which product should you choose?
This exercise is part of the course
Preparing for your Professional Data Engineer Journey
Hands-on interactive exercise
Turn theory into action with one of our interactive exercises
Start Exercise