Integration testing with dag.test()
Integrity tests verify loading and unit tests verify logic, but neither runs the actual Dag. Integration tests with dag.test() fill that gap by executing all tasks sequentially in a single process. An ETL pipeline called etl_output has been deployed that writes results to /tmp/etl_results.json.
You'll write an integration test that exercises the full pipeline and verifies its output.
This exercise is part of the course
Building Data Pipelines with Airflow
Hands-on interactive exercise
Turn theory into action with one of our interactive exercises
Start Exercise