- Course
Design and Test Pipelines with Apache Airflow 3
Design workflows that stay understandable as pipeline logic grows. This course will teach you to turn requirements into tasks, control data and branching, and test Airflow 3 Dags before they are scheduled.
Intermediate
- Course
Design and Test Pipelines with Apache Airflow 3
Design workflows that stay understandable as pipeline logic grows. This course will teach you to turn requirements into tasks, control data and branching, and test Airflow 3 Dags before they are scheduled.
Intermediate
Get started today
Access this course and other top-rated tech content with one of our business plans.
Try this course for free
Access this course and other top-rated tech content with one of our individual plans.
This course is included in the libraries shown below:
- Data
What you'll learn
Reliable pipelines need more than valid Python and a successful first run. In this course, Design and Test Pipelines with Apache Airflow 3, you’ll gain the ability to design maintainable task-based workflows and test their behavior. First, you’ll explore how to translate requirements into TaskFlow tasks, operators, dependencies, and TaskGroups. Next, you’ll discover how XComs, Params, Variables, branching, and trigger rules control data and execution flow. Finally, you’ll learn how to validate Dag loading, use dag.test(), write unit tests, and judge whether important paths are covered. When you’re finished with this course, you’ll have the skills and knowledge of Airflow workflow design and testing needed to build pipelines that are easier to change, diagnose, and trust.
Design and Test Pipelines with Apache Airflow 3
Intermediate
Table of contents
Pinal Dave is a Pluralsight Developer Evangelist.
