- Course
Add Dynamic Behavior and Resilience to Pipelines with Apache Airflow 3
Variable workloads, external waits, and failures can make otherwise sound pipelines unreliable. This course will teach you to use Dynamic Task Mapping, wait efficiently, and control retries, deadlines, and human review in Airflow 3.
Intermediate
- Course
Add Dynamic Behavior and Resilience to Pipelines with Apache Airflow 3
Variable workloads, external waits, and failures can make otherwise sound pipelines unreliable. This course will teach you to use Dynamic Task Mapping, wait efficiently, and control retries, deadlines, and human review in Airflow 3.
Intermediate
Get started today
Access this course and other top-rated tech content with one of our business plans.
Try this course for free
Access this course and other top-rated tech content with one of our individual plans.
This course is included in the libraries shown below:
- Data
What you'll learn
Production pipelines must handle changing workloads, external waits, and failures without wasting worker capacity or hiding recovery decisions.
In this course, Add Dynamic Behavior and Resilience to Pipelines with Apache Airflow 3, you’ll gain the ability to build pipelines that adapt at runtime and recover predictably.
First, you’ll explore Dynamic Task Mapping and how to process mapped results.
Next, you’ll discover how sensors, deferrable tasks, and the triggerer support efficient waiting.
Finally, you’ll learn how to configure retries, timeouts, Deadline Alerts, and human review decisions.
When you’re finished with this course, you’ll have the skills and knowledge of dynamic and resilient Airflow pipelines needed to process variable workloads with explicit waiting and recovery behavior.
Add Dynamic Behavior and Resilience to Pipelines with Apache Airflow 3
Intermediate
Table of contents
Pinal Dave is a Pluralsight Developer Evangelist.
