- Course
Monitor and Maintain Apache Airflow
This course will teach you to monitor, maintain, and troubleshoot Airflow workflows, ensuring timely execution and effective error handling with email notifications and SLA tracking.
Intermediate
- Course
Monitor and Maintain Apache Airflow
This course will teach you to monitor, maintain, and troubleshoot Airflow workflows, ensuring timely execution and effective error handling with email notifications and SLA tracking.
Intermediate
Get started today
Access this course and other top-rated tech content with one of our business plans.
Try this course for free
Access this course and other top-rated tech content with one of our individual plans.
This course is included in the libraries shown below:
- Data
What you'll learn
Monitoring and maintaining Apache Airflow workflows can be complex and critical for ensuring reliable data pipelines.
In this course, Monitor and Maintain Apache Airflow, you’ll gain the ability to effectively oversee and manage your Airflow workflows.
First, you’ll explore how to set up a DAG to read files and store filtered and processed data in a SQLite database, and you'll monitor the run of the workflow using the Airflow UI.
Next, you’ll discover how to configure the email provider settings in Airflow configuration to be able to send notifications for your DAG runs.
Finally, you’ll learn how to configure task-level and DAG-level SLAs, receive email notifications for SLA breaches, observe SLA misses in the Airflow UI, and configure DAG failed/retry actions.
When you’re finished with this course, you’ll have the skills and knowledge of Apache Airflow needed to monitor, maintain, and ensure the reliability of your data workflows.
Monitor and Maintain Apache Airflow
Intermediate
Table of contents
A problem solver at heart, Janani has a Masters degree from Stanford and worked for 7+ years at Google. She was one of the original engineers on Google Docs and holds 4 patents for its real-time collaborative editing framework.