- Course
Integrate Apache Airflow 3 with External Systems
Real pipelines depend on systems outside Airflow. This course will teach you how to connect Airflow 3 to APIs, databases, and object storage using providers, connections, operators, and hooks.
Intermediate
- Course
Integrate Apache Airflow 3 with External Systems
Real pipelines depend on systems outside Airflow. This course will teach you how to connect Airflow 3 to APIs, databases, and object storage using providers, connections, operators, and hooks.
Intermediate
Get started today
Access this course and other top-rated tech content with one of our business plans.
Try this course for free
Access this course and other top-rated tech content with one of our individual plans.
This course is included in the libraries shown below:
- Data
What you'll learn
Production data pipelines depend on databases, APIs, cloud storage, and other services that have their own authentication, configuration, and failure modes.
In this course, Integrate Apache Airflow 3 with External Systems, you'll gain the ability to build maintainable Airflow workflows that orchestrate data across external services.
First, you'll explore Airflow's integration model by using provider packages, connections, operators, and hooks to connect to Globoticket systems.
Next, you'll build an end-to-end Globoticket event publishing pipeline that retrieves event updates from a REST API, performs database operations, and publishes a partner feed through Airflow's object storage interface.
Finally, you'll learn how to keep credentials and endpoints outside Dag code, diagnose common integration failures, and update external configuration without rewriting the workflow.
When you're finished with this course, you'll have the skills and knowledge of Apache Airflow external integrations needed to build pipelines that connect reliably to real systems and remain maintainable as those systems change.
Integrate Apache Airflow 3 with External Systems
Intermediate
Table of contents
Warner is a SQL Server Certified Master, MVP, and Principal Consultant at Pythian. He manages clients in many industries and leads a talented team that maintains and innovates with their data solutions. When he's not working in Ottawa, Ontario, he can be found in his home country of Costa Rica.
