- Course
Build AI and Agentic Pipelines with Apache Airflow 3
Bring AI into real Airflow pipelines. This course will teach you to configure the Common AI Provider, extract structured data, route requests with LLMs, and use tool-enabled agents to publish review-ready results.
Intermediate
- Course
Build AI and Agentic Pipelines with Apache Airflow 3
Bring AI into real Airflow pipelines. This course will teach you to configure the Common AI Provider, extract structured data, route requests with LLMs, and use tool-enabled agents to publish review-ready results.
Intermediate
Get started today
Access this course and other top-rated tech content with one of our business plans.
Try this course for free
Access this course and other top-rated tech content with one of our individual plans.
This course is included in the libraries shown below:
- Data
What you'll learn
AI can extend data pipelines beyond deterministic processing by extracting information, evaluating context, and using tools when appropriate.
In this course, Build AI and Agentic Pipelines with Apache Airflow 3, you'll gain the ability to add structured AI tasks and tool-enabled agents to maintainable Airflow workflows.
First, you'll configure the Common AI Provider and an Azure-hosted GPT deployment, run an LLM task against a Globoticket promoter request, and return typed event data.
Next, you'll analyze event briefs in Azure Blob Storage, route submissions with AI-driven branching, and inspect execution and usage.
Finally, you'll use a read-only agent to investigate possible event conflicts through PostgreSQL and a Globoticket API, then validate and publish a JSON review packet to Azure Blob Storage.
When you're finished with this course, you'll know how to combine deterministic Airflow tasks, LLM tasks, and agents to produce review-ready outputs without handing workflow control to the model.
Build AI and Agentic Pipelines with Apache Airflow 3
Intermediate
Table of contents
Warner is a SQL Server Certified Master, MVP, and Principal Consultant at Pythian. He manages clients in many industries and leads a talented team that maintains and innovates with their data solutions. When he's not working in Ottawa, Ontario, he can be found in his home country of Costa Rica.
