All courses
Resource hub
Featured resource
Tech Upskilling Playbook 2025
Tech Upskilling Playbook

Build future-ready tech teams and hit key business milestones with seven proven plays from industry leaders.

Learn more
Hamburger Icon
  • Path icon Learning Path
    • Libraries: This path is only available in the libraries listed. To access this path, purchase a license for the corresponding library.
  • Data
    •

Data Orchestration and Workflow Management with Apache Airflow

12 Courses
5 Labs
8 Hours
Skill IQ

Apache Airflow is an open-source platform for orchestrating complex workflows and data pipelines. It enables scheduling, monitoring, and managing workflows through a user-friendly interface. Built on Python, Airflow supports dynamic pipeline generation, scalability, and extensibility, making it ideal for automating and optimizing data engineering processes. This learning path teaches data engineers how to build and manage data pipelines with Apache Airflow for better data orchestration and workflow management.

Get started

Content in this path

Data Orchestration and Workflow Management with Apache Airflow

Watch the following course to get started!

Course

First Look: Apache Airflow 3.0

  • by Pinal Dave
  • 33m
  • Jun 24, 2025
Course

Up and Running with Apache Airflow

  • by Pinal Dave
  • 34m
  • Apr 28, 2025
Course

Create Complex DAGs and Task Dependencies with Apache Airflow

  • by Janani Ravi
  • 22m
  • Jul 25, 2024
Course

Optimize Workflows with Apache Airflow Operators

  • by Janani Ravi
  • 22m
  • Jul 25, 2024
Course

Build DAGs Using the Taskflow API in Apache Airflow

  • by Janani Ravi
  • 24m
  • Aug 01, 2024
Course

Effective Workflow Management with Apache Airflow

  • by Pinal Dave
  • 21m
  • May 15, 2025
Course

Integrate Databases with Apache Airflow

  • by Pinal Dave
  • 14m
  • Jun 07, 2024
Course

Work with APIs in Apache Airflow

  • by Dayo Bamikole
  • 16m
  • Aug 20, 2024
Course

Integrate External Services with Apache Airflow

  • by Janani Ravi
  • 23m
  • Aug 01, 2024
Course

Build a Data Pipeline with Apache Airflow

  • by Julian Mateu
  • 17m
  • Jul 23, 2024
Course

Create Dynamic DAGs with Apache Airflow

  • by Matt Stenzel
  • 16m
  • Jul 15, 2024
Course

Monitor and Maintain Apache Airflow

  • by Janani Ravi
  • 22m
  • Jul 30, 2024

Hands-on Practice with Apache Airflow

The following labs will help you get practical experience with Apache Airflow.

Lab

Write and Run a Basic DAG in Apache Airflow

  • by Pinal Dave
  • 38m
  • Sep 15, 2025
Lab

Schedule Workflows in Apache Airflow

  • by Bismark Adomako
  • 43m
  • Sep 21, 2025
Lab

Integrate Databases with Apache Airflow

  • by Pinal Dave
  • 43m
  • Aug 12, 2025
Lab

Manage Task Failures and Retries in Apache Airflow

  • by Pinal Dave
  • 27m
  • Sep 15, 2025
Lab

Create Complex DAGs and Task Dependencies in Apache Airflow

  • by Pinal Dave
  • 42m
  • Sep 16, 2025
Try this learning path for free
Access this learning path and other top-rated tech content with a free trial.
Free individual trial Free team trial
What You'll Learn
  • How to get up and running with Airflow
  • How to create basic, complex, and dynamic DAGs
  • How to optimize workflows in Airflow
  • How to manage workflows in Airflow
  • How to integrate databases with Airflow
  • How to work with APIs in Airflow
  • How to integrate external services with Airflow
  • How to build data pipelines with Airflow
  • How to monitor and maintain Airflow
  • How to implement version control in Airflow
Prerequisites
  • Learners should have the following knowledge to gain the most from this learning path:
  • Basic Python knowledge
  • Basic SQL and database knowledge
  • Basic Command Line Interface (CLI) skills
  • Experience with data pipeline concepts and processes
Related topics
  • Data Engineering
  • Databases
  • ETL
  • Python
Not sure where to start?
With over 500 assessments to choose from, you can see where your skills stand and receive adaptive learning recommendations to fill knowledge gaps in as little as 10 minutes.
Learn more

Learn with the best

Pinal Dave
Pinal Dave
Pinal Dave is an SQL Server Performance Tuning Expert and independent consultant with over 24 years of hands-on experience. He holds a Master of Science degree and numerous database certifications. Pinal has authored 14 SQL Server database books, 96 Pluralsight courses, 11 Code Labs, and 5 Skill Assessments. To freely share his knowledge and help others build their expertise, Pinal has also written more than 5,800 database tech articles on his blog at https://blog.sqlauthority.com.
Janani Ravi
Janani Ravi
Janani has a Masters degree from Stanford and worked for 7+ years at Google. She was one of the original engineers on Google Docs and holds 4 patents for its real-time collaborative editing framework. After spending years working in tech in the Bay Area, New York, and Singapore at companies such as Microsoft, Google, and Flipkart, Janani finally decided to combine her love for technology with her passion for teaching. She is now the co-founder of Loonycorn, a content studio focused on providing ...
Dayo Bamikole
Dayo Bamikole
Dayo is a seasoned Data and AI Solutions Architect with deep expertise in Cloud Data Solutions, Artificial Intelligence, and Web Development. Over the years, he has traveled extensively, presenting in more than 35 U.S. states and across Europe, delivering engaging, hands-on workshops for audiences ranging from Database Administrators to Software Developers. He is certified as an Azure Data Engineer, Azure Data Scientist, Azure AI Engineer and AWS Solutions Architect, Dayo blends technical depth ...
Julian Mateu
Julian Mateu
Graduating as an Electronic Engineer degree from the University of Buenos Aires, and currently based in London, Julian has spent 10 years in the Software Industry, from working with large tech companies like Amazon and Google, to dynamic startups. He began his career in mobile and robotics and eventually found his passion in backend development and cloud-based distributed systems. Julian is skilled in Go, Javascript/Typescript, Java and Python, and designs, implements, and deploys software for d...
Matt Stenzel
Matt Stenzel
Matt Stenzel is a Data and AI Cloud Solution Architect at Microsoft. He has 15+ years of experience in the data and analytics industry working in various roles including a software developer, data engineer, DW developer, DBA and integration architect. He has spent the last 8 years working at Microsoft helping companies across the US successfully implement Azure solutions that provide business value.
Bismark Adomako
Bismark Adomako
Bismark believes that education is no longer a one-time investment, but instead a lifelong pursuit and that great authors and mentors can play an invaluable role in finding and developing a fulfilling career. He holds a Bachelor of Science degree in Computer Engineering specializing in Software Engineering, Artificial Intelligence and Distributed computing. He taught courses in robotics and computer vision as a student leader whiles in school, and interned and consulted for the British Counci...

Join our learners and upskill
in leading technologies