Featured resource
2026 Tech Forecast
2026 Tech Forecast

Stay ahead of what’s next in tech with predictions from 1,500+ business leaders, insiders, and Pluralsight Authors.

Get these insights
  • Course

Build DAGs Using the Taskflow API in Apache Airflow

Enhance your Airflow workflows using the Taskflow API. This course will teach you how to use the Taskflow API to construct DAGs and pass data between tasks.

Intermediate
24m
(1)

Created by Janani Ravi

Last Updated Aug 01, 2024

Course Thumbnail
  • Course

Build DAGs Using the Taskflow API in Apache Airflow

Enhance your Airflow workflows using the Taskflow API. This course will teach you how to use the Taskflow API to construct DAGs and pass data between tasks.

Intermediate
24m
(1)

Created by Janani Ravi

Last Updated Aug 01, 2024

Get started today

Access this course and other top-rated tech content with one of our business plans.

Try this course for free

Access this course and other top-rated tech content with one of our individual plans.

This course is included in the libraries shown below:

  • Data
What you'll learn

Managing and optimizing workflows in Airflow can be challenging without a clear understanding of how to use operators and the Taskflow API effectively. In this course, Build DAGs Using the Taskflow API in Apache Airflow, you’ll gain the ability to create directed acyclic graphs (DAGs) for streamlined data validation, filtering, and passing. First, you’ll set up a simple DAG, with no conditional operations, using Airflow operators for data processing and validation and pass data using XComs. Next, you’ll convert the same DAG to use the Taskflow API using the @task and @dag decorators. You’ll learn how to perform data passing using the “return” keyword, and collect and access the data passed using input arguments. Finally you'll build a more complex DAG which includes conditional branching workflows first using operators and then using the Taskflow API. When you’re finished with this course, you’ll have the skills and knowledge needed to use the Taskflow API to enhance and optimize your workflows efficiently.

Build DAGs Using the Taskflow API in Apache Airflow
Intermediate
24m
(1)
Table of contents

About the author
Janani Ravi - Pluralsight course - Build DAGs Using the Taskflow API in Apache Airflow
Janani Ravi
192 courses 4.5 author rating 6281 ratings

A problem solver at heart, Janani has a Masters degree from Stanford and worked for 7+ years at Google. She was one of the original engineers on Google Docs and holds 4 patents for its real-time collaborative editing framework.

Get started with Pluralsight