Airflow Best Practices for ETL/ELT Pipelines

This site uses cookies to improve your experience. By viewing our content, you are accepting the use of cookies. To help us insure we adhere to various privacy regulations, please select your country/region of residence. If you do not select a country we will assume you are from the United States. View our privacy policy and terms of use.

Search:

DAY

WEEK

MONTH

YEAR

Select your country:
Sign up | Log in

ETL and ELT are some of the most common data engineering use cases, but can come with challenges like scaling, connectivity to other systems, and dynamically adapting to changing data sources.

Airflow is specifically designed for moving and transforming data in ETL/ELT pipelines, and new features in Airflow 3.0 like assets, backfills, and event-driven scheduling make orchestrating ETL/ELT pipelines easier than ever!

Join Airflow expert Kenten Danas to learn:

An overview of ETL vs. ELT and how to select the right architecture for your use case 💡
Common DAG patterns for ETL/ELT use cases, including how to connect to other tools in the data ecosystem 🛠
Key Airflow features for creating reliable ETL/ELT pipelines, including dynamic task mapping, assets, and custom XCom backends 🔑
How to make your DAGs dynamic in an efficient and scalable way 📈

Get ready to revolutionize your data-processing approach—register today and save your seat!

📆 August 28, 2025 at 9:30 AM PDT, 12:30 PM EDT, 5:30 PM BST

Brought to you by:

Kenten Danas, Senior Manager, Developer Relations

Kenten is the Senior Manager of Developer Relations at Astronomer, and has a background in field engineering, data engineering, and consulting. She has first-hand experience adopting and running Airflow as a consultant, and is passionate about helping other data engineers scale and get the most out of their Airflow experience. When she isn't working with data she's typically outside trail running or skiing.

SaaS Brief