Open Source Everything

Apache Airflow

47kActiveApache-2.0

Apache Airflow lets technical teams write, schedule and watch jobs that move and prepare data, such as nightly imports. You describe each job in code and run Airflow on your own server.

Features

Ready-made connectionsProvider packages of operators; you write each job
SourcePartly
Schedules and retries
Hosted for youHosted by Astronomer, AWS and Google
Quick to run yourselfDocker Compose with several services
SourcePartly

Listed in

Replaces partly

You write each job in code; no ready-made connectors like Fivetran's

How to help

AI contributionsTraditional developers only

AI help is fine if you follow the Apache guidelines, understand and test everything, and say in the pull request that you used AI; blindly pasted AI code gets closed.

“Generally, it's fine to use Gen-AI tools to help you create Pull Requests for Apache Airflow as long as you adhere to the following guidelines:” Read it

Welcomes pull requests.

Something wrong?