dag-factory

Welcome to dag-factory! dag-factory is a library for Apache Airflow® to construct DAGs declaratively via configuration files.

The minimum requirements for dag-factory are:

• Python 3.10.0+
• Apache Airflow® 2.9+

For a gentle introduction, please take a look at our Quickstart Guide. For more examples, please see the examples folder.

• Quickstart
  • Astro CLI
  • Airflow Standalone
• Benefits
• Features
  • load_yml_dags Function
  • Schedule
  • Dynamically Mapped Tasks
  • Define Python Object
  • Custom Operators
  • Defaults
  • Callbacks
  • KubernetesPodOperator
• Contributing

Benefits

• Construct DAGs without knowing Python
• Construct DAGs without learning Airflow primitives
• Avoid duplicative code
• Everyone loves YAML! ;)

📢 Dag-Factory 1.0 Released

Version 1.0 introduces important improvements and breaking changes to support modern Airflow usage.

👉 See the Migration Guide to upgrade from earlier versions.

🚀 Dag-Factory Supports Airflow 3

DAG-Factory is compatible with Apache Airflow 3 and supports modern scheduling, and updated import paths.

Community

Join us on the Apache Airflow Slack Workspace at #yaml-dags

License

To learn more about the terms and conditions for use, reproduction and distribution, read the Apache License 2.0.

Privacy Notice

This project follows Astronomer's Privacy Policy.

For further information, read this

Security Policy

Check the project's Security Policy to learn how to report security vulnerabilities in DAG Factory and how security issues reported to the DAG Factory security team are handled.