#airflow

When people compare Azure Data Factory (ADF) and Apache Airflow, the conversation often becomes a...

How we collect health metadata from Airflow, Glue, dbt and Tableau into S3, serve it through a thin...

Three delivery toolchain products return fingerprints at different scales, and exposure matters most for the one that serves the artefacts other systems install.

Disclosure: I wrote this handbook. It is free and MIT licensed. Tutorials rot quietly. A dependency...

The "universal orchestrator" is a myth that keeps data engineers awake at 3:00 AM chasing zombie DAGs...

We deployed Windmill with Docker Compose, built a mixed-language data and AI workflow, tested worker isolation, and mapped the operational trade-offs against Airflow.

Practical Airflow DAG design patterns for production: idempotency, atomic tasks, dynamic mapping, backfills, sensors, secrets, and testing DAGs.

We started using Apache Airflow for repetitive DevOps workflows, not just data pipelines. Some of...

Originally published at norvik.tech Introduction Explore the challenges of using...

A Clean CSV Import Is Not a Data Engineering Portfolio Almost every beginner data project...

It is relatively straightforward to design a data pipeline that works under the perfect conditions of...

Airflow 3.3.0 shipped on 6 July 2026, with 3.3.1 following about five weeks later. It's a much...