Operations and Reliability

Replacing Polling Sensors with Deferrable Operators in Airflow

October 2, 2026 · Dagvane

Every waiting sensor holds a worker slot. Moving the wait to the triggerer frees capacity, but only if you change the right sensors and run the triggerer properly.

Cutting DAG Parsing Time on an Airflow Estate with Hundreds of DAGs

September 29, 2026 · Dagvane

When the DAG processor is the bottleneck, tasks sit queued and new DAGs take minutes to appear. How to measure parse time per file and bring it down.