Recover from StaleDataError during DagRun integrity verification to prevent scheduler crash.
Recover from StaleDataError during DagRun integrity verification to prevent scheduler crash.: a task in bird-critic-1.5-full-300 (Harbor dataset). When Airflow's LocalExecutor runs with high parallelism, a race condition can occur: a task instance row is completed or deleted between the time the…
The task
When Airflow's LocalExecutor runs with high parallelism, a race condition can occur: a task instance row is completed or deleted between the time the session loads task instances and the time `session.flush()` is called during task instance creation inside `DagRun.verify_integrity`. This raises…
Part of kochsnow/bird-critic-1.5-full-300.