The GitHub Actions job "Tests (AMD)" on airflow.git/feat/asset-watcher-match has failed. Run started by GitHub user Lee-W (triggered by Lee-W).
Head commit for run: 4c9ee01247df778792ecd87610dee49460992f74 / Wei Lee <[email protected]> feat(triggerer): share one poll across sibling event triggers When several AssetWatcher instances back triggers that read from the same upstream resource (one SQS queue, one Kafka topic, etc.), the triggerer spins up N independent poll loops today — one per trigger. Issue #66476 asks for one shared poller serving all of them. Add an opt-in path on BaseEventTrigger via three new hooks (`shared_stream_key`, `open_shared_stream`, `filter_shared_stream`) and a new SharedStreamManager that runs one poll task per distinct key and broadcasts events to per-subscriber queues. The key is read once when run_trigger starts and identifies the group for the trigger's lifetime. Per-trigger cleanup runs in run_trigger's finally; SharedStreamManager.stop_all() runs in the triggerer's shutdown path as a safety net. Triggers whose shared_stream_key() returns None (the default) keep their existing run() loop unchanged. The per-subscriber buffer size is exposed as [triggerer] shared_stream_subscriber_queue_size (default 1024) so deployments with a fast upstream can raise it without code changes. Report URL: https://github.com/apache/airflow/actions/runs/26222234624 With regards, GitHub Actions via GitBox --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
