The GitHub Actions job "Tests (AMD)" on 
airflow.git/ramitkataria/hook-lineage-asset-filters has failed.
Run started by GitHub user ramitkataria (triggered by ramitkataria).

Head commit for run:
b433104fe0789bfaee305b186778a101218c8ec8 / Ramit Kataria <[email protected]>
Allow filtering hook-collected assets in OpenLineage emission policy

Hook-level lineage registers an output asset for every object a hook writes, so
a task that writes many objects reports one asset per object. The existing
hook_lineage control is all-or-nothing: suppressing the noisy assets also loses
the ones worth tracking from the same hook, and the collector cannot tell the
two apart once its assets are read as one set.

Filtering by asset URI or reporting hook class lets a Dag keep the lineage that
matters while dropping the noise, and doing it where hook lineage is consumed
covers every instrumented hook at once rather than one provider at a time.

Note this reduces what gets reported rather than what gets collected, so it does
not recover assets already dropped by max_assets_per_collector.

closes: #63371

Report URL: https://github.com/apache/airflow/actions/runs/31211857938

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to