uranusjr commented on code in PR #67184:
URL: https://github.com/apache/airflow/pull/67184#discussion_r3378650053
##########
airflow-core/src/airflow/assets/manager.py:
##########
@@ -607,6 +605,14 @@ def _queue_partitioned_dags(
target_keys = [target_key]
del target_key
+ mapper_cap = mapper.max_downstream_keys
+ if mapper_cap is not None:
+ max_downstream_keys = mapper_cap
+ cap_source = f"max_downstream_keys={mapper_cap}"
+ else:
+ max_downstream_keys = global_cap
+ cap_source = f"[scheduler]
partition_mapper_max_downstream_keys={global_cap}"
+
if len(target_keys) > max_downstream_keys:
log.error(
Review Comment:
This log message should probably also mention which cap was exceeded. (Since
this is structlog, maybe just put both cap values in kwargs.)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
