dabla commented on PR #62922: URL: https://github.com/apache/airflow/pull/62922#issuecomment-5712399875
> What `batch(size=)` means. It means "make N task instances", and items go out round robin rather than in contiguous chunks. [...] A name like `count=` or `tasks=` would carry the meaning without the explanation, unless I am too late here. Feel free to raise devlist for this. Not too late: the feature is unreleased, so a rename costs nothing now. I have raised it on the devlist: https://lists.apache.org/thread/6qlbvvnt76514rstzk447pvs4784wcj2 The options on the table there are to keep `size=` and rely on the docs, to keep `.batch()` but rename the parameter to `count=` or `tasks=`, or to rename the method as well to something that says partitioning rather than chunking. Once the thread settles I will update this PR, the Task SDK docs and the AIP page to match. Until then the PR description lists this as an open point, and the batching note there now states the round-robin semantics explicitly. On the XCom layout: agreed, that stays tracked in #70223. --- Drafted-by: Claude Fable 5.1; reviewed by @dabla before posting -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
