Github user StephanEwen commented on the pull request:
https://github.com/apache/flink/pull/754#issuecomment-108843486
The hook that starts the next batch source is at the level of the
`Execution`. That means that as soon as one execution is finished, the next leg
would start.
I think that would only work if the leg's does not by itself trigger any
multiple successors (because it has an intermediate shuffle). Otherwise, we
would again immediately exceed the number of slots.
Can we put the hook onto the intermediate result, and have it trigger an
entire "slot sharing group" as soon as it is fully available? My initial
thought is that this would support the above case better.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
