[ https://issues.apache.org/jira/browse/BEAM-833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Groh updated BEAM-833: ----------------------------- Description: This primarily means calling the {{BoundedSource#splitAtFraction}} API during the evaluation of a BoundedReadEvaluatorFactory - this can return the work via addUnprocessedElements. At a later point, the {{MonitorRunnable}} within {{ExecutorServiceParallelExecutor}} can examine currently evaluating work and invoke a {{TransformExecutor#split}} method, which can return to the runner some amount of input, which can be scheduled to use more of the available threads. > Exercise Dynamic Splitting in the DirectRunner > ---------------------------------------------- > > Key: BEAM-833 > URL: https://issues.apache.org/jira/browse/BEAM-833 > Project: Beam > Issue Type: Improvement > Components: runner-direct > Reporter: Thomas Groh > Assignee: Thomas Groh > > This primarily means calling the {{BoundedSource#splitAtFraction}} API during > the evaluation of a BoundedReadEvaluatorFactory - this can return the work > via addUnprocessedElements. > At a later point, the {{MonitorRunnable}} within > {{ExecutorServiceParallelExecutor}} can examine currently evaluating work and > invoke a {{TransformExecutor#split}} method, which can return to the runner > some amount of input, which can be scheduled to use more of the available > threads. -- This message was sent by Atlassian JIRA (v6.3.4#6332)