Robert Bradshaw created BEAM-12475:
--------------------------------------
Summary: When bundle processors are re-used, do not respond to
splits for previous bundles.
Key: BEAM-12475
URL: https://issues.apache.org/jira/browse/BEAM-12475
Project: Beam
Issue Type: Bug
Components: java-fn-execution
Affects Versions: 2.30.0
Reporter: Robert Bradshaw
Assignee: Robert Bradshaw
The error manifests in the following way:
(thread1) Start processing bundle A
(thread2) Receive request to split for bundle A
(thread1) Finish bundle A
(thread1) Reset bundle processor
(thread1) Start processing bundle B
(thread2) Process split for bundle A on bundle B
Runners, such as Dataflow, that ensure the self-reported number of elements
processed by the SDK is equal to the number they expected to be processed
(taking into account the runner's understanding of all splits) can detect this
and reject A and B as invalid, but we should fix this race condition.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
