[
https://issues.apache.org/jira/browse/BEAM-12475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Boyuan Zhang updated BEAM-12475:
--------------------------------
Resolution: Fixed
Status: Resolved (was: Open)
> When bundle processors are re-used, do not respond to splits for previous
> bundles.
> ----------------------------------------------------------------------------------
>
> Key: BEAM-12475
> URL: https://issues.apache.org/jira/browse/BEAM-12475
> Project: Beam
> Issue Type: Bug
> Components: java-fn-execution
> Affects Versions: 2.30.0
> Reporter: Robert Bradshaw
> Assignee: Robert Bradshaw
> Priority: P1
> Fix For: 2.31.0
>
> Time Spent: 2h 10m
> Remaining Estimate: 0h
>
> The error manifests in the following way:
> (thread1) Start processing bundle A
> (thread2) Receive request to split for bundle A
> (thread1) Finish bundle A
> (thread1) Reset bundle processor
> (thread1) Start processing bundle B
> (thread2) Process split for bundle A on bundle B
> Runners, such as Dataflow, that ensure the self-reported number of elements
> processed by the SDK is equal to the number they expected to be processed
> (taking into account the runner's understanding of all splits) can detect
> this and reject A and B as invalid, but we should fix this race condition.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
