[
https://issues.apache.org/jira/browse/TEZ-879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth updated TEZ-879:
-------------------------------
Attachment: TEZ-879.1.txt
There are some issues with inputContext, and other variables being set in one
thread (initialize), and then accessed via another (start) - and local threads
started by each input / Output.
Patch makes the following changes
- synchronized methods on various Inputs / Outputs - and adds some error
checking on the started state
- Changes the actual workers (DefaultSorter, ShuffleScheduler, ShuffleManager,
etc) to setup everything as final fields via the constructor
- Renames threads to include the src / dest vertex name - (this used to be the
uniqeIdentifier in certain cases, and was missing in others)
[~hitesh], review please.
> Investigate synchronization in Inputs/Outputs .initialize() etc
> ---------------------------------------------------------------
>
> Key: TEZ-879
> URL: https://issues.apache.org/jira/browse/TEZ-879
> Project: Apache Tez
> Issue Type: Task
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
> Attachments: TEZ-879.1.txt
>
>
> Initialization, start etc happens in separate threads. Some synchronization -
> primarily for visibility - may be required.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
