[ 
https://issues.apache.org/jira/browse/TEZ-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13989747#comment-13989747
 ] 

Siddharth Seth commented on TEZ-1098:
-------------------------------------

That's an option. Merging the code paths is not straight forward though - and 
will likely take some time. It's not just the fetchers, the entire 
ShuffleManager/Shuffle code would eventually need to be merged. The Fetcher 
itself has a fair amount of communication with the ShuffleManager.
The easiest approach for this would be likely to take the Broadcast shuffle and 
ensure regular shuffle can work with this fetcher. That, I believe, is already 
fairly delinked - with pending attempts not being added directly back via the 
ShuffleHandler interface.

> Enable connection keep-alive for broadcast shuffle
> --------------------------------------------------
>
>                 Key: TEZ-1098
>                 URL: https://issues.apache.org/jira/browse/TEZ-1098
>             Project: Apache Tez
>          Issue Type: Task
>            Reporter: Siddharth Seth
>            Assignee: Rajesh Balamohan
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to