[ 
https://issues.apache.org/jira/browse/TEZ-988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13950861#comment-13950861
 ] 

Rajesh Balamohan commented on TEZ-988:
--------------------------------------

[~kamrul] I believe the comments in the code caused the confusion.  keep-alive 
can be enabeld clusterwide by setting 
"mapreduce.shuffle.connection-keep-alive.enable" (MAPREDUCE-5787).  As per 
mapreduce-5787, one can enable/disable keep-alive by passing it via the URL 
(i.e keepAlive=true or keepAlive=false).  I will rephrase the comments in the 
code and reupload it.

> http.maxConnections needs to be configurable in Tez Fetcher & read from 
> errorstream to make the connection reusable
> -------------------------------------------------------------------------------------------------------------------
>
>                 Key: TEZ-988
>                 URL: https://issues.apache.org/jira/browse/TEZ-988
>             Project: Apache Tez
>          Issue Type: Bug
>    Affects Versions: 0.4.0
>            Reporter: Rajesh Balamohan
>            Assignee: Rajesh Balamohan
>         Attachments: TEZ-988-v1.patch, TEZ-988-v2.patch
>
>
> 1. Currently http.maxConnections is set to 5 (default).  Make this 
> configurable in Fetcher.java.  This will help in running larger queries
> 2. ErrorStream has to be read completely in order to make the connection 
> reusable (when keepAlive is enabled).  Currently, we do not read error stream.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to