[ https://issues.apache.org/jira/browse/MAPREDUCE-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307179#comment-14307179 ]
Dustin Cote commented on MAPREDUCE-6235: ---------------------------------------- Thanks folks, I believe I was seeing a time difference because of the time to compress. I'll go ahead and close this out since no code change should be made here. > Bundle and compress files passed with -libjars prior to uploading and > distributing > ---------------------------------------------------------------------------------- > > Key: MAPREDUCE-6235 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6235 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: distributed-cache, mrv2 > Affects Versions: 2.6.0 > Reporter: Dustin Cote > Assignee: Dustin Cote > Priority: Minor > > To improve performance, we should upload jars flagged by -libjars as a single > bundle and expand on arrival instead of uploading the jars one by one. This > would also reduce network overhead of using the -libjars option. -- This message was sent by Atlassian JIRA (v6.3.4#6332)