[jira] [Commented] (MAPREDUCE-5049) CombineFileInputFormat counts all compressed files non-splitable

2013-03-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13594387#comment-13594387 ] Hadoop QA commented on MAPREDUCE-5049: -- {color:red}-1 overall{color}. Here are t

[jira] [Updated] (MAPREDUCE-5049) CombineFileInputFormat counts all compressed files non-splitable

2013-03-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-5049: -- Status: Patch Available (was: Open) > CombineFileInputFormat counts all compressed fil

[jira] [Updated] (MAPREDUCE-5049) CombineFileInputFormat counts all compressed files non-splitable

2013-03-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-5049: -- Attachment: MAPREDUCE-5049.patch > CombineFileInputFormat counts all compressed files n

[jira] [Commented] (MAPREDUCE-5038) old API CombineFileInputFormat missing fixes that are in new API

2013-03-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13594334#comment-13594334 ] Hadoop QA commented on MAPREDUCE-5038: -- {color:red}-1 overall{color}. Here are t

[jira] [Updated] (MAPREDUCE-5038) old API CombineFileInputFormat missing fixes that are in new API

2013-03-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-5038: -- Status: Patch Available (was: Open) > old API CombineFileInputFormat missing fixes tha

[jira] [Commented] (MAPREDUCE-5038) old API CombineFileInputFormat missing fixes that are in new API

2013-03-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13594329#comment-13594329 ] Sandy Ryza commented on MAPREDUCE-5038: --- Filed MAPREDUCE-5049 to handle Splittab

[jira] [Updated] (MAPREDUCE-5038) old API CombineFileInputFormat missing fixes that are in new API

2013-03-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-5038: -- Attachment: MAPREDUCE-5038-1.patch > old API CombineFileInputFormat missing fixes that

[jira] [Created] (MAPREDUCE-5049) CombineFileInputFormat counts all compressed files non-splitable

2013-03-05 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5049: - Summary: CombineFileInputFormat counts all compressed files non-splitable Key: MAPREDUCE-5049 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5049 Project: Had

[jira] [Commented] (MAPREDUCE-5047) keep.failed.task.files=true causes job failure on secure clusters

2013-03-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13594253#comment-13594253 ] Hadoop QA commented on MAPREDUCE-5047: -- {color:red}-1 overall{color}. Here are t

[jira] [Commented] (MAPREDUCE-5047) keep.failed.task.files=true causes job failure on secure clusters

2013-03-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13594251#comment-13594251 ] Sandy Ryza commented on MAPREDUCE-5047: --- localizeConfiguration is needed in the

[jira] [Updated] (MAPREDUCE-5047) keep.failed.task.files=true causes job failure on secure clusters

2013-03-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-5047: -- Status: Patch Available (was: Open) > keep.failed.task.files=true causes job failure o

[jira] [Updated] (MAPREDUCE-5047) keep.failed.task.files=true causes job failure on secure clusters

2013-03-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-5047: -- Attachment: MAPREDUCE-5047.patch > keep.failed.task.files=true causes job failure on se

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

2013-03-05 Thread Mariappan Asokan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13594248#comment-13594248 ] Mariappan Asokan commented on MAPREDUCE-4842: - Hi Ravi, Thanks for the c

[jira] [Updated] (MAPREDUCE-5042) Reducer unable to fetch for a map task that was recovered

2013-03-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5042: -- Attachment: MAPREDUCE-5042.patch This is complicated by the fact that the job token current

[jira] [Assigned] (MAPREDUCE-5042) Reducer unable to fetch for a map task that was recovered

2013-03-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-5042: - Assignee: Jason Lowe > Reducer unable to fetch for a map task that was recovered

[jira] [Commented] (MAPREDUCE-5028) Maps fail when io.sort.mb is set to high value

2013-03-05 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13594174#comment-13594174 ] Alejandro Abdelnur commented on MAPREDUCE-5028: --- Thanks Karthik. I've co

[jira] [Commented] (MAPREDUCE-5027) Shuffle does not limit number of outstanding connections

2013-03-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13594141#comment-13594141 ] Hudson commented on MAPREDUCE-5027: --- Integrated in Hadoop-trunk-Commit #3421 (See [

[jira] [Updated] (MAPREDUCE-5027) Shuffle does not limit number of outstanding connections

2013-03-05 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated MAPREDUCE-5027: --- Resolution: Fixed Fix Version/s: 2.0.4-beta 0.23.7

[jira] [Updated] (MAPREDUCE-3688) Need better Error message if AM is killed/throws exception

2013-03-05 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated MAPREDUCE-3688: Attachment: mapreduce-3688-h0.23-v01.patch This has been a pain for our users as well.

[jira] [Commented] (MAPREDUCE-5027) Shuffle does not limit number of outstanding connections

2013-03-05 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13594127#comment-13594127 ] Jonathan Eagles commented on MAPREDUCE-5027: +1. This patch looks good. Th

[jira] [Commented] (MAPREDUCE-3685) There are some bugs in implementation of MergeManager

2013-03-05 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13594124#comment-13594124 ] Ravi Prakash commented on MAPREDUCE-3685: - This is probably more for just my r

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

2013-03-05 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13594110#comment-13594110 ] Ravi Prakash commented on MAPREDUCE-4842: - Hi Mariappan, bq. This is a tangen

[jira] [Created] (MAPREDUCE-5048) streaming combiner feature breaks when input binary, output text

2013-03-05 Thread Antonio Piccolboni (JIRA)
Antonio Piccolboni created MAPREDUCE-5048: - Summary: streaming combiner feature breaks when input binary, output text Key: MAPREDUCE-5048 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5048

[jira] [Commented] (MAPREDUCE-5038) old API CombineFileInputFormat missing fixes that are in new API

2013-03-05 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13594002#comment-13594002 ] Sangjin Lee commented on MAPREDUCE-5038: I filed MAPREDUCE-5046 to backport MA

[jira] [Commented] (MAPREDUCE-5027) Shuffle does not limit number of outstanding connections

2013-03-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13593919#comment-13593919 ] Hadoop QA commented on MAPREDUCE-5027: -- {color:green}+1 overall{color}. Here are

[jira] [Created] (MAPREDUCE-5047) keep.failed.task.files=true causes job failure on secure clusters

2013-03-05 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-5047: - Summary: keep.failed.task.files=true causes job failure on secure clusters Key: MAPREDUCE-5047 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5047 Project: Ha

[jira] [Updated] (MAPREDUCE-5027) Shuffle does not limit number of outstanding connections

2013-03-05 Thread Robert Parker (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Parker updated MAPREDUCE-5027: - Attachment: (was: MAPREDUCE-5027-4.patch) > Shuffle does not limit number of

[jira] [Updated] (MAPREDUCE-5027) Shuffle does not limit number of outstanding connections

2013-03-05 Thread Robert Parker (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Parker updated MAPREDUCE-5027: - Attachment: MAPREDUCE-5027-4.patch > Shuffle does not limit number of outstanding

[jira] [Commented] (MAPREDUCE-5027) Shuffle does not limit number of outstanding connections

2013-03-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13593886#comment-13593886 ] Hadoop QA commented on MAPREDUCE-5027: -- {color:red}-1 overall{color}. Here are t

[jira] [Updated] (MAPREDUCE-5027) Shuffle does not limit number of outstanding connections

2013-03-05 Thread Robert Parker (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Parker updated MAPREDUCE-5027: - Attachment: MAPREDUCE-5027-b023-2.patch MAPREDUCE-5027-4.patch >

[jira] [Commented] (MAPREDUCE-5027) Shuffle does not limit number of outstanding connections

2013-03-05 Thread Robert Parker (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13593881#comment-13593881 ] Robert Parker commented on MAPREDUCE-5027: -- Jon, I have uploaded a new patch

[jira] [Created] (MAPREDUCE-5046) backport MAPREDUCE-1423 to mapred.lib.CombineFileInputFormat

2013-03-05 Thread Sangjin Lee (JIRA)
Sangjin Lee created MAPREDUCE-5046: -- Summary: backport MAPREDUCE-1423 to mapred.lib.CombineFileInputFormat Key: MAPREDUCE-5046 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5046 Project: Hadoo

[jira] [Created] (MAPREDUCE-5045) UtilTest#isCygwin method appears to be unused

2013-03-05 Thread Chris Nauroth (JIRA)
Chris Nauroth created MAPREDUCE-5045: Summary: UtilTest#isCygwin method appears to be unused Key: MAPREDUCE-5045 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5045 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-5043) Fetch failure processing can cause AM event queue to backup and eventually OOM

2013-03-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13593384#comment-13593384 ] Hudson commented on MAPREDUCE-5043: --- Integrated in Hadoop-Hdfs-trunk #1335 (See [ht

[jira] [Commented] (MAPREDUCE-5043) Fetch failure processing can cause AM event queue to backup and eventually OOM

2013-03-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13593307#comment-13593307 ] Hudson commented on MAPREDUCE-5043: --- Integrated in Hadoop-Yarn-trunk #146 (See [htt