[jira] [Created] (MAPREDUCE-4894) Renewal / cancellation of JobHistory tokens

Siddharth Seth created MAPREDUCE-4894: - Summary: Renewal / cancellation of JobHistory tokens Key: MAPREDUCE-4894 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4894 Project: Hadoop

[jira] [Updated] (MAPREDUCE-4894) Renewal / cancellation of JobHistory tokens

[ https://issues.apache.org/jira/browse/MAPREDUCE-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-4894: -- Attachment: MAPREDUCE-4894_wip.txt Work in progress. More details on YARN-50.

[jira] [Assigned] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-4886: - Assignee: meng gong TestCapacityScheduler failed in branch-1

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13536875#comment-13536875 ] Siddharth Seth commented on MAPREDUCE-4842: --- bq. You are right that such a

[jira] [Commented] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13536883#comment-13536883 ] meng gong commented on MAPREDUCE-4886: -- 1.These failures are caused for this

[jira] [Commented] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13536914#comment-13536914 ] Junping Du commented on MAPREDUCE-4886: --- Yes. It should due to -noFile

[jira] [Resolved] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved MAPREDUCE-4886. --- Resolution: Not A Problem TestCapacityScheduler failed in branch-1

[jira] [Commented] (MAPREDUCE-4887) Rehashing partitioner for better distribution

[ https://issues.apache.org/jira/browse/MAPREDUCE-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13536958#comment-13536958 ] Hudson commented on MAPREDUCE-4887: --- Integrated in Hadoop-Yarn-trunk #71 (See

[jira] [Created] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

Dennis Y created MAPREDUCE-4895: --- Summary: Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators Key: MAPREDUCE-4895 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4895

[jira] [Updated] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Y updated MAPREDUCE-4895: Description: Task https://issues.apache.org/jira/browse/YARN-223 breaks compilation of

[jira] [Updated] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Y updated MAPREDUCE-4895: Attachment:

[jira] [Updated] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Y updated MAPREDUCE-4895: Assignee: Thomas Graves Status: Patch Available (was: Open) Fix compilation

[jira] [Commented] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13536968#comment-13536968 ] Hadoop QA commented on MAPREDUCE-4895: -- {color:red}-1 overall{color}. Here are

[jira] [Updated] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Y updated MAPREDUCE-4895: Status: Open (was: Patch Available) Fix compilation failure of

[jira] [Assigned] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Y reassigned MAPREDUCE-4895: --- Assignee: (was: Thomas Graves) Fix compilation failure of

[jira] [Updated] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Y updated MAPREDUCE-4895: Assignee: Thomas Graves Status: Patch Available (was: Open) Fix compilation

[jira] [Commented] (MAPREDUCE-4887) Rehashing partitioner for better distribution

[ https://issues.apache.org/jira/browse/MAPREDUCE-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537011#comment-13537011 ] Hudson commented on MAPREDUCE-4887: --- Integrated in Hadoop-Hdfs-trunk #1260 (See

[jira] [Commented] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537051#comment-13537051 ] Thomas Graves commented on MAPREDUCE-4895: -- +1. This patch only applies to

[jira] [Updated] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-4895: - Resolution: Fixed Fix Version/s: 2.0.3-alpha Target Version/s:

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537063#comment-13537063 ] Thomas Graves commented on MAPREDUCE-4842: -- I ran the latest patch through

[jira] [Commented] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537070#comment-13537070 ] Tom White commented on MAPREDUCE-4808: -- These changes look reasonable to me. The

[jira] [Commented] (MAPREDUCE-4894) Renewal / cancellation of JobHistory tokens

[ https://issues.apache.org/jira/browse/MAPREDUCE-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537082#comment-13537082 ] Daryn Sharp commented on MAPREDUCE-4894: I think the comment on YARN-50

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537088#comment-13537088 ] Alejandro Abdelnur commented on MAPREDUCE-4842: --- If Asokan's approach

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537096#comment-13537096 ] Jason Lowe commented on MAPREDUCE-4842: --- Regarding the removal of the element in

[jira] [Updated] (MAPREDUCE-4806) Cleanup: Some (5) private methods in JobTracker.RecoveryManager are not used anymore after MAPREDUCE-3837

[ https://issues.apache.org/jira/browse/MAPREDUCE-4806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated MAPREDUCE-4806: - Resolution: Fixed Fix Version/s: 1.2.0 Hadoop Flags: Reviewed Status:

[jira] [Updated] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-4895: - Fix Version/s: 0.23.6 I pulled this into branch 0.23 along with YARN-223

[jira] [Commented] (MAPREDUCE-4888) NLineInputFormat drops data in 1.1 and beyond

[ https://issues.apache.org/jira/browse/MAPREDUCE-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537170#comment-13537170 ] Robert Joseph Evans commented on MAPREDUCE-4888: I am +1 of it too.

[jira] [Comment Edited] (MAPREDUCE-4888) NLineInputFormat drops data in 1.1 and beyond

[ https://issues.apache.org/jira/browse/MAPREDUCE-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537170#comment-13537170 ] Robert Joseph Evans edited comment on MAPREDUCE-4888 at 12/20/12 5:21 PM:

[jira] [Commented] (MAPREDUCE-4888) NLineInputFormat drops data in 1.1 and beyond

[ https://issues.apache.org/jira/browse/MAPREDUCE-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537173#comment-13537173 ] Robert Joseph Evans commented on MAPREDUCE-4888: But that is very

[jira] [Updated] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-4842: -- Attachment: MAPREDUCE-4842-2.patch In the interest of trying to push this forward faster,

[jira] [Updated] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-4842: -- Assignee: Mariappan Asokan (was: Jason Lowe) Status: Patch Available (was: Open)

[jira] [Updated] (MAPREDUCE-4861) Cleanup: Remove unused mapreduce.security.token.DelegationTokenRenewal

[ https://issues.apache.org/jira/browse/MAPREDUCE-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-4861: - Fix Version/s: 0.23.6 I pulled this into branch-0.23 Cleanup:

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537181#comment-13537181 ] Mariappan Asokan commented on MAPREDUCE-4842: - Thanks to all of you for

[jira] [Updated] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-4842: Attachment: mapreduce-4842.patch Shuffle race can hang reducer

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537186#comment-13537186 ] Jason Lowe commented on MAPREDUCE-4842: --- Patch race, sorry about that Asokan.

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537188#comment-13537188 ] Hadoop QA commented on MAPREDUCE-4842: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4806) Cleanup: Some (5) private methods in JobTracker.RecoveryManager are not used anymore after MAPREDUCE-3837

[ https://issues.apache.org/jira/browse/MAPREDUCE-4806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537190#comment-13537190 ] Karthik Kambatla commented on MAPREDUCE-4806: - Thanks for looking into

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537195#comment-13537195 ] Hadoop QA commented on MAPREDUCE-4842: -- {color:red}-1 overall{color}. Here are

[jira] [Updated] (MAPREDUCE-4856) TestJobOutputCommitter uses same directory as TestJobCleanup

[ https://issues.apache.org/jira/browse/MAPREDUCE-4856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-4856: - Fix Version/s: 0.23.6 I pulled this into branch-0.23.

[jira] [Updated] (MAPREDUCE-4171) Add a test for YARN Schedulers' MAXIMUM_ALLOCATION limits

[ https://issues.apache.org/jira/browse/MAPREDUCE-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated MAPREDUCE-4171: --- Summary: Add a test for YARN Schedulers' MAXIMUM_ALLOCATION limits (was: Add a test for MR2's

[jira] [Updated] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-4808: - Status: Open (was: Patch Available) Mariappan, can you pls put up a design doc on

[jira] [Updated] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-4842: Attachment: mapreduce-4842.patch Hi Jason, Thanks for the quick review of

[jira] [Updated] (MAPREDUCE-4894) Renewal / cancellation of JobHistory tokens

[ https://issues.apache.org/jira/browse/MAPREDUCE-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-4894: - Priority: Blocker (was: Major) Renewal / cancellation of JobHistory tokens

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537267#comment-13537267 ] Hadoop QA commented on MAPREDUCE-4842: -- {color:green}+1 overall{color}. Here are

[jira] [Created] (MAPREDUCE-4896) mapred queue -info spits out ugly exception when queue does not exist

Sandy Ryza created MAPREDUCE-4896: - Summary: mapred queue -info spits out ugly exception when queue does not exist Key: MAPREDUCE-4896 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4896

[jira] [Commented] (MAPREDUCE-4896) mapred queue -info spits out ugly exception when queue does not exist

[ https://issues.apache.org/jira/browse/MAPREDUCE-4896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537304#comment-13537304 ] Sandy Ryza commented on MAPREDUCE-4896: --- [root@c1414 ~]# mapred queue -info

[jira] [Updated] (MAPREDUCE-4894) Renewal / cancellation of JobHistory tokens

[ https://issues.apache.org/jira/browse/MAPREDUCE-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-4894: -- Attachment: MR-4894.txt Updated patch. Renewal / cancellation of

[jira] [Updated] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-4842: Attachment: mapreduce-4842.patch Made it more robust. Set {{inProgress}} to

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537354#comment-13537354 ] Hadoop QA commented on MAPREDUCE-4842: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4894) Renewal / cancellation of JobHistory tokens

[ https://issues.apache.org/jira/browse/MAPREDUCE-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537359#comment-13537359 ] Daryn Sharp commented on MAPREDUCE-4894: I think it looks ok. I'd like to see

[jira] [Commented] (MAPREDUCE-4894) Renewal / cancellation of JobHistory tokens

[ https://issues.apache.org/jira/browse/MAPREDUCE-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537362#comment-13537362 ] Daryn Sharp commented on MAPREDUCE-4894: Oh, and

[jira] [Created] (MAPREDUCE-4897) Using both MultipleInputs.addInputPath methods causes mappers to fail

glad...@gmail.com created MAPREDUCE-4897: Summary: Using both MultipleInputs.addInputPath methods causes mappers to fail Key: MAPREDUCE-4897 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4897

[jira] [Commented] (MAPREDUCE-4851) add lifecycle to Comparators

[ https://issues.apache.org/jira/browse/MAPREDUCE-4851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537377#comment-13537377 ] Radim Kolar commented on MAPREDUCE-4851: yes, taskattempt level lifecycle

[jira] [Commented] (MAPREDUCE-4897) Using both MultipleInputs.addInputPath methods causes mappers to fail

[ https://issues.apache.org/jira/browse/MAPREDUCE-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537382#comment-13537382 ] Harsh J commented on MAPREDUCE-4897: A simple workaround until this is resolved

[jira] [Commented] (MAPREDUCE-4897) Using both MultipleInputs.addInputPath methods causes mappers to fail

[ https://issues.apache.org/jira/browse/MAPREDUCE-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537393#comment-13537393 ] glad...@gmail.com commented on MAPREDUCE-4897: -- I just provided the

[jira] [Updated] (MAPREDUCE-4845) ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2

[ https://issues.apache.org/jira/browse/MAPREDUCE-4845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-4845: - Fix Version/s: 0.23.6 ClusterStatus.getMaxMemory() and getUsedMemory() exist in

[jira] [Updated] (MAPREDUCE-4896) mapred queue -info spits out ugly exception when queue does not exist

[ https://issues.apache.org/jira/browse/MAPREDUCE-4896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-4896: -- Attachment: MAPREDUCE-4896.patch mapred queue -info spits out ugly exception when

[jira] [Commented] (MAPREDUCE-4896) mapred queue -info spits out ugly exception when queue does not exist

[ https://issues.apache.org/jira/browse/MAPREDUCE-4896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537447#comment-13537447 ] Sandy Ryza commented on MAPREDUCE-4896: --- Tested manually that the patch fixes

[jira] [Updated] (MAPREDUCE-4896) mapred queue -info spits out ugly exception when queue does not exist

[ https://issues.apache.org/jira/browse/MAPREDUCE-4896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-4896: -- Status: Patch Available (was: Open) mapred queue -info spits out ugly exception when

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537450#comment-13537450 ] Jason Lowe commented on MAPREDUCE-4842: --- I'm mostly OK with the latest patch

[jira] [Commented] (MAPREDUCE-4894) Renewal / cancellation of JobHistory tokens

[ https://issues.apache.org/jira/browse/MAPREDUCE-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537454#comment-13537454 ] Siddharth Seth commented on MAPREDUCE-4894: --- Cancelling the MR side of the

[jira] [Updated] (MAPREDUCE-4892) CombineFileInputFormat node input split can be skewed on small clusters

[ https://issues.apache.org/jira/browse/MAPREDUCE-4892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated MAPREDUCE-4892: -- Attachment: MAPREDUCE-4892.1.patch The logic to balance the load on the nodes is to

[jira] [Updated] (MAPREDUCE-4892) CombineFileInputFormat node input split can be skewed on small clusters

[ https://issues.apache.org/jira/browse/MAPREDUCE-4892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated MAPREDUCE-4892: -- Status: Patch Available (was: Open) CombineFileInputFormat node input split can be

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537460#comment-13537460 ] Siddharth Seth commented on MAPREDUCE-4842: --- bq. Asokan, for this specific

[jira] [Commented] (MAPREDUCE-4896) mapred queue -info spits out ugly exception when queue does not exist

[ https://issues.apache.org/jira/browse/MAPREDUCE-4896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537502#comment-13537502 ] Hadoop QA commented on MAPREDUCE-4896: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4892) CombineFileInputFormat node input split can be skewed on small clusters

[ https://issues.apache.org/jira/browse/MAPREDUCE-4892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537523#comment-13537523 ] Hadoop QA commented on MAPREDUCE-4892: -- {color:green}+1 overall{color}. Here are

[jira] [Updated] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-4842: Attachment: mapreduce-4842.patch Hi Jason, Thanks for your comments. I

[jira] [Created] (MAPREDUCE-4898) FileOutputFormat.checkOutputSpecs and FileOutputFormat.setOutputPath incompatible with MR1

Robert Kanter created MAPREDUCE-4898: Summary: FileOutputFormat.checkOutputSpecs and FileOutputFormat.setOutputPath incompatible with MR1 Key: MAPREDUCE-4898 URL:

[jira] [Updated] (MAPREDUCE-4067) Replace YarnRemoteException with IOException in MRv2 APIs

[ https://issues.apache.org/jira/browse/MAPREDUCE-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated MAPREDUCE-4067: - Attachment: MAPREDUCE-4067.1.patch Replace the YarnRemoteException with IOException in below

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537608#comment-13537608 ] Hadoop QA commented on MAPREDUCE-4842: -- {color:green}+1 overall{color}. Here are

[jira] [Updated] (MAPREDUCE-4898) FileOutputFormat.checkOutputSpecs and FileOutputFormat.setOutputPath incompatible with MR1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-4898: - Attachment: MAPREDUCE-4898.patch FileOutputFormat.checkOutputSpecs and

[jira] [Updated] (MAPREDUCE-4898) FileOutputFormat.checkOutputSpecs and FileOutputFormat.setOutputPath incompatible with MR1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-4898: - Status: Patch Available (was: Open) FileOutputFormat.checkOutputSpecs and

[jira] [Commented] (MAPREDUCE-4898) FileOutputFormat.checkOutputSpecs and FileOutputFormat.setOutputPath incompatible with MR1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537638#comment-13537638 ] Hadoop QA commented on MAPREDUCE-4898: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4898) FileOutputFormat.checkOutputSpecs and FileOutputFormat.setOutputPath incompatible with MR1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537639#comment-13537639 ] Karthik Kambatla commented on MAPREDUCE-4898: - Thanks Robert. The patch

[jira] [Updated] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-4808: Attachment: MergeManagerPlugin.pdf MAPREDUCE-4808.patch Hi

[jira] [Updated] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-4808: Status: Patch Available (was: Open) Allow reduce-side merge to be

[jira] [Updated] (MAPREDUCE-3268) MR2 capacity scheduler doesn't spread tasks evenly on an underutilized cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-3268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated MAPREDUCE-3268: --- Component/s: (was: mrv2) MR2 capacity scheduler doesn't spread tasks evenly on an

[jira] [Updated] (MAPREDUCE-3268) YARN capacity scheduler doesn't spread MR tasks evenly on an underutilized cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-3268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated MAPREDUCE-3268: --- Summary: YARN capacity scheduler doesn't spread MR tasks evenly on an underutilized cluster

[jira] [Commented] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537647#comment-13537647 ] Hadoop QA commented on MAPREDUCE-4808: -- {color:red}-1 overall{color}. Here are

[jira] [Updated] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-4808: Attachment: (was: MAPREDUCE-4808.patch) Allow reduce-side merge to be

[jira] [Updated] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-4808: Attachment: mapreduce-4808.patch Allow reduce-side merge to be pluggable

[jira] [Commented] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13537663#comment-13537663 ] Hadoop QA commented on MAPREDUCE-4808: -- {color:green}+1 overall{color}. Here are

[jira] [Resolved] (MAPREDUCE-4888) NLineInputFormat drops data in 1.1 and beyond

[ https://issues.apache.org/jira/browse/MAPREDUCE-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-4888. -- Resolution: Fixed Fix Version/s: 1.1.2 I just committed this. Thanks Vinod