[jira] [Resolved] (MAPREDUCE-4888) NLineInputFormat drops data in 1.1 and beyond

2012-12-20 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-4888. -- Resolution: Fixed Fix Version/s: 1.1.2 I just committed this. Thanks Vinod a

[jira] [Commented] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

2012-12-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537663#comment-13537663 ] Hadoop QA commented on MAPREDUCE-4808: -- {color:green}+1 overall{color}. Here are

[jira] [Updated] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

2012-12-20 Thread Mariappan Asokan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-4808: Attachment: mapreduce-4808.patch > Allow reduce-side merge to be pluggable

[jira] [Updated] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

2012-12-20 Thread Mariappan Asokan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-4808: Attachment: (was: MAPREDUCE-4808.patch) > Allow reduce-side merge to be

[jira] [Commented] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

2012-12-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537647#comment-13537647 ] Hadoop QA commented on MAPREDUCE-4808: -- {color:red}-1 overall{color}. Here are t

[jira] [Updated] (MAPREDUCE-3268) YARN capacity scheduler doesn't spread MR tasks evenly on an underutilized cluster

2012-12-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated MAPREDUCE-3268: --- Summary: YARN capacity scheduler doesn't spread MR tasks evenly on an underutilized cluster (was

[jira] [Updated] (MAPREDUCE-3268) MR2 capacity scheduler doesn't spread tasks evenly on an underutilized cluster

2012-12-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated MAPREDUCE-3268: --- Component/s: (was: mrv2) > MR2 capacity scheduler doesn't spread tasks evenly on an under

[jira] [Updated] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

2012-12-20 Thread Mariappan Asokan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-4808: Status: Patch Available (was: Open) > Allow reduce-side merge to be plugga

[jira] [Updated] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

2012-12-20 Thread Mariappan Asokan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-4808: Attachment: MergeManagerPlugin.pdf MAPREDUCE-4808.patch Hi Tom,

[jira] [Commented] (MAPREDUCE-4898) FileOutputFormat.checkOutputSpecs and FileOutputFormat.setOutputPath incompatible with MR1

2012-12-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537639#comment-13537639 ] Karthik Kambatla commented on MAPREDUCE-4898: - Thanks Robert. The patch lo

[jira] [Commented] (MAPREDUCE-4898) FileOutputFormat.checkOutputSpecs and FileOutputFormat.setOutputPath incompatible with MR1

2012-12-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537638#comment-13537638 ] Hadoop QA commented on MAPREDUCE-4898: -- {color:green}+1 overall{color}. Here are

[jira] [Updated] (MAPREDUCE-4898) FileOutputFormat.checkOutputSpecs and FileOutputFormat.setOutputPath incompatible with MR1

2012-12-20 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-4898: - Status: Patch Available (was: Open) > FileOutputFormat.checkOutputSpecs and File

[jira] [Updated] (MAPREDUCE-4898) FileOutputFormat.checkOutputSpecs and FileOutputFormat.setOutputPath incompatible with MR1

2012-12-20 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-4898: - Attachment: MAPREDUCE-4898.patch > FileOutputFormat.checkOutputSpecs and FileOutp

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537608#comment-13537608 ] Hadoop QA commented on MAPREDUCE-4842: -- {color:green}+1 overall{color}. Here are

[jira] [Updated] (MAPREDUCE-4067) Replace YarnRemoteException with IOException in MRv2 APIs

2012-12-20 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated MAPREDUCE-4067: - Attachment: MAPREDUCE-4067.1.patch Replace the YarnRemoteException with IOException in below

[jira] [Created] (MAPREDUCE-4898) FileOutputFormat.checkOutputSpecs and FileOutputFormat.setOutputPath incompatible with MR1

2012-12-20 Thread Robert Kanter (JIRA)
Robert Kanter created MAPREDUCE-4898: Summary: FileOutputFormat.checkOutputSpecs and FileOutputFormat.setOutputPath incompatible with MR1 Key: MAPREDUCE-4898 URL: https://issues.apache.org/jira/browse/MAPREDUC

[jira] [Updated] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-20 Thread Mariappan Asokan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-4842: Attachment: mapreduce-4842.patch Hi Jason, Thanks for your comments. I think

[jira] [Commented] (MAPREDUCE-4892) CombineFileInputFormat node input split can be skewed on small clusters

2012-12-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537523#comment-13537523 ] Hadoop QA commented on MAPREDUCE-4892: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4896) "mapred queue -info" spits out ugly exception when queue does not exist

2012-12-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537502#comment-13537502 ] Hadoop QA commented on MAPREDUCE-4896: -- {color:red}-1 overall{color}. Here are t

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537460#comment-13537460 ] Siddharth Seth commented on MAPREDUCE-4842: --- bq. Asokan, for this specific J

[jira] [Updated] (MAPREDUCE-4892) CombineFileInputFormat node input split can be skewed on small clusters

2012-12-20 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated MAPREDUCE-4892: -- Attachment: MAPREDUCE-4892.1.patch The logic to balance the load on the nodes is to determi

[jira] [Updated] (MAPREDUCE-4892) CombineFileInputFormat node input split can be skewed on small clusters

2012-12-20 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated MAPREDUCE-4892: -- Status: Patch Available (was: Open) > CombineFileInputFormat node input split can be s

[jira] [Commented] (MAPREDUCE-4894) Renewal / cancellation of JobHistory tokens

2012-12-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537454#comment-13537454 ] Siddharth Seth commented on MAPREDUCE-4894: --- Cancelling the MR side of the p

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537450#comment-13537450 ] Jason Lowe commented on MAPREDUCE-4842: --- I'm mostly OK with the latest patch exc

[jira] [Updated] (MAPREDUCE-4896) "mapred queue -info" spits out ugly exception when queue does not exist

2012-12-20 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-4896: -- Attachment: MAPREDUCE-4896.patch > "mapred queue -info" spits out ugly exception when q

[jira] [Commented] (MAPREDUCE-4896) "mapred queue -info" spits out ugly exception when queue does not exist

2012-12-20 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537447#comment-13537447 ] Sandy Ryza commented on MAPREDUCE-4896: --- Tested manually that the patch fixes it

[jira] [Updated] (MAPREDUCE-4896) "mapred queue -info" spits out ugly exception when queue does not exist

2012-12-20 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-4896: -- Status: Patch Available (was: Open) > "mapred queue -info" spits out ugly exception wh

[jira] [Updated] (MAPREDUCE-4845) ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2

2012-12-20 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-4845: - Fix Version/s: 0.23.6 > ClusterStatus.getMaxMemory() and getUsedMemory() exist in

[jira] [Commented] (MAPREDUCE-4897) Using both MultipleInputs.addInputPath methods causes mappers to fail

2012-12-20 Thread glad...@gmail.com (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537393#comment-13537393 ] glad...@gmail.com commented on MAPREDUCE-4897: -- I just provided the ident

[jira] [Commented] (MAPREDUCE-4897) Using both MultipleInputs.addInputPath methods causes mappers to fail

2012-12-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537382#comment-13537382 ] Harsh J commented on MAPREDUCE-4897: A simple workaround until this is resolved ma

[jira] [Commented] (MAPREDUCE-4851) add lifecycle to Comparators

2012-12-20 Thread Radim Kolar (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537377#comment-13537377 ] Radim Kolar commented on MAPREDUCE-4851: yes, taskattempt level lifecycle (sam

[jira] [Created] (MAPREDUCE-4897) Using both MultipleInputs.addInputPath methods causes mappers to fail

2012-12-20 Thread glad...@gmail.com (JIRA)
glad...@gmail.com created MAPREDUCE-4897: Summary: Using both MultipleInputs.addInputPath methods causes mappers to fail Key: MAPREDUCE-4897 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4897

[jira] [Commented] (MAPREDUCE-4894) Renewal / cancellation of JobHistory tokens

2012-12-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537362#comment-13537362 ] Daryn Sharp commented on MAPREDUCE-4894: Oh, and {{CancelDelegationTokenRespon

[jira] [Commented] (MAPREDUCE-4894) Renewal / cancellation of JobHistory tokens

2012-12-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537359#comment-13537359 ] Daryn Sharp commented on MAPREDUCE-4894: I think it looks ok. I'd like to see

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537354#comment-13537354 ] Hadoop QA commented on MAPREDUCE-4842: -- {color:green}+1 overall{color}. Here are

[jira] [Updated] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-20 Thread Mariappan Asokan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-4842: Attachment: mapreduce-4842.patch Made it more robust. Set {{inProgress}} to {{

[jira] [Updated] (MAPREDUCE-4894) Renewal / cancellation of JobHistory tokens

2012-12-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-4894: -- Attachment: MR-4894.txt Updated patch. > Renewal / cancellation of

[jira] [Commented] (MAPREDUCE-4896) "mapred queue -info" spits out ugly exception when queue does not exist

2012-12-20 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537304#comment-13537304 ] Sandy Ryza commented on MAPREDUCE-4896: --- [root@c1414 ~]# mapred queue -info test

[jira] [Created] (MAPREDUCE-4896) "mapred queue -info" spits out ugly exception when queue does not exist

2012-12-20 Thread Sandy Ryza (JIRA)
Sandy Ryza created MAPREDUCE-4896: - Summary: "mapred queue -info" spits out ugly exception when queue does not exist Key: MAPREDUCE-4896 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4896 Proje

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537267#comment-13537267 ] Hadoop QA commented on MAPREDUCE-4842: -- {color:green}+1 overall{color}. Here are

[jira] [Updated] (MAPREDUCE-4894) Renewal / cancellation of JobHistory tokens

2012-12-20 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-4894: - Priority: Blocker (was: Major) > Renewal / cancellation of JobHistory tokens > -

[jira] [Updated] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-20 Thread Mariappan Asokan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-4842: Attachment: mapreduce-4842.patch Hi Jason, Thanks for the quick review of the

[jira] [Updated] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

2012-12-20 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-4808: - Status: Open (was: Patch Available) Mariappan, can you pls put up a design doc on ho

[jira] [Updated] (MAPREDUCE-4171) Add a test for YARN Schedulers' MAXIMUM_ALLOCATION limits

2012-12-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated MAPREDUCE-4171: --- Summary: Add a test for YARN Schedulers' MAXIMUM_ALLOCATION limits (was: Add a test for MR2's Sc

[jira] [Updated] (MAPREDUCE-4856) TestJobOutputCommitter uses same directory as TestJobCleanup

2012-12-20 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-4856: - Fix Version/s: 0.23.6 I pulled this into branch-0.23. > TestJobOutpu

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537195#comment-13537195 ] Hadoop QA commented on MAPREDUCE-4842: -- {color:red}-1 overall{color}. Here are t

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537188#comment-13537188 ] Hadoop QA commented on MAPREDUCE-4842: -- {color:red}-1 overall{color}. Here are t

[jira] [Commented] (MAPREDUCE-4806) Cleanup: Some (5) private methods in JobTracker.RecoveryManager are not used anymore after MAPREDUCE-3837

2012-12-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537190#comment-13537190 ] Karthik Kambatla commented on MAPREDUCE-4806: - Thanks for looking into thi

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537186#comment-13537186 ] Jason Lowe commented on MAPREDUCE-4842: --- Patch race, sorry about that Asokan. T

[jira] [Updated] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-20 Thread Mariappan Asokan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-4842: Attachment: mapreduce-4842.patch > Shuffle race can hang reducer >

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-20 Thread Mariappan Asokan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537181#comment-13537181 ] Mariappan Asokan commented on MAPREDUCE-4842: - Thanks to all of you for yo

[jira] [Updated] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-4842: -- Assignee: Mariappan Asokan (was: Jason Lowe) Status: Patch Available (was: Open)

[jira] [Updated] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-4842: -- Attachment: MAPREDUCE-4842-2.patch In the interest of trying to push this forward faster, h

[jira] [Updated] (MAPREDUCE-4861) Cleanup: Remove unused mapreduce.security.token.DelegationTokenRenewal

2012-12-20 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-4861: - Fix Version/s: 0.23.6 I pulled this into branch-0.23 > Cleanup: Remo

[jira] [Commented] (MAPREDUCE-4888) NLineInputFormat drops data in 1.1 and beyond

2012-12-20 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537173#comment-13537173 ] Robert Joseph Evans commented on MAPREDUCE-4888: But that is very mino

[jira] [Comment Edited] (MAPREDUCE-4888) NLineInputFormat drops data in 1.1 and beyond

2012-12-20 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537170#comment-13537170 ] Robert Joseph Evans edited comment on MAPREDUCE-4888 at 12/20/12 5:21 PM: --

[jira] [Commented] (MAPREDUCE-4888) NLineInputFormat drops data in 1.1 and beyond

2012-12-20 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537170#comment-13537170 ] Robert Joseph Evans commented on MAPREDUCE-4888: I am +1 of it too. M

[jira] [Updated] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

2012-12-20 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-4895: - Fix Version/s: 0.23.6 I pulled this into branch 0.23 along with YARN-223

[jira] [Updated] (MAPREDUCE-4806) Cleanup: Some (5) private methods in JobTracker.RecoveryManager are not used anymore after MAPREDUCE-3837

2012-12-20 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated MAPREDUCE-4806: - Resolution: Fixed Fix Version/s: 1.2.0 Hadoop Flags: Reviewed Status: R

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537096#comment-13537096 ] Jason Lowe commented on MAPREDUCE-4842: --- Regarding the removal of the element in

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-20 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537088#comment-13537088 ] Alejandro Abdelnur commented on MAPREDUCE-4842: --- If Asokan's approach ad

[jira] [Commented] (MAPREDUCE-4894) Renewal / cancellation of JobHistory tokens

2012-12-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537082#comment-13537082 ] Daryn Sharp commented on MAPREDUCE-4894: I think the comment on YARN-50 regard

[jira] [Commented] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

2012-12-20 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537070#comment-13537070 ] Tom White commented on MAPREDUCE-4808: -- These changes look reasonable to me. The

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-20 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537063#comment-13537063 ] Thomas Graves commented on MAPREDUCE-4842: -- I ran the latest patch through so

[jira] [Updated] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

2012-12-20 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-4895: - Resolution: Fixed Fix Version/s: 2.0.3-alpha Target Version/s: 2.0.3-

[jira] [Commented] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

2012-12-20 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537051#comment-13537051 ] Thomas Graves commented on MAPREDUCE-4895: -- +1. This patch only applies to br

[jira] [Updated] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

2012-12-20 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-4895: - Assignee: Dennis Y (was: Thomas Graves) > Fix compilation failure of > org.apac

[jira] [Commented] (MAPREDUCE-4887) Rehashing partitioner for better distribution

2012-12-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13537011#comment-13537011 ] Hudson commented on MAPREDUCE-4887: --- Integrated in Hadoop-Hdfs-trunk #1260 (See [ht

[jira] [Updated] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

2012-12-20 Thread Dennis Y (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Y updated MAPREDUCE-4895: Assignee: Thomas Graves Status: Patch Available (was: Open) > Fix compilation failur

[jira] [Assigned] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

2012-12-20 Thread Dennis Y (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Y reassigned MAPREDUCE-4895: --- Assignee: (was: Thomas Graves) > Fix compilation failure of > org.apache.hadoop.

[jira] [Updated] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

2012-12-20 Thread Dennis Y (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Y updated MAPREDUCE-4895: Status: Open (was: Patch Available) > Fix compilation failure of > org.apache.hadoop.mapr

[jira] [Commented] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

2012-12-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536968#comment-13536968 ] Hadoop QA commented on MAPREDUCE-4895: -- {color:red}-1 overall{color}. Here are t

[jira] [Updated] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

2012-12-20 Thread Dennis Y (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Y updated MAPREDUCE-4895: Attachment: MAPREDUCE-4895-branch-2-patch-from-[branch-2-gd]-to-[fb-MAPREDUCE-4895-branch-2-gd]

[jira] [Updated] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

2012-12-20 Thread Dennis Y (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Y updated MAPREDUCE-4895: Assignee: Thomas Graves Status: Patch Available (was: Open) > Fix compilation failur

[jira] [Updated] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

2012-12-20 Thread Dennis Y (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Y updated MAPREDUCE-4895: Description: Task https://issues.apache.org/jira/browse/YARN-223 breaks compilation of 'Apache

[jira] [Created] (MAPREDUCE-4895) Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators

2012-12-20 Thread Dennis Y (JIRA)
Dennis Y created MAPREDUCE-4895: --- Summary: Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators Key: MAPREDUCE-4895 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4895

[jira] [Commented] (MAPREDUCE-4887) Rehashing partitioner for better distribution

2012-12-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536958#comment-13536958 ] Hudson commented on MAPREDUCE-4887: --- Integrated in Hadoop-Yarn-trunk #71 (See [http

[jira] [Commented] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

2012-12-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536914#comment-13536914 ] Junping Du commented on MAPREDUCE-4886: --- Yes. It should due to -noFile configura

[jira] [Resolved] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

2012-12-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved MAPREDUCE-4886. --- Resolution: Not A Problem > TestCapacityScheduler failed in branch-1 > --

[jira] [Commented] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

2012-12-20 Thread meng gong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536883#comment-13536883 ] meng gong commented on MAPREDUCE-4886: -- 1.These failures are caused for this Test

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536875#comment-13536875 ] Siddharth Seth commented on MAPREDUCE-4842: --- bq. You are right that such a s

[jira] [Assigned] (MAPREDUCE-4886) TestCapacityScheduler failed in branch-1

2012-12-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned MAPREDUCE-4886: - Assignee: meng gong > TestCapacityScheduler failed in branch-1 >

[jira] [Updated] (MAPREDUCE-4894) Renewal / cancellation of JobHistory tokens

2012-12-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-4894: -- Attachment: MAPREDUCE-4894_wip.txt Work in progress. More details on YARN-50.

[jira] [Created] (MAPREDUCE-4894) Renewal / cancellation of JobHistory tokens

2012-12-20 Thread Siddharth Seth (JIRA)
Siddharth Seth created MAPREDUCE-4894: - Summary: Renewal / cancellation of JobHistory tokens Key: MAPREDUCE-4894 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4894 Project: Hadoop Map/Reduce