[jira] [Updated] (MAPREDUCE-4843) When using DefaultTaskController, JobLocalizer not thread safe

2012-12-05 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated MAPREDUCE-4843: Attachment: MAPREDUCE-4843-branch-1.1.patch Update patch. When using

[jira] [Updated] (MAPREDUCE-4843) When using DefaultTaskController, JobLocalizer not thread safe

2012-12-05 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated MAPREDUCE-4843: Status: Patch Available (was: Open) Testing patch When using

[jira] [Created] (MAPREDUCE-4849) TaskSelector not used in FairScheduler

2012-12-05 Thread Vincent Behar (JIRA)
Vincent Behar created MAPREDUCE-4849: Summary: TaskSelector not used in FairScheduler Key: MAPREDUCE-4849 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4849 Project: Hadoop Map/Reduce

[jira] [Updated] (MAPREDUCE-4732) testcase testJobRetire fails using IBM JAVA

2012-12-05 Thread Amir Sanjar (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amir Sanjar updated MAPREDUCE-4732: --- Summary: testcase testJobRetire fails using IBM JAVA (was: testcase testJobRetire

[jira] [Commented] (MAPREDUCE-4732) testcase testJobRetire fails using IBM JAVA

2012-12-05 Thread Amir Sanjar (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13510486#comment-13510486 ] Amir Sanjar commented on MAPREDUCE-4732: was able to reprouduce on IBM JAVA

[jira] [Updated] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-05 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-4842: - Status: Open (was: Patch Available) Shuffle race can hang reducer

[jira] [Updated] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-05 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-4842: - Attachment: MAPREDUCE-4842.patch Jason, nice unit test! Thanks! I've modified it a

[jira] [Assigned] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-05 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy reassigned MAPREDUCE-4842: Assignee: Jason Lowe (was: Arun C Murthy) Shuffle race can hang reducer

[jira] [Created] (MAPREDUCE-4850) Job recovery may fail if staging directory has been deleted

2012-12-05 Thread Tom White (JIRA)
Tom White created MAPREDUCE-4850: Summary: Job recovery may fail if staging directory has been deleted Key: MAPREDUCE-4850 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4850 Project: Hadoop

[jira] [Updated] (MAPREDUCE-4850) Job recovery may fail if staging directory has been deleted

2012-12-05 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated MAPREDUCE-4850: - Attachment: MAPREDUCE-4850.patch A patch that deletes the staging directory after the system

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-05 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13510664#comment-13510664 ] Alejandro Abdelnur commented on MAPREDUCE-4842: --- One minor NIT, the

[jira] [Updated] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-4842: -- Attachment: MAPREDUCE-4842.patch Thanks for the reviews, Alejandro and Arun. I updated

[jira] [Commented] (MAPREDUCE-4696) TestMRServerPorts throws NullReferenceException

2012-12-05 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13510832#comment-13510832 ] Siddharth Seth commented on MAPREDUCE-4696: --- +1. Simple enough patch. Will

[jira] [Commented] (MAPREDUCE-4697) TestMapredHeartbeat fails assertion on HeartbeatInterval

2012-12-05 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13510833#comment-13510833 ] Siddharth Seth commented on MAPREDUCE-4697: --- +1. Will commit shortly.

[jira] [Updated] (MAPREDUCE-4699) TestFairScheduler TestCapacityScheduler fails due to JobHistory exception

2012-12-05 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-4699: -- Attachment: MAPREDUCE4699.txt The current patch looks good for the

[jira] [Updated] (MAPREDUCE-4696) TestMRServerPorts throws NullReferenceException

2012-12-05 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-4696: -- Resolution: Fixed Fix Version/s: 1.1.2 Hadoop Flags: Reviewed

[jira] [Updated] (MAPREDUCE-4697) TestMapredHeartbeat fails assertion on HeartbeatInterval

2012-12-05 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-4697: -- Resolution: Fixed Fix Version/s: 1.1.2 Hadoop Flags: Reviewed

[jira] [Resolved] (MAPREDUCE-4699) TestFairScheduler TestCapacityScheduler fails due to JobHistory exception

2012-12-05 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved MAPREDUCE-4699. --- Resolution: Fixed Fix Version/s: 1.1.2 Hadoop Flags: Reviewed

[jira] [Commented] (MAPREDUCE-4845) ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2

2012-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13510896#comment-13510896 ] Hadoop QA commented on MAPREDUCE-4845: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4839) TextPartioner for hashing Text with good hashing function to get better distribution

2012-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13510901#comment-13510901 ] Hadoop QA commented on MAPREDUCE-4839: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4843) When using DefaultTaskController, JobLocalizer not thread safe

2012-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13510899#comment-13510899 ] Hadoop QA commented on MAPREDUCE-4843: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4827) Increase hash quality of HashPartitioner

2012-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13510911#comment-13510911 ] Hadoop QA commented on MAPREDUCE-4827: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4594) Add init/shutdown methods to mapreduce Partitioner

2012-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13510922#comment-13510922 ] Hadoop QA commented on MAPREDUCE-4594: -- {color:red}-1 overall{color}. Here are

[jira] [Updated] (MAPREDUCE-4839) TextPartioner for hashing Text with good hashing function to get better distribution

2012-12-05 Thread Radim Kolar (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radim Kolar updated MAPREDUCE-4839: --- Attachment: textpartitioner2.txt TextPartioner for hashing Text with good hashing

[jira] [Updated] (MAPREDUCE-4827) Increase hash quality of HashPartitioner

2012-12-05 Thread Radim Kolar (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radim Kolar updated MAPREDUCE-4827: --- Attachment: betterhash2.txt change it for old mapred api as well

[jira] [Commented] (MAPREDUCE-4843) When using DefaultTaskController, JobLocalizer not thread safe

2012-12-05 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13511003#comment-13511003 ] Karthik Kambatla commented on MAPREDUCE-4843: - [~zhaoyunjiong] The patch

[jira] [Commented] (MAPREDUCE-4843) When using DefaultTaskController, JobLocalizer not thread safe

2012-12-05 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13511019#comment-13511019 ] zhaoyunjiong commented on MAPREDUCE-4843: - No need for trunk. In hadoop 2.0,

[jira] [Commented] (MAPREDUCE-4594) Add init/shutdown methods to mapreduce Partitioner

2012-12-05 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13511028#comment-13511028 ] Harsh J commented on MAPREDUCE-4594: I notice no objects (such as an attempt

[jira] [Commented] (MAPREDUCE-4843) When using DefaultTaskController, JobLocalizer not thread safe

2012-12-05 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13511029#comment-13511029 ] Karthik Kambatla commented on MAPREDUCE-4843: - My bad - read the branch

[jira] [Commented] (MAPREDUCE-4847) Command Parsing in Hadoop Streaming

2012-12-05 Thread Peng Lei (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13511031#comment-13511031 ] Peng Lei commented on MAPREDUCE-4847: - Thank you for your comment! I have put the

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

2012-12-05 Thread Mariappan Asokan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13511039#comment-13511039 ] Mariappan Asokan commented on MAPREDUCE-4842: - Hi Jason, Arun, and

[jira] [Commented] (MAPREDUCE-4839) TextPartioner for hashing Text with good hashing function to get better distribution

2012-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13511041#comment-13511041 ] Hadoop QA commented on MAPREDUCE-4839: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4812) Create reduce input merger plugin in ReduceTask.java and pass it to Shuffle

2012-12-05 Thread Mariappan Asokan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13511045#comment-13511045 ] Mariappan Asokan commented on MAPREDUCE-4812: - Hi Arun, I have some

[jira] [Commented] (MAPREDUCE-4827) Increase hash quality of HashPartitioner

2012-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13511046#comment-13511046 ] Hadoop QA commented on MAPREDUCE-4827: -- {color:red}-1 overall{color}. Here are