[jira] [Updated] (MAPREDUCE-4875) coverage fixing for org.apache.hadoop.mapred

2013-01-22 Thread Aleksey Gorshkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksey Gorshkov updated MAPREDUCE-4875: Attachment: (was: MAPREDUCE-4875-trunk.patch) coverage fixing for

[jira] [Updated] (MAPREDUCE-4875) coverage fixing for org.apache.hadoop.mapred

2013-01-22 Thread Aleksey Gorshkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksey Gorshkov updated MAPREDUCE-4875: Attachment: (was: MAPREDUCE-4875-branch-0.23.patch) coverage fixing

[jira] [Updated] (MAPREDUCE-4875) coverage fixing for org.apache.hadoop.mapred

2013-01-22 Thread Aleksey Gorshkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksey Gorshkov updated MAPREDUCE-4875: Attachment: MAPREDUCE-4875-trunk.patch

[jira] [Commented] (MAPREDUCE-4951) Container preemption interpreted as task failure

2013-01-22 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13559593#comment-13559593 ] Tom White commented on MAPREDUCE-4951: -- The change looks good to me, but

[jira] [Commented] (MAPREDUCE-4875) coverage fixing for org.apache.hadoop.mapred

2013-01-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13559597#comment-13559597 ] Hadoop QA commented on MAPREDUCE-4875: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4929) mapreduce.task.timeout is ignored

2013-01-22 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13559635#comment-13559635 ] Tom White commented on MAPREDUCE-4929: -- +1 the precedence looks right to me.

[jira] [Commented] (MAPREDUCE-2931) CLONE - LocalJobRunner should support parallel mapper execution

2013-01-22 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13559642#comment-13559642 ] Tom White commented on MAPREDUCE-2931: -- This would be good to have. Sandy, if you

[jira] [Updated] (MAPREDUCE-4808) Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations

2013-01-22 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated MAPREDUCE-4808: -- Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Reviewed

[jira] [Commented] (MAPREDUCE-4808) Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations

2013-01-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13559658#comment-13559658 ] Hudson commented on MAPREDUCE-4808: --- Integrated in Hadoop-trunk-Commit #3266 (See

[jira] [Updated] (MAPREDUCE-4946) Type conversion of map completion events leads to performance problems with large jobs

2013-01-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-4946: -- Attachment: MAPREDUCE-4946-branch-0.23.patch Thanks for the review, Sidd. Attaching the

[jira] [Commented] (MAPREDUCE-4946) Type conversion of map completion events leads to performance problems with large jobs

2013-01-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13559722#comment-13559722 ] Hadoop QA commented on MAPREDUCE-4946: -- {color:red}-1 overall{color}. Here are

[jira] [Created] (MAPREDUCE-4954) ShuffleHandler logs excessively when channel closed prematurely by reducer

2013-01-22 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-4954: - Summary: ShuffleHandler logs excessively when channel closed prematurely by reducer Key: MAPREDUCE-4954 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4954

[jira] [Resolved] (MAPREDUCE-4954) ShuffleHandler logs excessively when channel closed prematurely by reducer

2013-01-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-4954. --- Resolution: Not A Problem Sorry for the noise, I discovered the nodemanager in question

[jira] [Updated] (MAPREDUCE-4949) Enable multiple pi jobs to run in parallel

2013-01-22 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated MAPREDUCE-4949: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Hadoop Flags:

[jira] [Commented] (MAPREDUCE-4949) Enable multiple pi jobs to run in parallel

2013-01-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13559753#comment-13559753 ] Hudson commented on MAPREDUCE-4949: --- Integrated in Hadoop-trunk-Commit #3267 (See

[jira] [Commented] (MAPREDUCE-4946) Type conversion of map completion events leads to performance problems with large jobs

2013-01-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13559771#comment-13559771 ] Jason Lowe commented on MAPREDUCE-4946: --- Ran test-patch manually on the

[jira] [Commented] (MAPREDUCE-4808) Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations

2013-01-22 Thread Mariappan Asokan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13559785#comment-13559785 ] Mariappan Asokan commented on MAPREDUCE-4808: - Alejandro, thanks for

[jira] [Commented] (MAPREDUCE-4951) Container preemption interpreted as task failure

2013-01-22 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13559849#comment-13559849 ] Bikas Saha commented on MAPREDUCE-4951: --- From what I see in the code. Both

[jira] [Commented] (MAPREDUCE-4946) Type conversion of map completion events leads to performance problems with large jobs

2013-01-22 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13559895#comment-13559895 ] Siddharth Seth commented on MAPREDUCE-4946: --- +1. Looks good. Committing

[jira] [Updated] (MAPREDUCE-4946) Type conversion of map completion events leads to performance problems with large jobs

2013-01-22 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-4946: -- Resolution: Fixed Fix Version/s: 0.23.7 2.0.3-alpha

[jira] [Commented] (MAPREDUCE-4946) Type conversion of map completion events leads to performance problems with large jobs

2013-01-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13559904#comment-13559904 ] Hudson commented on MAPREDUCE-4946: --- Integrated in Hadoop-trunk-Commit #3268 (See

[jira] [Created] (MAPREDUCE-4955) NM container diagnostics for excess resource usage can be lost if task fails while being killed

2013-01-22 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-4955: - Summary: NM container diagnostics for excess resource usage can be lost if task fails while being killed Key: MAPREDUCE-4955 URL:

[jira] [Commented] (MAPREDUCE-4951) Container preemption interpreted as task failure

2013-01-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13559978#comment-13559978 ] Jason Lowe commented on MAPREDUCE-4951: --- Like the comment states in

[jira] [Commented] (MAPREDUCE-4951) Container preemption interpreted as task failure

2013-01-22 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13560031#comment-13560031 ] Bikas Saha commented on MAPREDUCE-4951: --- I think its RM killing the container

[jira] [Commented] (MAPREDUCE-4949) Enable multiple pi jobs to run in parallel

2013-01-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13560066#comment-13560066 ] Sandy Ryza commented on MAPREDUCE-4949: --- Thanks Alejandro!

[jira] [Commented] (MAPREDUCE-4951) Container preemption interpreted as task failure

2013-01-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13560090#comment-13560090 ] Sandy Ryza commented on MAPREDUCE-4951: --- Tom, Regarding the other special exit

[jira] [Commented] (MAPREDUCE-4951) Container preemption interpreted as task failure

2013-01-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13560107#comment-13560107 ] Jason Lowe commented on MAPREDUCE-4951: --- bq. That's correct that a

[jira] [Commented] (MAPREDUCE-4951) Container preemption interpreted as task failure

2013-01-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13560111#comment-13560111 ] Sandy Ryza commented on MAPREDUCE-4951: --- bq. If the RM is indeed telling the NM

[jira] [Commented] (MAPREDUCE-4951) Container preemption interpreted as task failure

2013-01-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13560116#comment-13560116 ] Jason Lowe commented on MAPREDUCE-4951: --- Arguably it's yet another instance of

[jira] [Commented] (MAPREDUCE-4951) Container preemption interpreted as task failure

2013-01-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13560123#comment-13560123 ] Jason Lowe commented on MAPREDUCE-4951: --- Note that I'm not sure whether the fix

[jira] [Commented] (MAPREDUCE-3837) Job tracker is not able to recover job in case of crash and after that no user can submit job.

2013-01-22 Thread Manish Malhotra (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13560169#comment-13560169 ] Manish Malhotra commented on MAPREDUCE-3837: Hi, Thanks for this patch,

[jira] [Commented] (MAPREDUCE-4951) Container preemption interpreted as task failure

2013-01-22 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13560174#comment-13560174 ] Hitesh Shah commented on MAPREDUCE-4951: @Jason, having the RM ask the AM to

[jira] [Commented] (MAPREDUCE-2931) CLONE - LocalJobRunner should support parallel mapper execution

2013-01-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13560255#comment-13560255 ] Sandy Ryza commented on MAPREDUCE-2931: --- Yeah, I did already and everything

[jira] [Updated] (MAPREDUCE-4951) Container preemption interpreted as task failure

2013-01-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-4951: -- Attachment: MAPREDUCE-4951-2.patch Container preemption interpreted as task failure

[jira] [Commented] (MAPREDUCE-4951) Container preemption interpreted as task failure

2013-01-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13560265#comment-13560265 ] Sandy Ryza commented on MAPREDUCE-4951: --- Uploaded a patch that removes the

[jira] [Commented] (MAPREDUCE-4951) Container preemption interpreted as task failure

2013-01-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13560281#comment-13560281 ] Hadoop QA commented on MAPREDUCE-4951: -- {color:green}+1 overall{color}. Here are

[jira] [Updated] (MAPREDUCE-4838) Add extra info to JH files

2013-01-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated MAPREDUCE-4838: --- Attachment: MAPREDUCE-4838_2.patch Hi Sid, Thanks for your comments. I've incorporated