[jira] [Commented] (MAPREDUCE-4469) Resource calculation in child tasks is CPU-heavy

2012-11-09 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13493814#comment-13493814 ] Todd Lipcon commented on MAPREDUCE-4469: The problem with the getrusage

[jira] [Commented] (MAPREDUCE-4772) Fetch failures can take way too long for a map to be restarted

2012-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13493899#comment-13493899 ] Hudson commented on MAPREDUCE-4772: --- Integrated in Hadoop-Yarn-trunk #31 (See

[jira] [Commented] (MAPREDUCE-4764) repair test org.apache.hadoop.mapreduce.security.TestBinaryTokenFile

2012-11-09 Thread Ivan A. Veselovsky (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13493959#comment-13493959 ] Ivan A. Veselovsky commented on MAPREDUCE-4764: --- Hi, Daryn, I'd like to

[jira] [Commented] (MAPREDUCE-4772) Fetch failures can take way too long for a map to be restarted

2012-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13493972#comment-13493972 ] Hudson commented on MAPREDUCE-4772: --- Integrated in Hadoop-Hdfs-0.23-Build #430 (See

[jira] [Commented] (MAPREDUCE-4772) Fetch failures can take way too long for a map to be restarted

2012-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13493981#comment-13493981 ] Hudson commented on MAPREDUCE-4772: --- Integrated in Hadoop-Hdfs-trunk #1221 (See

[jira] [Commented] (MAPREDUCE-4772) Fetch failures can take way too long for a map to be restarted

2012-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494006#comment-13494006 ] Hudson commented on MAPREDUCE-4772: --- Integrated in Hadoop-Mapreduce-trunk #1251 (See

[jira] [Assigned] (MAPREDUCE-4782) NLineInputFormat skips first line of last InputSplit

2012-11-09 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned MAPREDUCE-4782: Assignee: Mark Fuhs NLineInputFormat skips first line of last InputSplit

[jira] [Updated] (MAPREDUCE-4782) NLineInputFormat skips first line of last InputSplit

2012-11-09 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated MAPREDUCE-4782: --- Attachment: MR-4782-branch-1.txt Patch for branch-1. The patch is

[jira] [Updated] (MAPREDUCE-4782) NLineInputFormat skips first line of last InputSplit

2012-11-09 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated MAPREDUCE-4782: --- Priority: Blocker (was: Critical) NLineInputFormat skips first

[jira] [Commented] (MAPREDUCE-4782) NLineInputFormat skips first line of last InputSplit

2012-11-09 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494050#comment-13494050 ] Robert Joseph Evans commented on MAPREDUCE-4782: Also now that I think

[jira] [Commented] (MAPREDUCE-4782) NLineInputFormat skips first line of last InputSplit

2012-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494052#comment-13494052 ] Hadoop QA commented on MAPREDUCE-4782: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4782) NLineInputFormat skips first line of last InputSplit

2012-11-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494059#comment-13494059 ] Jason Lowe commented on MAPREDUCE-4782: --- +1, thanks Mark and Bobby. Bobby or

[jira] [Updated] (MAPREDUCE-4266) remove Ant remnants from MR

2012-11-09 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-4266: - Status: Patch Available (was: Open) remove Ant remnants from MR

[jira] [Updated] (MAPREDUCE-4266) remove Ant remnants from MR

2012-11-09 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-4266: - Attachment: MAPREDUCE-4266.sh shell script to remove the directories and xml files.

[jira] [Commented] (MAPREDUCE-4266) remove Ant remnants from MR

2012-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494062#comment-13494062 ] Hadoop QA commented on MAPREDUCE-4266: -- {color:red}-1 overall{color}. Here are

[jira] [Updated] (MAPREDUCE-4782) NLineInputFormat skips first line of last InputSplit

2012-11-09 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated MAPREDUCE-4782: --- Resolution: Fixed Fix Version/s: 0.23.5

[jira] [Commented] (MAPREDUCE-4782) NLineInputFormat skips first line of last InputSplit

2012-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494080#comment-13494080 ] Hudson commented on MAPREDUCE-4782: --- Integrated in Hadoop-trunk-Commit #2988 (See

[jira] [Commented] (MAPREDUCE-4782) NLineInputFormat skips first line of last InputSplit

2012-11-09 Thread Mark Fuhs (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494115#comment-13494115 ] Mark Fuhs commented on MAPREDUCE-4782: -- I'm glad I could contribute!

[jira] [Commented] (MAPREDUCE-4266) remove Ant remnants from MR

2012-11-09 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494139#comment-13494139 ] Robert Joseph Evans commented on MAPREDUCE-4266: The shell script

[jira] [Commented] (MAPREDUCE-4266) remove Ant remnants from MR

2012-11-09 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494141#comment-13494141 ] Robert Joseph Evans commented on MAPREDUCE-4266: Oh and I'll also

[jira] [Commented] (MAPREDUCE-4266) remove Ant remnants from MR

2012-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494145#comment-13494145 ] Hudson commented on MAPREDUCE-4266: --- Integrated in Hadoop-trunk-Commit #2989 (See

[jira] [Commented] (MAPREDUCE-4266) remove Ant remnants from MR

2012-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494162#comment-13494162 ] Hudson commented on MAPREDUCE-4266: --- Integrated in Hadoop-Mapreduce-trunk #1252 (See

[jira] [Commented] (MAPREDUCE-4782) NLineInputFormat skips first line of last InputSplit

2012-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494163#comment-13494163 ] Hudson commented on MAPREDUCE-4782: --- Integrated in Hadoop-Mapreduce-trunk #1252 (See

[jira] [Updated] (MAPREDUCE-4266) remove Ant remnants from MR

2012-11-09 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated MAPREDUCE-4266: --- Resolution: Fixed Fix Version/s: 0.23.5 3.0.0

[jira] [Updated] (MAPREDUCE-2454) Allow external sorter plugin for MR

2012-11-09 Thread Mariappan Asokan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-2454: Status: Open (was: Patch Available) Allow external sorter plugin for MR

[jira] [Updated] (MAPREDUCE-2454) Allow external sorter plugin for MR

2012-11-09 Thread Mariappan Asokan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-2454: Attachment: mapreduce-2454.patch Hi Alejandro, Thanks for catching the

[jira] [Updated] (MAPREDUCE-2454) Allow external sorter plugin for MR

2012-11-09 Thread Mariappan Asokan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-2454: Status: Patch Available (was: Open) Allow external sorter plugin for MR

[jira] [Commented] (MAPREDUCE-2454) Allow external sorter plugin for MR

2012-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494276#comment-13494276 ] Hadoop QA commented on MAPREDUCE-2454: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4751) AM stuck in KILL_WAIT for days

2012-11-09 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494279#comment-13494279 ] Robert Joseph Evans commented on MAPREDUCE-4751: I have been doing a

[jira] [Commented] (MAPREDUCE-4751) AM stuck in KILL_WAIT for days

2012-11-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494295#comment-13494295 ] Jason Lowe commented on MAPREDUCE-4751: --- Part of the issue is that the job is

[jira] [Commented] (MAPREDUCE-4751) AM stuck in KILL_WAIT for days

2012-11-09 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494303#comment-13494303 ] Robert Joseph Evans commented on MAPREDUCE-4751: Yes I think that

[jira] [Commented] (MAPREDUCE-4783) data_join mavenization broke the mr1 build

2012-11-09 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494306#comment-13494306 ] Robert Joseph Evans commented on MAPREDUCE-4783: I think this can be

[jira] [Updated] (MAPREDUCE-4783) data_join mavenization broke the mr1 build

2012-11-09 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated MAPREDUCE-4783: --- Resolution: Duplicate Status: Resolved (was: Patch Available) Great, thanks.

[jira] [Commented] (MAPREDUCE-4666) JVM metrics for history server

2012-11-09 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494353#comment-13494353 ] Jonathan Eagles commented on MAPREDUCE-4666: +1. simple change that works

[jira] [Updated] (MAPREDUCE-4666) JVM metrics for history server

2012-11-09 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated MAPREDUCE-4666: --- Resolution: Fixed Fix Version/s: 0.23.5 2.0.3-alpha

[jira] [Updated] (MAPREDUCE-4774) repair test org.apache.hadoop.mapred.TestClusterMRNotification.testMR

2012-11-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-4774: -- Attachment: MAPREDUCE-4774.patch This test failure is pretty pervasive and annoying, so

[jira] [Updated] (MAPREDUCE-4774) JobImpl does not handle asynchronous task events in FAILED state

2012-11-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-4774: -- Component/s: mrv2 applicationmaster Affects Version/s:

[jira] [Commented] (MAPREDUCE-4666) JVM metrics for history server

2012-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494368#comment-13494368 ] Hudson commented on MAPREDUCE-4666: --- Integrated in Hadoop-trunk-Commit #2996 (See

[jira] [Updated] (MAPREDUCE-4774) JobImpl does not handle asynchronous task events in FAILED state

2012-11-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-4774: -- Assignee: Jason Lowe Target Version/s: 2.0.3-alpha, 0.23.5

[jira] [Commented] (MAPREDUCE-4774) JobImpl does not handle asynchronous task events in FAILED state

2012-11-09 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494377#comment-13494377 ] Robert Joseph Evans commented on MAPREDUCE-4774: The change looks

[jira] [Commented] (MAPREDUCE-4774) JobImpl does not handle asynchronous task events in FAILED state

2012-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494389#comment-13494389 ] Hadoop QA commented on MAPREDUCE-4774: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4774) JobImpl does not handle asynchronous task events in FAILED state

2012-11-09 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494392#comment-13494392 ] Robert Joseph Evans commented on MAPREDUCE-4774: I ran TestRecovery

[jira] [Updated] (MAPREDUCE-4774) JobImpl does not handle asynchronous task events in FAILED state

2012-11-09 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated MAPREDUCE-4774: --- Resolution: Fixed Fix Version/s: 0.23.5

[jira] [Commented] (MAPREDUCE-2454) Allow external sorter plugin for MR

2012-11-09 Thread Mariappan Asokan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494423#comment-13494423 ] Mariappan Asokan commented on MAPREDUCE-2454: - Hi Alejandro, I ran the

[jira] [Commented] (MAPREDUCE-4774) JobImpl does not handle asynchronous task events in FAILED state

2012-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494459#comment-13494459 ] Hudson commented on MAPREDUCE-4774: --- Integrated in Hadoop-trunk-Commit #2997 (See

[jira] [Updated] (MAPREDUCE-4751) AM stuck in KILL_WAIT for days

2012-11-09 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-4751: --- Attachment: MAPREDUCE-4751-20121109.txt Address Bobby's comments

[jira] [Updated] (MAPREDUCE-4751) AM stuck in KILL_WAIT for days

2012-11-09 Thread Vinod Kumar Vavilapalli (JIRA)
Assignee: Vinod Kumar Vavilapalli Attachments: MAPREDUCE-4751-20121108.txt, MAPREDUCE-4751-20121109.txt, TaskAttemptStateGraph.jpg We found some jobs were stuck in KILL_WAIT for days on end. The RM shows them as RUNNING. When you go to the AM, it shows it in the KILL_WAIT

[jira] [Commented] (MAPREDUCE-4751) AM stuck in KILL_WAIT for days

2012-11-09 Thread Vinod Kumar Vavilapalli (JIRA)
/browse/MAPREDUCE-4751 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 0.23.3, 2.0.2-alpha Reporter: Ravi Prakash Assignee: Vinod Kumar Vavilapalli Attachments: MAPREDUCE-4751-20121108.txt, MAPREDUCE-4751-20121109.txt

[jira] [Commented] (MAPREDUCE-4749) Killing multiple attempts of a task taker longer as more attempts are killed

2012-11-09 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494523#comment-13494523 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-4749: Looks good to

[jira] [Commented] (MAPREDUCE-4751) AM stuck in KILL_WAIT for days

2012-11-09 Thread Hadoop QA (JIRA)
are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12552951/MAPREDUCE-4751-20121109.txt against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color

[jira] [Resolved] (MAPREDUCE-4749) Killing multiple attempts of a task taker longer as more attempts are killed

2012-11-09 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved MAPREDUCE-4749. Resolution: Fixed Fix Version/s: 1.1.1 Hadoop