[jira] [Updated] (MAPREDUCE-6062) Use TestDFSIO test random read : job failed

2014-09-02 Thread chongyuanhuang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chongyuanhuang updated MAPREDUCE-6062: -- Assignee: Koji Noguchi Use TestDFSIO test random read : job failed

[jira] [Updated] (MAPREDUCE-6056) nativetask: move system test working dir to target dir and cleanup test config xml files

2014-09-02 Thread Manu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manu Zhang updated MAPREDUCE-6056: -- Attachment: mapreduce-6056-v4.txt patch updated and rebased after pulling in

[jira] [Commented] (MAPREDUCE-6056) nativetask: move system test working dir to target dir and cleanup test config xml files

2014-09-02 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14118018#comment-14118018 ] Binglin Chang commented on MAPREDUCE-6056: -- Patch lgtm, +1, will commit soon.

[jira] [Resolved] (MAPREDUCE-6056) nativetask: move system test working dir to target dir and cleanup test config xml files

2014-09-02 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang resolved MAPREDUCE-6056. -- Resolution: Fixed Committed, thanks Manu. nativetask: move system test working

[jira] [Created] (MAPREDUCE-6063) In sortAndSpill of MapTask.java, size is calculated wrongly when bufend bufstart.

2014-09-02 Thread zhihai xu (JIRA)
zhihai xu created MAPREDUCE-6063: Summary: In sortAndSpill of MapTask.java, size is calculated wrongly when bufend bufstart. Key: MAPREDUCE-6063 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6063

[jira] [Commented] (MAPREDUCE-5721) RM occur exception while unregistering

2014-09-02 Thread chillon_m (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14118253#comment-14118253 ] chillon_m commented on MAPREDUCE-5721: -- i didn't modify the

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

2014-09-02 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14118290#comment-14118290 ] Ming Ma commented on MAPREDUCE-5891: Thanks, Junping, Jason for the useful patch.

[jira] [Updated] (MAPREDUCE-5465) Container killed before hprof dumps profile.out

2014-09-02 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated MAPREDUCE-5465: --- Status: Open (was: Patch Available) Container killed before hprof dumps profile.out

[jira] [Updated] (MAPREDUCE-5465) Container killed before hprof dumps profile.out

2014-09-02 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated MAPREDUCE-5465: --- Status: Patch Available (was: Open) Container killed before hprof dumps profile.out

[jira] [Updated] (MAPREDUCE-6063) In sortAndSpill of MapTask.java, size is calculated wrongly when bufend bufstart.

2014-09-02 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated MAPREDUCE-6063: - Attachment: MAPREDUCE-6063.000.patch In sortAndSpill of MapTask.java, size is calculated

[jira] [Updated] (MAPREDUCE-6063) In sortAndSpill of MapTask.java, size is calculated wrongly when bufend bufstart.

2014-09-02 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated MAPREDUCE-6063: - Status: Patch Available (was: Open) I attached a patch for review. In sortAndSpill of

[jira] [Commented] (MAPREDUCE-6063) In sortAndSpill of MapTask.java, size is calculated wrongly when bufend bufstart.

2014-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14118619#comment-14118619 ] Hadoop QA commented on MAPREDUCE-6063: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

2014-09-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14118727#comment-14118727 ] Jason Lowe commented on MAPREDUCE-5891: --- Thanks for updating the patch, Junping.

[jira] [Commented] (MAPREDUCE-6057) Remove obsolete entries from mapred-default.xml

2014-09-02 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14118991#comment-14118991 ] Ray Chiang commented on MAPREDUCE-6057: --- The file

[jira] [Commented] (MAPREDUCE-6057) Remove obsolete entries from mapred-default.xml

2014-09-02 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119000#comment-14119000 ] Ray Chiang commented on MAPREDUCE-6057: --- For map.sort.class, I see two options:

[jira] [Moved] (MAPREDUCE-6064) Bad links to jobhistory server

2014-09-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla moved YARN-2490 to MAPREDUCE-6064: --- Key: MAPREDUCE-6064 (was: YARN-2490) Project:

[jira] [Commented] (MAPREDUCE-6064) Bad links to jobhistory server

2014-09-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119051#comment-14119051 ] Karthik Kambatla commented on MAPREDUCE-6064: - It might be reasonable to

[jira] [Commented] (MAPREDUCE-2841) Task level native optimization

2014-09-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119174#comment-14119174 ] Todd Lipcon commented on MAPREDUCE-2841: FYI, I'm running terasort

[jira] [Created] (MAPREDUCE-6065) native-task: warnings about illegal Progress values

2014-09-02 Thread Todd Lipcon (JIRA)
Todd Lipcon created MAPREDUCE-6065: -- Summary: native-task: warnings about illegal Progress values Key: MAPREDUCE-6065 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6065 Project: Hadoop

[jira] [Updated] (MAPREDUCE-6065) native-task: warnings about illegal Progress values

2014-09-02 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Zhong updated MAPREDUCE-6065: -- Assignee: Manu Zhang native-task: warnings about illegal Progress values

[jira] [Commented] (MAPREDUCE-2841) Task level native optimization

2014-09-02 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119200#comment-14119200 ] Sean Zhong commented on MAPREDUCE-2841: --- Hi Todd, We typically choose block

[jira] [Commented] (MAPREDUCE-6065) native-task: warnings about illegal Progress values

2014-09-02 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119204#comment-14119204 ] Sean Zhong commented on MAPREDUCE-6065: --- Sure, we will take care of it.

[jira] [Commented] (MAPREDUCE-5992) native-task test logs should not write to console

2014-09-02 Thread Sean Zhong (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119207#comment-14119207 ] Sean Zhong commented on MAPREDUCE-5992: --- Should we mark this as won't fix? I

[jira] [Moved] (MAPREDUCE-6066) Speculative attempts should not run on the same node as their original attempt

2014-09-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza moved YARN-2491 to MAPREDUCE-6066: - Component/s: (was: scheduler)

[jira] [Created] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

2014-09-02 Thread Todd Lipcon (JIRA)
Todd Lipcon created MAPREDUCE-6067: -- Summary: native-task: spilled records counter is incorrect Key: MAPREDUCE-6067 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6067 Project: Hadoop

[jira] [Commented] (MAPREDUCE-6065) native-task: warnings about illegal Progress values

2014-09-02 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119219#comment-14119219 ] Binglin Chang commented on MAPREDUCE-6065: -- Hi I looked into the log, looks

[jira] [Updated] (MAPREDUCE-2841) Task level native optimization

2014-09-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-2841: --- Attachment: MR-2841benchmarks.pdf Attached a report with various benchmark results from

[jira] [Commented] (MAPREDUCE-6065) native-task: warnings about illegal Progress values

2014-09-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119237#comment-14119237 ] Todd Lipcon commented on MAPREDUCE-6065: Ah, I see now that you're right,

[jira] [Resolved] (MAPREDUCE-6065) native-task: warnings about illegal Progress values

2014-09-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved MAPREDUCE-6065. Resolution: Invalid Closed as invalid since this isn't specific to native-task. I'll

[jira] [Resolved] (MAPREDUCE-5993) native-task: simplify/remove dead code

2014-09-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved MAPREDUCE-5993. Resolution: Duplicate This was resolved as part of other cleanup JIRAs. native-task:

[jira] [Updated] (MAPREDUCE-6057) Remove obsolete entries from mapred-default.xml

2014-09-02 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated MAPREDUCE-6057: -- Attachment: MAPREDUCE-6057-01.patch 1) Remove as obsolete:

[jira] [Updated] (MAPREDUCE-6057) Remove obsolete entries from mapred-default.xml

2014-09-02 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated MAPREDUCE-6057: -- Status: Patch Available (was: Open) First version to submit for testing. Remove obsolete

[jira] [Updated] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

2014-09-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-6067: --- Attachment: trunk-counters.html native-counters.html Attached the

[jira] [Updated] (MAPREDUCE-5465) Container killed before hprof dumps profile.out

2014-09-02 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated MAPREDUCE-5465: --- Attachment: MAPREDUCE-5465-8.patch Updated patch to address javac warnings. Container killed

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

2014-09-02 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119375#comment-14119375 ] Binglin Chang commented on MAPREDUCE-6067: -- Thanks for the report Todd. If