[jira] [Updated] (MAPREDUCE-2841) Task level native optimization

[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Zhong updated MAPREDUCE-2841: -- Status: Patch Available (was: In Progress) > Task level native optimization > -

[jira] [Updated] (MAPREDUCE-2841) Task level native optimization

[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Zhong updated MAPREDUCE-2841: -- Status: In Progress (was: Patch Available) > Task level native optimization > -

[jira] [Updated] (MAPREDUCE-2841) Task level native optimization

[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Zhong updated MAPREDUCE-2841: -- Attachment: mr-2841-merge-3.patch Use git diff to generate this patch. Also includes fix in

[jira] [Updated] (MAPREDUCE-6077) Remove CustomModule examples in nativetask

[ https://issues.apache.org/jira/browse/MAPREDUCE-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Zhong updated MAPREDUCE-6077: -- Attachment: MAPREDUCE-6077.patch patch for this > Remove CustomModule examples in nativetas

[jira] [Commented] (MAPREDUCE-6076) Zero map split input length combine with none zero map split input length will cause MR1 job hung.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14124286#comment-14124286 ] Hadoop QA commented on MAPREDUCE-6076: -- {color:red}-1 overall{color}. Here are t

[jira] [Commented] (MAPREDUCE-2841) Task level native optimization

[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14124284#comment-14124284 ] Hadoop QA commented on MAPREDUCE-2841: -- {color:red}-1 overall{color}. Here are t

[jira] [Commented] (MAPREDUCE-6076) Zero map split input length combine with none zero map split input length will cause MR1 job hung.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14124281#comment-14124281 ] zhihai xu commented on MAPREDUCE-6076: -- A patch:MAPREDUCE-6076.branch-1.000.patch

[jira] [Created] (MAPREDUCE-6077) Remove CustomModule examples in nativetask

Sean Zhong created MAPREDUCE-6077: - Summary: Remove CustomModule examples in nativetask Key: MAPREDUCE-6077 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6077 Project: Hadoop Map/Reduce

[jira] [Updated] (MAPREDUCE-6076) Zero map split input length combine with none zero map split input length will cause MR1 job hung.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated MAPREDUCE-6076: - Status: Patch Available (was: Open) > Zero map split input length combine with none zero map

[jira] [Updated] (MAPREDUCE-6076) Zero map split input length combine with none zero map split input length will cause MR1 job hung.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated MAPREDUCE-6076: - Attachment: MAPREDUCE-6076.branch-1.000.patch > Zero map split input length combine with none

[jira] [Resolved] (MAPREDUCE-6074) native-task: fix release audit, javadoc, javac warnings

[ https://issues.apache.org/jira/browse/MAPREDUCE-6074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved MAPREDUCE-6074. Resolution: Fixed Hadoop Flags: Reviewed Thanks. Committed this to branch. > nati

[jira] [Commented] (MAPREDUCE-2841) Task level native optimization

[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14124279#comment-14124279 ] Todd Lipcon commented on MAPREDUCE-2841: Hey Sean. Did you file a separate JIR

[jira] [Commented] (MAPREDUCE-6074) native-task: fix release audit, javadoc, javac warnings

[ https://issues.apache.org/jira/browse/MAPREDUCE-6074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14124276#comment-14124276 ] Sean Zhong commented on MAPREDUCE-6074: --- It looks good. +1. I will clean up th

[jira] [Updated] (MAPREDUCE-2841) Task level native optimization

[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Zhong updated MAPREDUCE-2841: -- Status: Patch Available (was: In Progress) > Task level native optimization > -

[jira] [Updated] (MAPREDUCE-2841) Task level native optimization

[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Zhong updated MAPREDUCE-2841: -- Attachment: mr-2841-merge-2.txt new patch after removing the customModule > Task level nati

[jira] [Updated] (MAPREDUCE-2841) Task level native optimization

[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Zhong updated MAPREDUCE-2841: -- Status: In Progress (was: Patch Available) > Task level native optimization > -

[jira] [Commented] (MAPREDUCE-2841) Task level native optimization

[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14124270#comment-14124270 ] Sean Zhong commented on MAPREDUCE-2841: --- Hi Todd, In that case, we can remove C

[jira] [Created] (MAPREDUCE-6076) Zero map split input length combine with none zero map split input length will cause MR1 job hung.

zhihai xu created MAPREDUCE-6076: Summary: Zero map split input length combine with none zero map split input length will cause MR1 job hung. Key: MAPREDUCE-6076 URL: https://issues.apache.org/jira/browse/MAPRED

[jira] [Commented] (MAPREDUCE-6075) HistoryServerFileSystemStateStore can create zero-length files

[ https://issues.apache.org/jira/browse/MAPREDUCE-6075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14123862#comment-14123862 ] Hadoop QA commented on MAPREDUCE-6075: -- {color:red}-1 overall{color}. Here are t

[jira] [Commented] (MAPREDUCE-6046) Change the class name for logs in RMCommunicator.java

[ https://issues.apache.org/jira/browse/MAPREDUCE-6046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14123797#comment-14123797 ] Hadoop QA commented on MAPREDUCE-6046: -- {color:red}-1 overall{color}. Here are t

[jira] [Updated] (MAPREDUCE-6046) Change the class name for logs in RMCommunicator.java

[ https://issues.apache.org/jira/browse/MAPREDUCE-6046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated MAPREDUCE-6046: -- Assignee: Sahil Takiar > Change the class name for logs in RMCommunicator.java > ---

[jira] [Updated] (MAPREDUCE-6074) native-task: fix release audit, javadoc, javac warnings

[ https://issues.apache.org/jira/browse/MAPREDUCE-6074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-6074: --- Attachment: mapreduce-6074.txt > native-task: fix release audit, javadoc, javac warnings >

[jira] [Commented] (MAPREDUCE-6046) Change the class name for logs in RMCommunicator.java

[ https://issues.apache.org/jira/browse/MAPREDUCE-6046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14123739#comment-14123739 ] Tsuyoshi OZAWA commented on MAPREDUCE-6046: --- Thanks for your contribution, [

[jira] [Updated] (MAPREDUCE-6074) native-task: fix release audit, javadoc, javac warnings

[ https://issues.apache.org/jira/browse/MAPREDUCE-6074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-6074: --- Summary: native-task: fix release audit, javadoc, javac warnings (was: native-task: fix r

[jira] [Commented] (MAPREDUCE-6075) HistoryServerFileSystemStateStore can create zero-length files

[ https://issues.apache.org/jira/browse/MAPREDUCE-6075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14123734#comment-14123734 ] Tsuyoshi OZAWA commented on MAPREDUCE-6075: --- [~jlowe], thanks for your contr

[jira] [Updated] (MAPREDUCE-6075) HistoryServerFileSystemStateStore can create zero-length files

[ https://issues.apache.org/jira/browse/MAPREDUCE-6075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6075: -- Status: Patch Available (was: Open) > HistoryServerFileSystemStateStore can create zero-len

[jira] [Updated] (MAPREDUCE-6075) HistoryServerFileSystemStateStore can create zero-length files

[ https://issues.apache.org/jira/browse/MAPREDUCE-6075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6075: -- Attachment: MAPREDUCE-6075.patch Patch to call close() before IOUtils.cleanup so we don't si

[jira] [Updated] (MAPREDUCE-6046) Change the class name for logs in RMCommunicator.java

[ https://issues.apache.org/jira/browse/MAPREDUCE-6046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated MAPREDUCE-6046: Status: Patch Available (was: Open) > Change the class name for logs in RMCommunicator.

[jira] [Commented] (MAPREDUCE-6046) Change the class name for logs in RMCommunicator.java

[ https://issues.apache.org/jira/browse/MAPREDUCE-6046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14123706#comment-14123706 ] Sahil Takiar commented on MAPREDUCE-6046: - Patch submitted > Change the class

[jira] [Updated] (MAPREDUCE-6046) Change the class name for logs in RMCommunicator.java

[ https://issues.apache.org/jira/browse/MAPREDUCE-6046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated MAPREDUCE-6046: Attachment: MAPREDUCE-6046-01.patch > Change the class name for logs in RMCommunicator.j

[jira] [Commented] (MAPREDUCE-5933) Enable MR AM to post history events to the timeline server

[ https://issues.apache.org/jira/browse/MAPREDUCE-5933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14123658#comment-14123658 ] Zhijie Shen commented on MAPREDUCE-5933: Hi [~rkanter], thanks for taking care

[jira] [Created] (MAPREDUCE-6075) HistoryServerFileSystemStateStore can create zero-length files

Jason Lowe created MAPREDUCE-6075: - Summary: HistoryServerFileSystemStateStore can create zero-length files Key: MAPREDUCE-6075 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6075 Project: Hadoo

[jira] [Updated] (MAPREDUCE-6074) native-task: fix release audit warnings

[ https://issues.apache.org/jira/browse/MAPREDUCE-6074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-6074: --- Attachment: mapreduce-6074.txt * Remove javah output files (these are generated at bui

[jira] [Created] (MAPREDUCE-6074) native-task: fix release audit warnings

Todd Lipcon created MAPREDUCE-6074: -- Summary: native-task: fix release audit warnings Key: MAPREDUCE-6074 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6074 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-2841) Task level native optimization

[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14123496#comment-14123496 ] Todd Lipcon commented on MAPREDUCE-2841: It looks like there are some issues w

[jira] [Updated] (MAPREDUCE-5951) Add support for the YARN Shared Cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-5951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated MAPREDUCE-5951: Attachment: MAPREDUCE-5951-trunk-v5.patch Attached v5. Updated to match patch in YARN-14

[jira] [Commented] (MAPREDUCE-2841) Task level native optimization

[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14123332#comment-14123332 ] Hadoop QA commented on MAPREDUCE-2841: -- {color:red}-1 overall{color}. Here are t

[jira] [Updated] (MAPREDUCE-2841) Task level native optimization

[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-2841: --- Status: Patch Available (was: Open) BTW, in case anyone is worried about destabilizing ex

[jira] [Updated] (MAPREDUCE-2841) Task level native optimization

[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-2841: --- Attachment: mr-2841-merge.txt Attaching a candidate merge patch to get a Jenkins run. This

[jira] [Resolved] (MAPREDUCE-6069) native-task: Style fixups and dead code removal

[ https://issues.apache.org/jira/browse/MAPREDUCE-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved MAPREDUCE-6069. Resolution: Fixed Assignee: Todd Lipcon Hadoop Flags: Reviewed Committed t

[jira] [Commented] (MAPREDUCE-6073) Description of mapreduce.job.speculative.slowtaskthreshold in mapred-default should be moved into description tags

[ https://issues.apache.org/jira/browse/MAPREDUCE-6073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14123160#comment-14123160 ] Hadoop QA commented on MAPREDUCE-6073: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-6070) yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented

[ https://issues.apache.org/jira/browse/MAPREDUCE-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14123159#comment-14123159 ] Hadoop QA commented on MAPREDUCE-6070: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-6071) JobImpl#makeUberDecision doesn't log that Uber mode is disabled because of too much CPUs

[ https://issues.apache.org/jira/browse/MAPREDUCE-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14123127#comment-14123127 ] Tsuyoshi OZAWA commented on MAPREDUCE-6071: --- Thanks for your review, Jason!

[jira] [Updated] (MAPREDUCE-6073) Description of mapreduce.job.speculative.slowtaskthreshold in mapred-default should be moved into description tags

[ https://issues.apache.org/jira/browse/MAPREDUCE-6073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated MAPREDUCE-6073: -- Attachment: MAPREDUCE-6073.1.patch Attached a first patch to fix this issue. > Desc

[jira] [Updated] (MAPREDUCE-6073) Description of mapreduce.job.speculative.slowtaskthreshold in mapred-default should be moved into description tags

[ https://issues.apache.org/jira/browse/MAPREDUCE-6073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated MAPREDUCE-6073: -- Status: Patch Available (was: Open) > Description of mapreduce.job.speculative.slow

[jira] [Created] (MAPREDUCE-6073) Description of mapreduce.job.speculative.slowtaskthreshold in mapred-default should be moved into description tags

Tsuyoshi OZAWA created MAPREDUCE-6073: - Summary: Description of mapreduce.job.speculative.slowtaskthreshold in mapred-default should be moved into description tags Key: MAPREDUCE-6073 URL: https://issues.apac

[jira] [Updated] (MAPREDUCE-6070) yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented

[ https://issues.apache.org/jira/browse/MAPREDUCE-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated MAPREDUCE-6070: -- Attachment: MAPREDUCE-6070.2.patch Thanks for your review, Jason. I think your point

[jira] [Commented] (MAPREDUCE-6070) yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented

[ https://issues.apache.org/jira/browse/MAPREDUCE-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122970#comment-14122970 ] Jason Lowe commented on MAPREDUCE-6070: --- Do we want to put these details in the

[jira] [Updated] (MAPREDUCE-6071) JobImpl#makeUberDecision doesn't log that Uber mode is disabled because of too much CPUs

[ https://issues.apache.org/jira/browse/MAPREDUCE-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6071: -- Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-6071) JobImpl#makeUberDecision doesn't log that Uber mode is disabled because of too much CPUs

[ https://issues.apache.org/jira/browse/MAPREDUCE-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122922#comment-14122922 ] Jason Lowe commented on MAPREDUCE-6071: --- +1 lgtm. Committing this. > JobImpl#m

[jira] [Commented] (MAPREDUCE-6069) native-task: Style fixups and dead code removal

[ https://issues.apache.org/jira/browse/MAPREDUCE-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122559#comment-14122559 ] Manu Zhang commented on MAPREDUCE-6069: --- double checked and tests passed. +1. Th

[jira] [Updated] (MAPREDUCE-6069) native-task: Style fixups and dead code removal

[ https://issues.apache.org/jira/browse/MAPREDUCE-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-6069: --- Attachment: mr-6069.txt rebased the patch. Also removed dead commented-out code from TestS

[jira] [Resolved] (MAPREDUCE-6067) native-task: fix some counter issues

[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Zhong resolved MAPREDUCE-6067. --- Resolution: Fixed mark as resolved. > native-task: fix some counter issues >

[jira] [Commented] (MAPREDUCE-6069) native-task: Style fixups and dead code removal

[ https://issues.apache.org/jira/browse/MAPREDUCE-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122538#comment-14122538 ] Sean Zhong commented on MAPREDUCE-6069: --- +1， thanks! > native-task: Style fixup

[jira] [Commented] (MAPREDUCE-6069) native-task: Style fixups and dead code removal

[ https://issues.apache.org/jira/browse/MAPREDUCE-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122537#comment-14122537 ] Manu Zhang commented on MAPREDUCE-6069: --- checked the clean-up only touches dead