[jira] [Updated] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated MAPREDUCE-6067: - Attachment: MAPREDUCE-6067.v2.patch Update the patch, changes: 1. add counter support

[jira] [Updated] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated MAPREDUCE-6067: - Attachment: MAPREDUCE-6067.v3.patch The earlier patch can't apply, rebase to lastest b

[jira] [Updated] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated MAPREDUCE-6067: - Attachment: MAPREDUCE-6067.v4.patch Fix a minor bug in MAP_OUTPUT_BYTES counter calcul

[jira] [Commented] (MAPREDUCE-6063) In sortAndSpill of MapTask.java, size is calculated wrongly when bufend < bufstart.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14121254#comment-14121254 ] Hudson commented on MAPREDUCE-6063: --- FAILURE: Integrated in Hadoop-Yarn-trunk #670 (

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14121306#comment-14121306 ] Sean Zhong commented on MAPREDUCE-6067: --- Hi Binglin, Thanks for your patch. I h

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14121309#comment-14121309 ] Sean Zhong commented on MAPREDUCE-6067: --- By the way, the patches doesn't applies

[jira] [Commented] (MAPREDUCE-6063) In sortAndSpill of MapTask.java, size is calculated wrongly when bufend < bufstart.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14121356#comment-14121356 ] Hudson commented on MAPREDUCE-6063: --- FAILURE: Integrated in Hadoop-Hdfs-trunk #1861

[jira] [Updated] (MAPREDUCE-5279) Jobs can deadlock if headroom is limited by cpu instead of memory

[ https://issues.apache.org/jira/browse/MAPREDUCE-5279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5279: -- Priority: Critical (was: Major) Target Version/s: 2.6.0 Summary: Jo

[jira] [Commented] (MAPREDUCE-5279) Jobs can deadlock if headroom is limited by cpu instead of memory

[ https://issues.apache.org/jira/browse/MAPREDUCE-5279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14121484#comment-14121484 ] Hadoop QA commented on MAPREDUCE-5279: -- {color:red}-1 overall{color}. Here are t

[jira] [Commented] (MAPREDUCE-6063) In sortAndSpill of MapTask.java, size is calculated wrongly when bufend < bufstart.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14121540#comment-14121540 ] Hudson commented on MAPREDUCE-6063: --- FAILURE: Integrated in Hadoop-Mapreduce-trunk #

[jira] [Commented] (MAPREDUCE-6063) In sortAndSpill of MapTask.java, size is calculated wrongly when bufend < bufstart.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14121968#comment-14121968 ] Chris Douglas commented on MAPREDUCE-6063: -- bq. This issue is also in MR1 (br

[jira] [Moved] (MAPREDUCE-6070) yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented

[ https://issues.apache.org/jira/browse/MAPREDUCE-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA moved YARN-2078 to MAPREDUCE-6070: - Component/s: (was: documentation)

[jira] [Commented] (MAPREDUCE-6070) yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented

[ https://issues.apache.org/jira/browse/MAPREDUCE-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122129#comment-14122129 ] Tsuyoshi OZAWA commented on MAPREDUCE-6070: --- [~jlowe], could you check this

[jira] [Updated] (MAPREDUCE-6070) yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented

[ https://issues.apache.org/jira/browse/MAPREDUCE-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated MAPREDUCE-6070: -- Affects Version/s: 2.5.0 > yarn.app.am.resource.mb/cpu-vcores affects uber mode but

[jira] [Moved] (MAPREDUCE-6071) JobImpl#makeUberDecision doesn't log that Uber mode is disabled because of too much CPUs

[ https://issues.apache.org/jira/browse/MAPREDUCE-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA moved YARN-2077 to MAPREDUCE-6071: - Component/s: (was: client) cl

[jira] [Commented] (MAPREDUCE-6071) JobImpl#makeUberDecision doesn't log that Uber mode is disabled because of too much CPUs

[ https://issues.apache.org/jira/browse/MAPREDUCE-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122130#comment-14122130 ] Tsuyoshi OZAWA commented on MAPREDUCE-6071: --- Moved this from YARN to MapRedu

[jira] [Commented] (MAPREDUCE-6070) yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented

[ https://issues.apache.org/jira/browse/MAPREDUCE-6070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122159#comment-14122159 ] Hadoop QA commented on MAPREDUCE-6070: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-6071) JobImpl#makeUberDecision doesn't log that Uber mode is disabled because of too much CPUs

[ https://issues.apache.org/jira/browse/MAPREDUCE-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122167#comment-14122167 ] Hadoop QA commented on MAPREDUCE-6071: -- {color:red}-1 overall{color}. Here are t

[jira] [Created] (MAPREDUCE-6072) Remove INSTALL document

Akira AJISAKA created MAPREDUCE-6072: Summary: Remove INSTALL document Key: MAPREDUCE-6072 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6072 Project: Hadoop Map/Reduce Issue Type:

[jira] [Updated] (MAPREDUCE-6072) Remove INSTALL document

[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-6072: - Attachment: MAPREDUCE-6072.patch Attaching a patch. > Remove INSTALL document > -

[jira] [Updated] (MAPREDUCE-6072) Remove INSTALL document

[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-6072: - Labels: newbie (was: ) Target Version/s: 2.6.0 Status: Pat

[jira] [Commented] (MAPREDUCE-6072) Remove INSTALL document

[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122290#comment-14122290 ] Tsuyoshi OZAWA commented on MAPREDUCE-6072: --- [~ajisakaa] how about adding a

[jira] [Updated] (MAPREDUCE-6072) Remove INSTALL document

[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-6072: - Status: Open (was: Patch Available) > Remove INSTALL document > -

[jira] [Commented] (MAPREDUCE-6072) Remove INSTALL document

[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122295#comment-14122295 ] Akira AJISAKA commented on MAPREDUCE-6072: -- Thanks [~ozawa] for the comment.

[jira] [Updated] (MAPREDUCE-6072) Remove INSTALL document

[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-6072: - Attachment: MAPREDUCE-6072.2.patch Updated the patch. > Remove INSTALL document > ---

[jira] [Updated] (MAPREDUCE-6072) Update INSTALL document

[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-6072: - Description: "./hadoop-mapreduce-project/INSTALL" has become stale. The document shows

[jira] [Updated] (MAPREDUCE-6072) Update INSTALL document

[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-6072: - Status: Patch Available (was: Open) > Update INSTALL document > -

[jira] [Commented] (MAPREDUCE-6072) Update INSTALL document

[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122310#comment-14122310 ] Hadoop QA commented on MAPREDUCE-6072: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122316#comment-14122316 ] Binglin Chang commented on MAPREDUCE-6067: -- Thanks for the comments Manu and

[jira] [Commented] (MAPREDUCE-6063) In sortAndSpill of MapTask.java, size is calculated wrongly when bufend < bufstart.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122327#comment-14122327 ] zhihai xu commented on MAPREDUCE-6063: -- Hi [~chris.douglas], thanks to commit thi

[jira] [Commented] (MAPREDUCE-6072) Update INSTALL document

[ https://issues.apache.org/jira/browse/MAPREDUCE-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122333#comment-14122333 ] Hadoop QA commented on MAPREDUCE-6072: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122344#comment-14122344 ] Sean Zhong commented on MAPREDUCE-6067: --- Hi Binling, {quote} Thanks for the co

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122351#comment-14122351 ] Binglin Chang commented on MAPREDUCE-6067: -- bq. I did saw some seeming trivi

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122356#comment-14122356 ] Sean Zhong commented on MAPREDUCE-6067: --- Here, the variable name is different {q

[jira] [Resolved] (MAPREDUCE-6058) native-task: KVTest and LargeKVTest should check mr job is sucessful

[ https://issues.apache.org/jira/browse/MAPREDUCE-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved MAPREDUCE-6058. Resolution: Fixed ah, I see you're right. Thanks and sorry for the noise > native-task:

[jira] [Updated] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated MAPREDUCE-6067: - Attachment: MAPREDUCE-6067.v5.patch Attach new patch, changes: 1. move all added count

[jira] [Updated] (MAPREDUCE-6069) native-task: Style fixups and dead code removal

[ https://issues.apache.org/jira/browse/MAPREDUCE-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-6069: --- Attachment: mr-6069.txt Oops, I'd uploaded the wrong path file previously. This one should

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122449#comment-14122449 ] Sean Zhong commented on MAPREDUCE-6067: --- +1 for the change. Have you runned thi

[jira] [Commented] (MAPREDUCE-6069) native-task: Style fixups and dead code removal

[ https://issues.apache.org/jira/browse/MAPREDUCE-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122455#comment-14122455 ] Sean Zhong commented on MAPREDUCE-6069: --- Hi Todd, where is the new patch? > na

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122459#comment-14122459 ] Manu Zhang commented on MAPREDUCE-6067: --- patch applied and all tests passed from

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122473#comment-14122473 ] Todd Lipcon commented on MAPREDUCE-6067: I tested Binglin's latest patch (v5)

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122474#comment-14122474 ] Sean Zhong commented on MAPREDUCE-6067: --- +1 > native-task: spilled records coun

[jira] [Commented] (MAPREDUCE-6069) native-task: Style fixups and dead code removal

[ https://issues.apache.org/jira/browse/MAPREDUCE-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122476#comment-14122476 ] Sean Zhong commented on MAPREDUCE-6069: --- The file you uploaded is only 8K, looks

[jira] [Commented] (MAPREDUCE-6069) native-task: Style fixups and dead code removal

[ https://issues.apache.org/jira/browse/MAPREDUCE-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122487#comment-14122487 ] Manu Zhang commented on MAPREDUCE-6069: --- Hi Todd, some native config keys in Co

[jira] [Commented] (MAPREDUCE-6067) native-task: spilled records counter is incorrect

[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122496#comment-14122496 ] Binglin Chang commented on MAPREDUCE-6067: -- Thanks for the review and tests,

[jira] [Updated] (MAPREDUCE-6067) native-task: fix some counter issues

[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated MAPREDUCE-6067: - Summary: native-task: fix some counter issues (was: native-task: spilled records coun

[jira] [Commented] (MAPREDUCE-6067) native-task: fix some counter issues

[ https://issues.apache.org/jira/browse/MAPREDUCE-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122503#comment-14122503 ] Binglin Chang commented on MAPREDUCE-6067: -- I have committed this. > native-

[jira] [Updated] (MAPREDUCE-6069) native-task: Style fixups and dead code removal

[ https://issues.apache.org/jira/browse/MAPREDUCE-6069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-6069: --- Attachment: mr-6069.txt Wow, I'm really bad at uploading patch files. I'm pretty sure this