[jira] [Commented] (MAPREDUCE-4629) In DEBUG_MODE, JobHistory#directoryTime() returns incorrect time

2012-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446583#comment-13446583 ] Hadoop QA commented on MAPREDUCE-4629: -- -1 overall. Here are the results of test

[jira] [Updated] (MAPREDUCE-4629) In DEBUG_MODE, JobHistory#directoryTime() returns incorrect time

2012-08-31 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated MAPREDUCE-4629: Attachment: MR-4629.patch Uploading a patch that fixes this issue. The patch:

[jira] [Updated] (MAPREDUCE-4629) In DEBUG_MODE, JobHistory#directoryTime() returns incorrect time

2012-08-31 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated MAPREDUCE-4629: Status: Patch Available (was: In Progress) > In DEBUG_MODE, JobHistory#dir

[jira] [Created] (MAPREDUCE-4629) In DEBUG_MODE, JobHistory#directoryTime() returns incorrect time

2012-08-31 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-4629: --- Summary: In DEBUG_MODE, JobHistory#directoryTime() returns incorrect time Key: MAPREDUCE-4629 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4629

[jira] [Work started] (MAPREDUCE-4629) In DEBUG_MODE, JobHistory#directoryTime() returns incorrect time

2012-08-31 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on MAPREDUCE-4629 started by Karthik Kambatla. > In DEBUG_MODE, JobHistory#directoryTime() returns incorrect time > -

[jira] [Commented] (MAPREDUCE-2786) TestDFSIO should also test compression reading/writing from command-line.

2012-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446579#comment-13446579 ] Hadoop QA commented on MAPREDUCE-2786: -- +1 overall. Here are the results of test

[jira] [Commented] (MAPREDUCE-4607) Race condition in ReduceTask completion can result in Task being incorrectly failed

2012-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446548#comment-13446548 ] Hadoop QA commented on MAPREDUCE-4607: -- +1 overall. Here are the results of test

[jira] [Commented] (MAPREDUCE-4607) Race condition in ReduceTask completion can result in Task being incorrectly failed

2012-08-31 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446528#comment-13446528 ] Bikas Saha commented on MAPREDUCE-4607: --- Attaching patch with fixes 1) Rename Ma

[jira] [Updated] (MAPREDUCE-4607) Race condition in ReduceTask completion can result in Task being incorrectly failed

2012-08-31 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated MAPREDUCE-4607: -- Status: Patch Available (was: Open) > Race condition in ReduceTask completion can resu

[jira] [Updated] (MAPREDUCE-4607) Race condition in ReduceTask completion can result in Task being incorrectly failed

2012-08-31 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated MAPREDUCE-4607: -- Attachment: MAPREDUCE-4607.2.patch > Race condition in ReduceTask completion can result

[jira] [Commented] (MAPREDUCE-4628) Use Builder to get RPC server in Map/Reduce

2012-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446520#comment-13446520 ] Hadoop QA commented on MAPREDUCE-4628: -- +1 overall. Here are the results of test

[jira] [Updated] (MAPREDUCE-4628) Use Builder to get RPC server in Map/Reduce

2012-08-31 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated MAPREDUCE-4628: -- Status: Patch Available (was: Open) > Use Builder to get RPC server in Map/Reduce > --

[jira] [Updated] (MAPREDUCE-4628) Use Builder to get RPC server in Map/Reduce

2012-08-31 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated MAPREDUCE-4628: -- Attachment: MAPREDUCE-4628.patch > Use Builder to get RPC server in Map/Reduce > --

[jira] [Updated] (MAPREDUCE-4628) Use Builder to get RPC server in Map/Reduce

2012-08-31 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated MAPREDUCE-4628: -- Description: In HADOOP-8736, a Builder is introduced to replace all the getServer() variant

[jira] [Created] (MAPREDUCE-4628) Use Builder to get RPC server in Map/Reduce

2012-08-31 Thread Brandon Li (JIRA)
Brandon Li created MAPREDUCE-4628: - Summary: Use Builder to get RPC server in Map/Reduce Key: MAPREDUCE-4628 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4628 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-4624) [MAPREDUCE-3902] Reduce scheduling fixes, factor in MR-4437

2012-08-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved MAPREDUCE-4624. --- Resolution: Fixed Fix Version/s: MR-3902 > [MAPREDUCE-3902] Reduce sch

[jira] [Resolved] (MAPREDUCE-4625) [MAPREDUCE-3902] Statistics logging in the AM scheduler

2012-08-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved MAPREDUCE-4625. --- Resolution: Fixed Fix Version/s: MR-3902 > [MAPREDUCE-3902] Statistics

[jira] [Updated] (MAPREDUCE-4625) [MAPREDUCE-3902] Statistics logging in the AM scheduler

2012-08-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-4625: -- Attachment: MR4625_2.txt Upmerged patch. > [MAPREDUCE-3902] Statis

[jira] [Updated] (MAPREDUCE-4624) [MAPREDUCE-3902] Reduce scheduling fixes, factor in MR-4437

2012-08-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-4624: -- Attachment: MR4624.txt Fixes for reduce scheduling. Incorporates MR-4437, except fo

[jira] [Updated] (MAPREDUCE-4625) [MAPREDUCE-3902] Statistics logging in the AM scheduler

2012-08-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-4625: -- Attachment: MR4625.txt Includes statistics logging for RMContainerRequestor and RMC

[jira] [Commented] (MAPREDUCE-4604) In mapred-default, mapreduce.map.maxattempts & mapreduce.reduce.maxattempts defaults are set to 4 as well as mapreduce.job.maxtaskfailures.per.tracker.

2012-08-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446444#comment-13446444 ] Hudson commented on MAPREDUCE-4604: --- Integrated in Hadoop-Mapreduce-trunk-Commit #26

[jira] [Work started] (MAPREDUCE-4554) Job Credentials are not transmitted if security is turned off

2012-08-31 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on MAPREDUCE-4554 started by Benoy Antony. > Job Credentials are not transmitted if security is turned off >

[jira] [Commented] (MAPREDUCE-4615) [MAPREDUCE-3902] RMContainerAllocator#assign should be split into functions

2012-08-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446429#comment-13446429 ] Siddharth Seth commented on MAPREDUCE-4615: --- Thanks. > [MAP

[jira] [Commented] (MAPREDUCE-4607) Race condition in ReduceTask completion can result in Task being incorrectly failed

2012-08-31 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446427#comment-13446427 ] Bikas Saha commented on MAPREDUCE-4607: --- Yes I am taking care of that too.

[jira] [Commented] (MAPREDUCE-4615) [MAPREDUCE-3902] RMContainerAllocator#assign should be split into functions

2012-08-31 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446423#comment-13446423 ] Tsuyoshi OZAWA commented on MAPREDUCE-4615: --- Sure, NP. > [M

[jira] [Commented] (MAPREDUCE-4607) Race condition in ReduceTask completion can result in Task being incorrectly failed

2012-08-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446408#comment-13446408 ] Siddharth Seth commented on MAPREDUCE-4607: --- Bikas, I think the patch needs

[jira] [Commented] (MAPREDUCE-4604) In mapred-default, mapreduce.map.maxattempts & mapreduce.reduce.maxattempts defaults are set to 4 as well as mapreduce.job.maxtaskfailures.per.tracker.

2012-08-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446403#comment-13446403 ] Hudson commented on MAPREDUCE-4604: --- Integrated in Hadoop-Hdfs-trunk-Commit #2730 (S

[jira] [Commented] (MAPREDUCE-4604) In mapred-default, mapreduce.map.maxattempts & mapreduce.reduce.maxattempts defaults are set to 4 as well as mapreduce.job.maxtaskfailures.per.tracker.

2012-08-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446400#comment-13446400 ] Hudson commented on MAPREDUCE-4604: --- Integrated in Hadoop-Common-trunk-Commit #2667

[jira] [Updated] (MAPREDUCE-4604) In mapred-default, mapreduce.map.maxattempts & mapreduce.reduce.maxattempts defaults are set to 4 as well as mapreduce.job.maxtaskfailures.per.tracker.

2012-08-31 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated MAPREDUCE-4604: --- Resolution: Fixed Fix Version/s: 2.2.0-alpha 3.0.0

[jira] [Commented] (MAPREDUCE-4607) Race condition in ReduceTask completion can result in Task being incorrectly failed

2012-08-31 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446382#comment-13446382 ] Bikas Saha commented on MAPREDUCE-4607: --- [~chaku88] I jumped the gun on the patc

[jira] [Created] (MAPREDUCE-4627) [MAPREDUCE-3902] Handle the JobFinishedEvent correctly

2012-08-31 Thread Siddharth Seth (JIRA)
Siddharth Seth created MAPREDUCE-4627: - Summary: [MAPREDUCE-3902] Handle the JobFinishedEvent correctly Key: MAPREDUCE-4627 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4627 Project: Hadoop

[jira] [Commented] (MAPREDUCE-4611) MR AM dies badly when Node is decomissioned

2012-08-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446376#comment-13446376 ] Hudson commented on MAPREDUCE-4611: --- Integrated in Hadoop-Mapreduce-trunk-Commit #26

[jira] [Commented] (MAPREDUCE-4614) Simplify debugging a job's tokens

2012-08-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446377#comment-13446377 ] Hudson commented on MAPREDUCE-4614: --- Integrated in Hadoop-Mapreduce-trunk-Commit #26

[jira] [Commented] (MAPREDUCE-4612) job summary file permissions not set when its created

2012-08-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446375#comment-13446375 ] Hudson commented on MAPREDUCE-4612: --- Integrated in Hadoop-Mapreduce-trunk-Commit #26

[jira] [Created] (MAPREDUCE-4626) [MAPREDUCE-3902] Fix and re-enable RMContaienrAllocator unit tests

2012-08-31 Thread Siddharth Seth (JIRA)
Siddharth Seth created MAPREDUCE-4626: - Summary: [MAPREDUCE-3902] Fix and re-enable RMContaienrAllocator unit tests Key: MAPREDUCE-4626 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4626 Pr

[jira] [Created] (MAPREDUCE-4624) [MAPREDUCE-3902] Reduce scheduling fixes, factor in MR-4437

2012-08-31 Thread Siddharth Seth (JIRA)
Siddharth Seth created MAPREDUCE-4624: - Summary: [MAPREDUCE-3902] Reduce scheduling fixes, factor in MR-4437 Key: MAPREDUCE-4624 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4624 Project:

[jira] [Created] (MAPREDUCE-4625) [MAPREDUCE-3902] Statistics logging in the AM scheduler

2012-08-31 Thread Siddharth Seth (JIRA)
Siddharth Seth created MAPREDUCE-4625: - Summary: [MAPREDUCE-3902] Statistics logging in the AM scheduler Key: MAPREDUCE-4625 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4625 Project: Hadoo

[jira] [Commented] (MAPREDUCE-4611) MR AM dies badly when Node is decomissioned

2012-08-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446368#comment-13446368 ] Hudson commented on MAPREDUCE-4611: --- Integrated in Hadoop-Common-trunk-Commit #2666

[jira] [Created] (MAPREDUCE-4622) [MAPREDUCE-3902] Unit tests for AMContainer

2012-08-31 Thread Siddharth Seth (JIRA)
Siddharth Seth created MAPREDUCE-4622: - Summary: [MAPREDUCE-3902] Unit tests for AMContainer Key: MAPREDUCE-4622 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4622 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-4623) [MAPREDUCE-3902] Unit tests for AMNode

2012-08-31 Thread Siddharth Seth (JIRA)
Siddharth Seth created MAPREDUCE-4623: - Summary: [MAPREDUCE-3902] Unit tests for AMNode Key: MAPREDUCE-4623 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4623 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-4611) MR AM dies badly when Node is decomissioned

2012-08-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446363#comment-13446363 ] Hudson commented on MAPREDUCE-4611: --- Integrated in Hadoop-Hdfs-trunk-Commit #2729 (S

[jira] [Created] (MAPREDUCE-4621) [MAPREDUCE-3902] Disable AM blacklisting if #blacklistedNodes crosses the configured threshold

2012-08-31 Thread Siddharth Seth (JIRA)
Siddharth Seth created MAPREDUCE-4621: - Summary: [MAPREDUCE-3902] Disable AM blacklisting if #blacklistedNodes crosses the configured threshold Key: MAPREDUCE-4621 URL: https://issues.apache.org/jira/browse/MA

[jira] [Created] (MAPREDUCE-4620) [MAPREDUCE-3902] RMContainerAllocator should factor in nodes being blacklisted

2012-08-31 Thread Siddharth Seth (JIRA)
Siddharth Seth created MAPREDUCE-4620: - Summary: [MAPREDUCE-3902] RMContainerAllocator should factor in nodes being blacklisted Key: MAPREDUCE-4620 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4620

[jira] [Created] (MAPREDUCE-4618) [MAPREDUCE-3902] Re-wire LocalContainerAllocator / UberAM

2012-08-31 Thread Siddharth Seth (JIRA)
Siddharth Seth created MAPREDUCE-4618: - Summary: [MAPREDUCE-3902] Re-wire LocalContainerAllocator / UberAM Key: MAPREDUCE-4618 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4618 Project: Had

[jira] [Created] (MAPREDUCE-4619) [MAPREDUCE-3902] Change AMContainerMap to extend AbstractService

2012-08-31 Thread Siddharth Seth (JIRA)
Siddharth Seth created MAPREDUCE-4619: - Summary: [MAPREDUCE-3902] Change AMContainerMap to extend AbstractService Key: MAPREDUCE-4619 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4619 Proj

[jira] [Created] (MAPREDUCE-4617) [MAPREDUCE-3902] Re-wire AM Recovery

2012-08-31 Thread Siddharth Seth (JIRA)
Siddharth Seth created MAPREDUCE-4617: - Summary: [MAPREDUCE-3902] Re-wire AM Recovery Key: MAPREDUCE-4617 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4617 Project: Hadoop Map/Reduce

[jira] [Updated] (MAPREDUCE-4611) MR AM dies badly when Node is decomissioned

2012-08-31 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-4611: - Resolution: Fixed Fix Version/s: 2.2.0-alpha 3.0.0

[jira] [Commented] (MAPREDUCE-3902) MR AM should reuse containers for map tasks, there-by allowing fine-grained control on num-maps for users without need for CombineFileInputFormat etc.

2012-08-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446355#comment-13446355 ] Siddharth Seth commented on MAPREDUCE-3902: --- You're right. There's a lot of

[jira] [Commented] (MAPREDUCE-4614) Simplify debugging a job's tokens

2012-08-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446354#comment-13446354 ] Hudson commented on MAPREDUCE-4614: --- Integrated in Hadoop-Common-trunk-Commit #2665

[jira] [Commented] (MAPREDUCE-4614) Simplify debugging a job's tokens

2012-08-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446352#comment-13446352 ] Hudson commented on MAPREDUCE-4614: --- Integrated in Hadoop-Hdfs-trunk-Commit #2728 (S

[jira] [Commented] (MAPREDUCE-4615) [MAPREDUCE-3902] RMContainerAllocator#assign should be split into functions

2012-08-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446350#comment-13446350 ] Siddharth Seth commented on MAPREDUCE-4615: --- Tsuyoshi, I'd like to defer com

[jira] [Commented] (MAPREDUCE-4611) MR AM dies badly when Node is decomissioned

2012-08-31 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446347#comment-13446347 ] Thomas Graves commented on MAPREDUCE-4611: -- +1 lgtm. Thanks Bobby!

[jira] [Updated] (MAPREDUCE-4614) Simplify debugging a job's tokens

2012-08-31 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated MAPREDUCE-4614: --- Resolution: Fixed Fix Version/s: 2.2.0-alpha 3.0

[jira] [Commented] (MAPREDUCE-4614) Simplify debugging a job's tokens

2012-08-31 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446343#comment-13446343 ] Robert Joseph Evans commented on MAPREDUCE-4614: The changes look OK t

[jira] [Commented] (MAPREDUCE-4612) job summary file permissions not set when its created

2012-08-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446344#comment-13446344 ] Hudson commented on MAPREDUCE-4612: --- Integrated in Hadoop-Common-trunk-Commit #2664

[jira] [Commented] (MAPREDUCE-4612) job summary file permissions not set when its created

2012-08-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446342#comment-13446342 ] Hudson commented on MAPREDUCE-4612: --- Integrated in Hadoop-Hdfs-trunk-Commit #2727 (S

[jira] [Commented] (MAPREDUCE-4612) job summary file permissions not set when its created

2012-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446338#comment-13446338 ] Hadoop QA commented on MAPREDUCE-4612: -- -1 overall. Here are the results of test

[jira] [Updated] (MAPREDUCE-4612) job summary file permissions not set when its created

2012-08-31 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated MAPREDUCE-4612: --- Resolution: Fixed Fix Version/s: 2.2.0-alpha 3.0

[jira] [Commented] (MAPREDUCE-4612) job summary file permissions not set when its created

2012-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446334#comment-13446334 ] Hadoop QA commented on MAPREDUCE-4612: -- -1 overall. Here are the results of test

[jira] [Commented] (MAPREDUCE-4614) Simplify debugging a job's tokens

2012-08-31 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446333#comment-13446333 ] Daryn Sharp commented on MAPREDUCE-4614: I'm ok with INFO during stabilization

[jira] [Resolved] (MAPREDUCE-4609) [MAPREDUCE-3902] RMContainerAllocator#scheduleInterval should be configurable

2012-08-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved MAPREDUCE-4609. --- Resolution: Fixed Fix Version/s: MR-3902 Hadoop Flags: Reviewed >

[jira] [Commented] (MAPREDUCE-4609) [MAPREDUCE-3902] RMContainerAllocator#scheduleInterval should be configurable

2012-08-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446328#comment-13446328 ] Siddharth Seth commented on MAPREDUCE-4609: --- Committing this to 3902. Thanks

[jira] [Commented] (MAPREDUCE-4582) [MAPREDUCE-3902] ScheduledRequests#remove should remove the elements from mapsHostMapping and mapsRackMapping

2012-08-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446326#comment-13446326 ] Siddharth Seth commented on MAPREDUCE-4582: --- Thanks for the updated patch. N

[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not transmitted if security is turned off

2012-08-31 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated MAPREDUCE-4554: Attachment: MR_4554_trunk.patch Attaching the new patch with Daryn's suggested improvem

[jira] [Commented] (MAPREDUCE-4612) job summary file permissions not set when its created

2012-08-31 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446321#comment-13446321 ] Robert Joseph Evans commented on MAPREDUCE-4612: The patch looks good

[jira] [Commented] (MAPREDUCE-4604) In mapred-default, mapreduce.map.maxattempts & mapreduce.reduce.maxattempts defaults are set to 4 as well as mapreduce.job.maxtaskfailures.per.tracker.

2012-08-31 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446320#comment-13446320 ] Jonathan Eagles commented on MAPREDUCE-4604: +1. Thanks, Ravi.

[jira] [Commented] (MAPREDUCE-4614) Simplify debugging a job's tokens

2012-08-31 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446312#comment-13446312 ] Siddharth Seth commented on MAPREDUCE-4614: --- Looks good. Would prefer the cl

[jira] [Updated] (MAPREDUCE-4612) job summary file permissions not set when its created

2012-08-31 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-4612: - Status: Patch Available (was: Open) > job summary file permissions not set when

[jira] [Updated] (MAPREDUCE-4612) job summary file permissions not set when its created

2012-08-31 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated MAPREDUCE-4612: - Attachment: MAPREDUCE-4612.patch Patch to fix the permission on the job summary file.

[jira] [Resolved] (MAPREDUCE-4196) nodemanager doesn't cleanup old logs/local files after restart

2012-08-31 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved MAPREDUCE-4196. Resolution: Duplicate > nodemanager doesn't cleanup old log

[jira] [Updated] (MAPREDUCE-2786) TestDFSIO should also test compression reading/writing from command-line.

2012-08-31 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated MAPREDUCE-2786: Attachment: (was: MAPREDUCE_2786.patch) > TestDFSIO should also test co

[jira] [Updated] (MAPREDUCE-2786) TestDFSIO should also test compression reading/writing from command-line.

2012-08-31 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated MAPREDUCE-2786: Status: Open (was: Patch Available) > TestDFSIO should also test compressi

[jira] [Updated] (MAPREDUCE-2786) TestDFSIO should also test compression reading/writing from command-line.

2012-08-31 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated MAPREDUCE-2786: Status: Patch Available (was: Open) > TestDFSIO should also test compressi

[jira] [Updated] (MAPREDUCE-2786) TestDFSIO should also test compression reading/writing from command-line.

2012-08-31 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated MAPREDUCE-2786: Attachment: MAPREDUCE_2786.patch > TestDFSIO should also test compression r

[jira] [Commented] (MAPREDUCE-2786) TestDFSIO should also test compression reading/writing from command-line.

2012-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446250#comment-13446250 ] Hadoop QA commented on MAPREDUCE-2786: -- -1 overall. Here are the results of test

[jira] [Updated] (MAPREDUCE-2786) TestDFSIO should also test compression reading/writing from command-line.

2012-08-31 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated MAPREDUCE-2786: Status: Patch Available (was: Open) > TestDFSIO should also test compressi

[jira] [Updated] (MAPREDUCE-2786) TestDFSIO should also test compression reading/writing from command-line.

2012-08-31 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated MAPREDUCE-2786: Status: Open (was: Patch Available) > TestDFSIO should also test compressi

[jira] [Updated] (MAPREDUCE-2786) TestDFSIO should also test compression reading/writing from command-line.

2012-08-31 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated MAPREDUCE-2786: Attachment: MAPREDUCE_2786.patch > TestDFSIO should also test compression r

[jira] [Commented] (MAPREDUCE-2786) TestDFSIO should also test compression reading/writing from command-line.

2012-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446232#comment-13446232 ] Hadoop QA commented on MAPREDUCE-2786: -- -1 overall. Here are the results of test

[jira] [Updated] (MAPREDUCE-2786) TestDFSIO should also test compression reading/writing from command-line.

2012-08-31 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated MAPREDUCE-2786: Attachment: MAPREDUCE_2786.patch > TestDFSIO should also test compression r

[jira] [Updated] (MAPREDUCE-2786) TestDFSIO should also test compression reading/writing from command-line.

2012-08-31 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated MAPREDUCE-2786: Status: Patch Available (was: Open) > TestDFSIO should also test compressi

[jira] [Updated] (MAPREDUCE-2786) TestDFSIO should also test compression reading/writing from command-line.

2012-08-31 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated MAPREDUCE-2786: Status: Open (was: Patch Available) > TestDFSIO should also test compressi

[jira] [Updated] (MAPREDUCE-2786) TestDFSIO should also test compression reading/writing from command-line.

2012-08-31 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated MAPREDUCE-2786: Attachment: (was: MAPREDUCE_2786.patch) > TestDFSIO should also test co

[jira] [Commented] (MAPREDUCE-2786) TestDFSIO should also test compression reading/writing from command-line.

2012-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446214#comment-13446214 ] Hadoop QA commented on MAPREDUCE-2786: -- -1 overall. Here are the results of test

[jira] [Commented] (MAPREDUCE-2454) Allow external sorter plugin for MR

2012-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446210#comment-13446210 ] Hadoop QA commented on MAPREDUCE-2454: -- -1 overall. Here are the results of test

[jira] [Updated] (MAPREDUCE-2786) TestDFSIO should also test compression reading/writing from command-line.

2012-08-31 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated MAPREDUCE-2786: Attachment: MAPREDUCE_2786.patch This patch should address Konstantin's guideli

[jira] [Updated] (MAPREDUCE-2786) TestDFSIO should also test compression reading/writing from command-line.

2012-08-31 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated MAPREDUCE-2786: Status: Patch Available (was: Open) > TestDFSIO should also test compressi

[jira] [Updated] (MAPREDUCE-2786) TestDFSIO should also test compression reading/writing from command-line.

2012-08-31 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated MAPREDUCE-2786: Status: Open (was: Patch Available) > TestDFSIO should also test compressi

[jira] [Updated] (MAPREDUCE-4611) MR AM dies badly when Node is decomissioned

2012-08-31 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated MAPREDUCE-4611: --- Priority: Critical (was: Major) > MR AM dies badly when Node is deco

[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not transmitted if security is turned off

2012-08-31 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446109#comment-13446109 ] Daryn Sharp commented on MAPREDUCE-4554: Minor suggestion, in {{TaskAttemptImp

[jira] [Commented] (MAPREDUCE-4049) plugin for generic shuffle service

2012-08-31 Thread Mariappan Asokan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446093#comment-13446093 ] Mariappan Asokan commented on MAPREDUCE-4049: - Hi Avner, Please take a l

[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not transmitted if security is turned off

2012-08-31 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated MAPREDUCE-4554: Attachment: MR_4554_trunk.patch Attaching latest patch after merging changes from trunk

[jira] [Commented] (MAPREDUCE-4613) Scheduling of reduce tasks results in starvation

2012-08-31 Thread Vasco (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446085#comment-13446085 ] Vasco commented on MAPREDUCE-4613: -- I tried in 2.1.0 (misread 4299 to be resolved in

[jira] [Commented] (MAPREDUCE-4613) Scheduling of reduce tasks results in starvation

2012-08-31 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446078#comment-13446078 ] Arun C Murthy commented on MAPREDUCE-4613: -- Vasco - the fix will show up via

[jira] [Resolved] (MAPREDUCE-4613) Scheduling of reduce tasks results in starvation

2012-08-31 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-4613. -- Resolution: Duplicate Dup of MAPREDUCE-4299. Thanks Vasco. > Sched

[jira] [Commented] (MAPREDUCE-4488) Port MAPREDUCE-463 (The job setup and cleanup tasks should be optional) to branch-1

2012-08-31 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446065#comment-13446065 ] Arun C Murthy commented on MAPREDUCE-4488: -- The concern I have is that MAPRED

[jira] [Commented] (MAPREDUCE-4607) Race condition in ReduceTask completion can result in Task being incorrectly failed

2012-08-31 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446053#comment-13446053 ] Tom White commented on MAPREDUCE-4607: -- Thanks for reporting this issue, chackara

[jira] [Updated] (MAPREDUCE-2454) Allow external sorter plugin for MR

2012-08-31 Thread Mariappan Asokan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-2454: Attachment: mapreduce-2454.patch Fixed the new test to get rid of compiler warn

[jira] [Resolved] (MAPREDUCE-900) Proposed enhancements/tuning to hadoop-mapred/build.xml

2012-08-31 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved MAPREDUCE-900. -- Resolution: Won't Fix if there were any changes to the build going forward, I'd use

[jira] [Updated] (MAPREDUCE-4613) Scheduling of reduce tasks results in starvation

2012-08-31 Thread Vasco (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasco updated MAPREDUCE-4613: - Environment: 16 (duo core) machine cluster ==> 32 containers namenode and resourcemanager running on

  1   2   >