[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427134#comment-13427134 ] Alejandro Abdelnur commented on MAPREDUCE-4495: --- As I've mentioned to

[jira] [Created] (MAPREDUCE-4506) EofException / 'connection reset by peer' while copying map output

Piotr Kołaczkowski created MAPREDUCE-4506: - Summary: EofException / 'connection reset by peer' while copying map output Key: MAPREDUCE-4506 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4506

[jira] [Updated] (MAPREDUCE-4506) EofException / 'connection reset by peer' while copying map output

[ https://issues.apache.org/jira/browse/MAPREDUCE-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Kołaczkowski updated MAPREDUCE-4506: -- Attachment: ReduceTask.patch RamManager.patch Patch fixing

[jira] [Updated] (MAPREDUCE-4506) EofException / 'connection reset by peer' while copying map output

[ https://issues.apache.org/jira/browse/MAPREDUCE-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Kołaczkowski updated MAPREDUCE-4506: -- Status: Patch Available (was: Open) I attach a patch disabling the 'break

[jira] [Commented] (MAPREDUCE-4506) EofException / 'connection reset by peer' while copying map output

[ https://issues.apache.org/jira/browse/MAPREDUCE-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427221#comment-13427221 ] Hadoop QA commented on MAPREDUCE-4506: -- -1 overall. Here are the results of

[jira] [Commented] (MAPREDUCE-4504) SortValidator writes to wrong directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427274#comment-13427274 ] Hudson commented on MAPREDUCE-4504: --- Integrated in Hadoop-Hdfs-0.23-Build #332 (See

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427297#comment-13427297 ] Chris A. Mattmann commented on MAPREDUCE-4495: -- Hi Alejandro: Thanks for

[jira] [Commented] (MAPREDUCE-4506) EofException / 'connection reset by peer' while copying map output

[ https://issues.apache.org/jira/browse/MAPREDUCE-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427310#comment-13427310 ] Robert Joseph Evans commented on MAPREDUCE-4506: Piotr, I agree that

[jira] [Commented] (MAPREDUCE-4504) SortValidator writes to wrong directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427333#comment-13427333 ] Hudson commented on MAPREDUCE-4504: --- Integrated in Hadoop-Mapreduce-trunk #1155 (See

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427336#comment-13427336 ] Tom White commented on MAPREDUCE-4495: -- Alejandro's list of reasons make a good

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427361#comment-13427361 ] Arun C Murthy commented on MAPREDUCE-4495: -- Alejandro Tom - If we limit the

[jira] [Commented] (MAPREDUCE-4334) Add support for CPU isolation/monitoring of containers

[ https://issues.apache.org/jira/browse/MAPREDUCE-4334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427367#comment-13427367 ] Arun C Murthy commented on MAPREDUCE-4334: -- Also, I'll add that since cgroups

[jira] [Commented] (MAPREDUCE-4334) Add support for CPU isolation/monitoring of containers

[ https://issues.apache.org/jira/browse/MAPREDUCE-4334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427366#comment-13427366 ] Arun C Murthy commented on MAPREDUCE-4334: -- Alejandro, LCE accomplishes 2

[jira] [Commented] (MAPREDUCE-4334) Add support for CPU isolation/monitoring of containers

[ https://issues.apache.org/jira/browse/MAPREDUCE-4334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427374#comment-13427374 ] Arun C Murthy commented on MAPREDUCE-4334: -- Maybe I haven't been able to

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427380#comment-13427380 ] Alejandro Abdelnur commented on MAPREDUCE-4495: --- @Chris, as we all know,

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427387#comment-13427387 ] Robert Joseph Evans commented on MAPREDUCE-4495: I am on the side of

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427395#comment-13427395 ] Arun C Murthy commented on MAPREDUCE-4495: -- Bobby, as I alluded in my Hadoop

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427398#comment-13427398 ] Chris A. Mattmann commented on MAPREDUCE-4495: -- Hi Alejandro: bq. as we

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427407#comment-13427407 ] Robert Joseph Evans commented on MAPREDUCE-4495: Arun pinged me

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427412#comment-13427412 ] Josh Wills commented on MAPREDUCE-4495: --- Two comments, as someone who would be

[jira] [Commented] (MAPREDUCE-3223) Remove MR1 configs from mapred-default.xml

[ https://issues.apache.org/jira/browse/MAPREDUCE-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427418#comment-13427418 ] Robert Joseph Evans commented on MAPREDUCE-3223: I did a quick look

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427432#comment-13427432 ] Chris A. Mattmann commented on MAPREDUCE-4495: -- Hi Josh: bq. 1) Chris,

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427434#comment-13427434 ] Robert Joseph Evans commented on MAPREDUCE-4495: @Josh, Pleased to

[jira] [Commented] (MAPREDUCE-4327) Enhance CS to schedule accounting for both memory and cpu cores

[ https://issues.apache.org/jira/browse/MAPREDUCE-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427447#comment-13427447 ] Robert Joseph Evans commented on MAPREDUCE-4327: Thanks Arun. The

[jira] [Commented] (MAPREDUCE-4275) Plugable process tree

[ https://issues.apache.org/jira/browse/MAPREDUCE-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427483#comment-13427483 ] Bikas Saha commented on MAPREDUCE-4275: --- I am ok with the null pointer check.

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427484#comment-13427484 ] Josh Wills commented on MAPREDUCE-4495: --- @Chris, thanks for clarifying your

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427494#comment-13427494 ] Arun C Murthy commented on MAPREDUCE-4495: -- bq. And of course, we shouldn't

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427497#comment-13427497 ] Josh Wills commented on MAPREDUCE-4495: --- Arun, I would never criticize INFRA.

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427496#comment-13427496 ] Arun C Murthy commented on MAPREDUCE-4495: -- For disclosure, I had another

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427506#comment-13427506 ] Arun C Murthy commented on MAPREDUCE-4495: -- Fine, there is some overhead.

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427507#comment-13427507 ] Mayank Bansal commented on MAPREDUCE-4495: -- I agree with Bobby about adding

[jira] [Commented] (MAPREDUCE-4327) Enhance CS to schedule accounting for both memory and cpu cores

[ https://issues.apache.org/jira/browse/MAPREDUCE-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427508#comment-13427508 ] Arun C Murthy commented on MAPREDUCE-4327: -- Oops, my bad. I forgot to point

[jira] [Updated] (MAPREDUCE-4503) Should throw InvalidJobConfException if duplicates found in cacheArchives or cacheFiles

[ https://issues.apache.org/jira/browse/MAPREDUCE-4503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated MAPREDUCE-4503: --- Attachment: MR-4503.txt Fix for the findbugs issue, and the test

[jira] [Commented] (MAPREDUCE-4503) Should throw InvalidJobConfException if duplicates found in cacheArchives or cacheFiles

[ https://issues.apache.org/jira/browse/MAPREDUCE-4503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427533#comment-13427533 ] Hadoop QA commented on MAPREDUCE-4503: -- -1 overall. Here are the results of

[jira] [Updated] (MAPREDUCE-3289) Make use of fadvise in the NM's shuffle handler

[ https://issues.apache.org/jira/browse/MAPREDUCE-3289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-3289: -- Resolution: Fixed Fix Version/s: 2.2.0-alpha 1.2.0

[jira] [Commented] (MAPREDUCE-4327) Enhance CS to schedule accounting for both memory and cpu cores

[ https://issues.apache.org/jira/browse/MAPREDUCE-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427672#comment-13427672 ] Junping Du commented on MAPREDUCE-4327: --- It looks like these findbugs warnings

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427675#comment-13427675 ] Arun C Murthy commented on MAPREDUCE-4495: -- bq. May be we can do a contrib

[jira] [Created] (MAPREDUCE-4507) IdentityMapper being triggered when the InputType at class level ane method level has a conflict

Bejoy KS created MAPREDUCE-4507: --- Summary: IdentityMapper being triggered when the InputType at class level ane method level has a conflict Key: MAPREDUCE-4507 URL:

[jira] [Updated] (MAPREDUCE-4507) IdentityMapper is being triggered when the type of the Input Key at class level and method level has a conflict

[ https://issues.apache.org/jira/browse/MAPREDUCE-4507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bejoy KS updated MAPREDUCE-4507: Description: If we use the default InputFormat (TextInputFormat) but specify the Key type in

[jira] [Commented] (MAPREDUCE-4507) IdentityMapper is being triggered when the type of the Input Key at class level and method level has a conflict

[ https://issues.apache.org/jira/browse/MAPREDUCE-4507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427695#comment-13427695 ] Bejoy KS commented on MAPREDUCE-4507: - This piece of code will trigger

[jira] [Commented] (MAPREDUCE-4507) IdentityMapper is being triggered when the type of the Input Key at class level and method level has a conflict

[ https://issues.apache.org/jira/browse/MAPREDUCE-4507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427701#comment-13427701 ] Bejoy KS commented on MAPREDUCE-4507: - Sorry About the typo This piece of code

[jira] [Commented] (MAPREDUCE-3289) Make use of fadvise in the NM's shuffle handler

[ https://issues.apache.org/jira/browse/MAPREDUCE-3289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427705#comment-13427705 ] Hudson commented on MAPREDUCE-3289: --- Integrated in Hadoop-Mapreduce-trunk-Commit

[jira] [Commented] (MAPREDUCE-4507) IdentityMapper is being triggered when the type of the Input Key at class level and method level has a conflict

[ https://issues.apache.org/jira/browse/MAPREDUCE-4507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427709#comment-13427709 ] Bejoy KS commented on MAPREDUCE-4507: - By just changing the Input Key Type to

[jira] [Assigned] (MAPREDUCE-4455) RMAppImpl state machine does not handle event ATTEMPT_KILLED at ACCEPTED

[ https://issues.apache.org/jira/browse/MAPREDUCE-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal reassigned MAPREDUCE-4455: Assignee: Mayank Bansal RMAppImpl state machine does not handle event

[jira] [Commented] (MAPREDUCE-4487) Reduce job latency by removing hardcoded sleep statements

[ https://issues.apache.org/jira/browse/MAPREDUCE-4487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427715#comment-13427715 ] Alejandro Abdelnur commented on MAPREDUCE-4487: --- +1

[jira] [Updated] (MAPREDUCE-4455) RMAppImpl state machine does not handle event ATTEMPT_KILLED at ACCEPTED

[ https://issues.apache.org/jira/browse/MAPREDUCE-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated MAPREDUCE-4455: - Fix Version/s: trunk Status: Patch Available (was: Open) RMAppImpl

[jira] [Updated] (MAPREDUCE-4455) RMAppImpl state machine does not handle event ATTEMPT_KILLED at ACCEPTED

[ https://issues.apache.org/jira/browse/MAPREDUCE-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated MAPREDUCE-4455: - Attachment: MAPREDUCE-4455-trunk-v1.patch Fixing the issue and test cases. Thanks,

[jira] [Commented] (MAPREDUCE-4487) Reduce job latency by removing hardcoded sleep statements

[ https://issues.apache.org/jira/browse/MAPREDUCE-4487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427720#comment-13427720 ] Mayank Bansal commented on MAPREDUCE-4487: -- +1 Looks good Thanks, Mayank

[jira] [Commented] (MAPREDUCE-3289) Make use of fadvise in the NM's shuffle handler

[ https://issues.apache.org/jira/browse/MAPREDUCE-3289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427724#comment-13427724 ] Hudson commented on MAPREDUCE-3289: --- Integrated in Hadoop-Common-trunk-Commit #2552

[jira] [Commented] (MAPREDUCE-3289) Make use of fadvise in the NM's shuffle handler

[ https://issues.apache.org/jira/browse/MAPREDUCE-3289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427726#comment-13427726 ] Hudson commented on MAPREDUCE-3289: --- Integrated in Hadoop-Hdfs-trunk-Commit #2617

[jira] [Created] (MAPREDUCE-4508) YARN needs to properly check the NM,AM memory properties in yarn-site.xml and mapred.xml and report errors accordingly.

Anil Gupta created MAPREDUCE-4508: - Summary: YARN needs to properly check the NM,AM memory properties in yarn-site.xml and mapred.xml and report errors accordingly. Key: MAPREDUCE-4508 URL:

[jira] [Commented] (MAPREDUCE-4455) RMAppImpl state machine does not handle event ATTEMPT_KILLED at ACCEPTED

[ https://issues.apache.org/jira/browse/MAPREDUCE-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427748#comment-13427748 ] Hadoop QA commented on MAPREDUCE-4455: -- -1 overall. Here are the results of

[jira] [Commented] (MAPREDUCE-4508) YARN needs to properly check the NM,AM memory properties in yarn-site.xml and mapred.xml and report errors accordingly.

[ https://issues.apache.org/jira/browse/MAPREDUCE-4508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427751#comment-13427751 ] Hitesh Shah commented on MAPREDUCE-4508: Seems like a dup of MAPREDUCE-3796

[jira] [Commented] (MAPREDUCE-4455) RMAppImpl state machine does not handle event ATTEMPT_KILLED at ACCEPTED

[ https://issues.apache.org/jira/browse/MAPREDUCE-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427759#comment-13427759 ] Mayank Bansal commented on MAPREDUCE-4455: -- These find bug warnings are

[jira] [Created] (MAPREDUCE-4509) Make link in Aggregation is not enabled. Try the nodemanager at

Radim Kolar created MAPREDUCE-4509: -- Summary: Make link in Aggregation is not enabled. Try the nodemanager at Key: MAPREDUCE-4509 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4509 Project:

[jira] [Commented] (MAPREDUCE-4488) Port MAPREDUCE-463 (The job setup and cleanup tasks should be optional) to branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427785#comment-13427785 ] Ahmed Radwan commented on MAPREDUCE-4488: - +1 Thanks Tom! On a related note, I

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427809#comment-13427809 ] Chris A. Mattmann commented on MAPREDUCE-4495: -- Here's a link to a

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427817#comment-13427817 ] Santhosh Srinivasan commented on MAPREDUCE-4495: [~eric14] bq Look

[jira] [Commented] (MAPREDUCE-4495) Workflow Application Master in YARN

[ https://issues.apache.org/jira/browse/MAPREDUCE-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427819#comment-13427819 ] Chris A. Mattmann commented on MAPREDUCE-4495: -- Hi Santhosh, Not sure

[jira] [Commented] (MAPREDUCE-4488) Port MAPREDUCE-463 (The job setup and cleanup tasks should be optional) to branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13427839#comment-13427839 ] Alejandro Abdelnur commented on MAPREDUCE-4488: --- looks good, some minor

[jira] [Moved] (MAPREDUCE-4510) Avoid logging Cannot run program getconf on Windows

[ https://issues.apache.org/jira/browse/MAPREDUCE-4510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha moved HADOOP-8646 to MAPREDUCE-4510: --- Key: MAPREDUCE-4510 (was: HADOOP-8646) Project: Hadoop