[jira] [Updated] (YARN-954) [YARN-321] History Service should create the webUI and wire it to HistoryStorage

2013-11-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-954: - Attachment: YARN-954.6.patch Thanks Vinod for the review. I updated the patch in the following aspects:

[jira] [Commented] (YARN-1242) Script changes to start AHS as an individual process

2013-11-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13829804#comment-13829804 ] Zhijie Shen commented on YARN-1242: --- Whenever we have the end-to-end AHS runnable, I

[jira] [Commented] (YARN-954) [YARN-321] History Service should create the webUI and wire it to HistoryStorage

2013-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13829821#comment-13829821 ] Hadoop QA commented on YARN-954: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-967) [YARN-321] Command Line Interface(CLI) for Reading Application History Storage Data

2013-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13829823#comment-13829823 ] Hadoop QA commented on YARN-967: {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-1437) Add way for YARN client to determine the resource limits of a queue before creating the AM

2013-11-22 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-1437: Summary: Add way for YARN client to determine the resource limits of a queue before creating the AM Key: YARN-1437 URL: https://issues.apache.org/jira/browse/YARN-1437

[jira] [Updated] (YARN-1409) NonAggregatingLogHandler can throw RejectedExecutionException

2013-11-22 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1409: - Summary: NonAggregatingLogHandler can throw RejectedExecutionException (was:

[jira] [Updated] (YARN-1409) NonAggregatingLogHandler can throw RejectedExecutionException

2013-11-22 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1409: - Attachment: YARN-1409.2.patch Sorry for delay. Updated a patch to handle

[jira] [Commented] (YARN-1409) NonAggregatingLogHandler can throw RejectedExecutionException

2013-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13829921#comment-13829921 ] Hadoop QA commented on YARN-1409: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1320) Custom log4j properties in Distributed shell does not work properly.

2013-11-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13829953#comment-13829953 ] Hudson commented on YARN-1320: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1590 (See

[jira] [Commented] (YARN-1320) Custom log4j properties in Distributed shell does not work properly.

2013-11-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13829964#comment-13829964 ] Hudson commented on YARN-1320: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1616 (See

[jira] [Updated] (YARN-1307) Rethink znode structure for RM HA

2013-11-22 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1307: - Attachment: YARN-1307.7.patch Removed version-infomation znode. Rethink znode structure for RM

[jira] [Created] (YARN-1438) When a container fails, the text of the exception isn't included in the diagnostics

2013-11-22 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-1438: Summary: When a container fails, the text of the exception isn't included in the diagnostics Key: YARN-1438 URL: https://issues.apache.org/jira/browse/YARN-1438

[jira] [Commented] (YARN-1438) When a container fails, the text of the exception isn't included in the diagnostics

2013-11-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13829995#comment-13829995 ] Steve Loughran commented on YARN-1438: -- Here's an example, we know the container

[jira] [Commented] (YARN-1438) When a container fails, the text of the exception isn't included in the diagnostics

2013-11-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13829997#comment-13829997 ] Steve Loughran commented on YARN-1438: -- the issue here is that while the NM logs

[jira] [Commented] (YARN-778) Failures in container launches due to issues like disk failure are difficult to diagnose

2013-11-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1382#comment-1382 ] Steve Loughran commented on YARN-778: - YARN-257 may be the cause, but this is about

[jira] [Commented] (YARN-1409) NonAggregatingLogHandler can throw RejectedExecutionException

2013-11-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13830016#comment-13830016 ] Jason Lowe commented on YARN-1409: -- Thanks for updating the patch. Comments: - It should

[jira] [Created] (YARN-1439) Taking around 800 to 900 ms to connect from AM to RM

2013-11-22 Thread Krishna Kishore Bonagiri (JIRA)
Krishna Kishore Bonagiri created YARN-1439: -- Summary: Taking around 800 to 900 ms to connect from AM to RM Key: YARN-1439 URL: https://issues.apache.org/jira/browse/YARN-1439 Project: Hadoop

[jira] [Commented] (YARN-1239) Save version information in the state store

2013-11-22 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13830031#comment-13830031 ] Tsuyoshi OZAWA commented on YARN-1239: -- [~jianhe], could you fix the findbugs warning?

[jira] [Commented] (YARN-1434) Single Job can affect fairshare of others

2013-11-22 Thread Srikanth Kandula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13830129#comment-13830129 ] Srikanth Kandula commented on YARN-1434: Sandy Ryza, I get it up to the receive

[jira] [Commented] (YARN-1423) Support queue placement by secondary group in the Fair Scheduler

2013-11-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13830128#comment-13830128 ] Sandy Ryza commented on YARN-1423: -- Thanks for working on this Ted, The patch is looking

[jira] [Commented] (YARN-1423) Support queue placement by secondary group in the Fair Scheduler

2013-11-22 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13830140#comment-13830140 ] Ted Malaska commented on YARN-1423: --- Thank you for the review I will make both changes

[jira] [Assigned] (YARN-1023) [YARN-321] Webservices REST API's support for Application History

2013-11-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-1023: - Assignee: Zhijie Shen (was: Devaraj K) [YARN-321] Webservices REST API's support for

[jira] [Commented] (YARN-1023) [YARN-321] Webservices REST API's support for Application History

2013-11-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13830239#comment-13830239 ] Zhijie Shen commented on YARN-1023: --- [~devaraj.k], thanks for the patch. Let me continue

[jira] [Created] (YARN-1440) Yarn aggregated logs should be stored in a simpler format

2013-11-22 Thread ledion bitincka (JIRA)
ledion bitincka created YARN-1440: - Summary: Yarn aggregated logs should be stored in a simpler format Key: YARN-1440 URL: https://issues.apache.org/jira/browse/YARN-1440 Project: Hadoop YARN

[jira] [Updated] (YARN-1318) Promote AdminService to an Always-On service and merge in RMHAProtocolService

2013-11-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1318: --- Attachment: yarn-1318-4.patch Rebased on trunk and addressed Vinod's comments. Promote

[jira] [Updated] (YARN-1440) Yarn aggregated logs should be stored in a simpler format

2013-11-22 Thread ledion bitincka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ledion bitincka updated YARN-1440: -- Description: The log aggregation feature in Yarn is awesome! However, the file type and format

[jira] [Updated] (YARN-1423) Support queue placement by secondary group in the Fair Scheduler

2013-11-22 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated YARN-1423: -- Attachment: YARN-1423-2.patch I've made the changes request by Sandy Ryza. Support queue placement by

[jira] [Commented] (YARN-1430) InvalidStateTransition exceptions are ignored in state machines

2013-11-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13830328#comment-13830328 ] Karthik Kambatla commented on YARN-1430: bq. But as of today, we are treating them

[jira] [Commented] (YARN-1421) Node managers will not receive application finish event where containers ran before RM restart

2013-11-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13830331#comment-13830331 ] Karthik Kambatla commented on YARN-1421: Reading all the RM apps on each node

[jira] [Commented] (YARN-1318) Promote AdminService to an Always-On service and merge in RMHAProtocolService

2013-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13830330#comment-13830330 ] Hadoop QA commented on YARN-1318: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-967) [YARN-321] Command Line Interface(CLI) for Reading Application History Storage Data

2013-11-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13830338#comment-13830338 ] Zhijie Shen commented on YARN-967: -- 1. Should be doesn't exist in RM and AHS {code} /** *

[jira] [Commented] (YARN-1440) Yarn aggregated logs should be stored in a simpler format

2013-11-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13830335#comment-13830335 ] Jason Lowe commented on YARN-1440: -- bq. My suggestion would be to simplify the log

[jira] [Updated] (YARN-1318) Promote AdminService to an Always-On service and merge in RMHAProtocolService

2013-11-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1318: --- Attachment: yarn-1318-4.patch Updated patch to address the findbugs warning and add license

[jira] [Commented] (YARN-1423) Support queue placement by secondary group in the Fair Scheduler

2013-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13830343#comment-13830343 ] Hadoop QA commented on YARN-1423: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1434) Single Job can affect fairshare of others

2013-11-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13830368#comment-13830368 ] Carlo Curino commented on YARN-1434: Srikanth, what we observed (again in a noise

[jira] [Updated] (YARN-1416) InvalidStateTransitions getting reported in multiple test cases even though they pass

2013-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1416: -- Attachment: YARN-1416.3.patch New patch rewrote TestRMAppTransitions.testClientTokens and put that in

[jira] [Commented] (YARN-1416) InvalidStateTransitions getting reported in multiple test cases even though they pass

2013-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13830381#comment-13830381 ] Jian He commented on YARN-1416: --- As of now, no more invalid event exceptions found both in

[jira] [Commented] (YARN-1416) InvalidStateTransitions getting reported in multiple test cases even though they pass

2013-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13830409#comment-13830409 ] Hadoop QA commented on YARN-1416: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1318) Promote AdminService to an Always-On service and merge in RMHAProtocolService

2013-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13830476#comment-13830476 ] Hadoop QA commented on YARN-1318: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-895) RM crashes if it restarts while NameNode is in safe mode

2013-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13830509#comment-13830509 ] Jian He commented on YARN-895: -- Upload a patch: - HDFS: create configs for enabling dfs

[jira] [Updated] (YARN-895) RM crashes if it restarts while NameNode is in safe mode

2013-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-895: - Attachment: YARN-895.2.patch RM crashes if it restarts while NameNode is in safe mode

[jira] [Commented] (YARN-895) RM crashes if it restarts while NameNode is in safe mode

2013-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13830522#comment-13830522 ] Hadoop QA commented on YARN-895: {color:red}-1 overall{color}. Here are the results of