[jira] [Commented] (YARN-4989) TestWorkPreservingRMRestart#testCapacitySchedulerRecovery fails intermittently

2016-05-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15279764#comment-15279764 ] Hadoop QA commented on YARN-4989: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5068) The AM does not know the queue from which it is launched.

2016-05-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15279769#comment-15279769 ] Varun Vasudev commented on YARN-5068: - One minor fix from my end. [~harishjp] - can you

[jira] [Updated] (YARN-5068) Expose scheduler queue to application master

2016-05-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-5068: Summary: Expose scheduler queue to application master (was: The AM does not know the queue from whic

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-05-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15279782#comment-15279782 ] Varun Vasudev commented on YARN-4577: - [~xgong] - as [~sjlee0] mentioned the latest pat

[jira] [Commented] (YARN-4981) limit the max containers to assign to one application per heartbeart

2016-05-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15279808#comment-15279808 ] Hadoop QA commented on YARN-4981: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5068) Expose scheduler queue to application master

2016-05-11 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated YARN-5068: Attachment: YARN-5068.1.patch Changed the environment variable to YARN_RESOURCEMANAGER_APPLIC

[jira] [Commented] (YARN-1418) Add Tracing to YARN

2016-05-11 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15279824#comment-15279824 ] Masatake Iwasaki commented on YARN-1418: I appreciate your help, [~rchiang]. We hav

[jira] [Commented] (YARN-5051) The RM can't update the Decommissioned Nodes Metric

2016-05-11 Thread tangshangwen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15279855#comment-15279855 ] tangshangwen commented on YARN-5051: yes, thanks [~kshukla] > The RM can't update the

[jira] [Updated] (YARN-5068) Expose scheduler queue to application master

2016-05-11 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated YARN-5068: Attachment: YARN-5068.2.patch Updated to fix checkstyle issues. > Expose scheduler queue to

[jira] [Commented] (YARN-5068) Expose scheduler queue to application master

2016-05-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15279970#comment-15279970 ] Hadoop QA commented on YARN-5068: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5068) Expose scheduler queue to application master

2016-05-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15279988#comment-15279988 ] Hadoop QA commented on YARN-5068: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-4948) Support node labels store in zookeeper

2016-05-11 Thread jialei weng (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jialei weng updated YARN-4948: -- Attachment: YARN-4948.003.patch > Support node labels store in zookeeper > --

[jira] [Updated] (YARN-5053) More informative diagnostics when applications killed by a user

2016-05-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-5053: -- Attachment: YARN-5053.004.patch Fixing checkstyle issue. > More informative diagnostics when applicatio

[jira] [Commented] (YARN-4948) Support node labels store in zookeeper

2016-05-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280174#comment-15280174 ] Hadoop QA commented on YARN-4948: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4325) Purge app state from NM state-store should cover more LOG_HANDLING cases

2016-05-11 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280176#comment-15280176 ] Jason Lowe commented on YARN-4325: -- Yes, what I'm proposing is to have the log handlers al

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-11 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280191#comment-15280191 ] Nathan Roberts commented on YARN-5039: -- Thanks [~milesc]. This seems to be an Amazon e

[jira] [Commented] (YARN-4882) Change the log level to DEBUG for recovering completed applications

2016-05-11 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280214#comment-15280214 ] Jason Lowe commented on YARN-4882: -- The main motiviation of proposing a separate logger is

[jira] [Commented] (YARN-4913) Yarn logs should take a -out option to write to a directory

2016-05-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280206#comment-15280206 ] Varun Vasudev commented on YARN-4913: - [~xgong] - the latest patch is not entirely ther

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-11 Thread Daniel Zhi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280259#comment-15280259 ] Daniel Zhi commented on YARN-5039: -- I am OOO so didn't really dive deep. EMR has logic to

[jira] [Commented] (YARN-5069) TestFifoScheduler.testResourceOverCommit race condition

2016-05-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280334#comment-15280334 ] Eric Badger commented on YARN-5069: --- [~eepayne], you committed [YARN-4556], which is simi

[jira] [Commented] (YARN-5053) More informative diagnostics when applications killed by a user

2016-05-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280346#comment-15280346 ] Daniel Templeton commented on YARN-5053: Maybe I'm going blind, but I don't see any

[jira] [Commented] (YARN-4996) Make TestNMReconnect.testCompareRMNodeAfterReconnect() scheduler agnostic, or better yet parameterized

2016-05-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280355#comment-15280355 ] Daniel Templeton commented on YARN-4996: Do you think you'd be willing to move the

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-11 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280357#comment-15280357 ] Miles Crawford commented on YARN-5039: -- Okay, wow that is wonderful to know. We have a

[jira] [Resolved] (YARN-5039) Applications ACCEPTED but not starting

2016-05-11 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford resolved YARN-5039. -- Resolution: Not A Bug > Applications ACCEPTED but not starting >

[jira] [Commented] (YARN-3344) procfs stat file is not in the expected format warning

2016-05-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280359#comment-15280359 ] Daniel Templeton commented on YARN-3344: Looks good to me in general. Thanks for p

[jira] [Updated] (YARN-5053) More informative diagnostics when applications killed by a user

2016-05-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-5053: -- Attachment: YARN-5053.005.patch [~templedf], the last few patches have been small fixes. One was a checks

[jira] [Updated] (YARN-4325) Purge app state from NM state-store should cover more LOG_HANDLING cases

2016-05-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4325: - Attachment: YARN-4325-v2.patch Okay. Your proposal sounds more clean. I update v2 patch. Can you take a loo

[jira] [Updated] (YARN-4866) FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy

2016-05-11 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4866: --- Attachment: YARN-4866.003.patch > FairScheduler: AMs can consume all vcores leading to a livelock when using >

[jira] [Updated] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-05-11 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4577: Attachment: YARN-4577.20160511.patch > Enable aux services to have their own custom classpath/jar file >

[jira] [Updated] (YARN-4866) FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy

2016-05-11 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4866: --- Attachment: (was: YARN-4866.003.patch) > FairScheduler: AMs can consume all vcores leading to a livelock wh

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-05-11 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280472#comment-15280472 ] Xuan Gong commented on YARN-4577: - [~vvasudev], [~sjlee0] Sorry about that. I have uploaded

[jira] [Updated] (YARN-4866) FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy

2016-05-11 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4866: --- Attachment: YARN-4866.003.patch > FairScheduler: AMs can consume all vcores leading to a livelock when using >

[jira] [Commented] (YARN-2888) Corrective mechanisms for rebalancing NM container queues

2016-05-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280587#comment-15280587 ] Hadoop QA commented on YARN-2888: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5072) Support comma separated list of includes and excludes files

2016-05-11 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280599#comment-15280599 ] Ravi Prakash commented on YARN-5072: Just fyi, not all of us run with the same nodes fo

[jira] [Updated] (YARN-5072) Support comma separated list of includes and excludes files

2016-05-11 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated YARN-5072: -- Description: When a yarn cluster shares the same hosts as the underlying HDFS cluster, we have {{yarn.resourcema

[jira] [Commented] (YARN-5053) More informative diagnostics when applications killed by a user

2016-05-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280614#comment-15280614 ] Hadoop QA commented on YARN-5053: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5029) RM needs to send update event with YarnApplicationState as Running to ATS/AHS

2016-05-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280620#comment-15280620 ] Hudson commented on YARN-5029: -- FAILURE: Integrated in Hadoop-trunk-Commit #9746 (See [https:

[jira] [Commented] (YARN-4090) Make Collections.sort() more efficient in FSParentQueue.java

2016-05-11 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280653#comment-15280653 ] Yufei Gu commented on YARN-4090: Thanks, [~xinxianyin]! Looks really good. All three previo

[jira] [Commented] (YARN-3344) procfs stat file is not in the expected format warning

2016-05-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280663#comment-15280663 ] Hadoop QA commented on YARN-3344: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5053) More informative diagnostics when applications killed by a user

2016-05-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280669#comment-15280669 ] Sunil G commented on YARN-5053: --- HI [~ebadger] I have one doubt here, please correct me if I

[jira] [Commented] (YARN-4325) Purge app state from NM state-store should cover more LOG_HANDLING cases

2016-05-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280689#comment-15280689 ] Hadoop QA commented on YARN-4325: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5049) Extend NMStateStore to save queued container information

2016-05-11 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5049: - Attachment: YARN-5049.003.patch Thanks for the review, [~asuresh]! Fixed the VERSI

[jira] [Commented] (YARN-5049) Extend NMStateStore to save queued container information

2016-05-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280707#comment-15280707 ] Arun Suresh commented on YARN-5049: --- Looks good.. +1 pending Jenkins.. > Extend NMStateS

[jira] [Updated] (YARN-4515) [YARN-3368] Support hosting web UI framework inside YARN RM

2016-05-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4515: -- Attachment: YARN-4515-YARN-3368.1.patch A combined patch with YARN-5000. This will help to test UI overall. But I

[jira] [Commented] (YARN-5053) More informative diagnostics when applications killed by a user

2016-05-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280724#comment-15280724 ] Eric Badger commented on YARN-5053: --- [~sunilg], my attempt is to print out the address fr

[jira] [Commented] (YARN-5053) More informative diagnostics when applications killed by a user

2016-05-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280729#comment-15280729 ] Daniel Templeton commented on YARN-5053: I can answer that one. He's referring to

[jira] [Commented] (YARN-4325) Purge app state from NM state-store should cover more LOG_HANDLING cases

2016-05-11 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280731#comment-15280731 ] Jason Lowe commented on YARN-4325: -- Thanks, Junping! The test failure is related. In add

[jira] [Commented] (YARN-4635) Add global blacklist tracking for AM container failure.

2016-05-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280745#comment-15280745 ] Jian He commented on YARN-4635: --- I guess this is a bit late for 2.8, let's move to 2.9 ? > A

[jira] [Updated] (YARN-4515) [YARN-3368] Support hosting web UI framework inside YARN RM

2016-05-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4515: -- Attachment: YARN-4515-YARN-3368.2.patch Uploading a rebased patch. This is still combined with YARN-5000 for easi

[jira] [Commented] (YARN-5053) More informative diagnostics when applications killed by a user

2016-05-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280787#comment-15280787 ] Sunil G commented on YARN-5053: --- Thanks for the clarification. It makes sense to me. > More

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2016-05-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280807#comment-15280807 ] Karthik Kambatla commented on YARN-4599: Yes, I meant containers. My proposal was

[jira] [Commented] (YARN-5070) upgrade HBase version for first merge

2016-05-11 Thread Enis Soztutar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280808#comment-15280808 ] Enis Soztutar commented on YARN-5070: - Phoenix will support HBase-1.2.0 only in upcomin

[jira] [Commented] (YARN-5053) More informative diagnostics when applications killed by a user

2016-05-11 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280835#comment-15280835 ] Jason Lowe commented on YARN-5053: -- +1 lgtm. Will commit this tomorrow if there are no ob

[jira] [Commented] (YARN-5046) [Umbrella] Refactor scheduler code

2016-05-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280842#comment-15280842 ] Karthik Kambatla commented on YARN-5046: Thanks for picking this up, [~rchiang]. Th

[jira] [Updated] (YARN-1815) RM should record final state for unmanaged AMs

2016-05-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1815: -- Target Version/s: 2.9.0 (was: 2.8.0) Description: RM should record final state for unmanaged AMs (was:

[jira] [Commented] (YARN-4090) Make Collections.sort() more efficient in FSParentQueue.java

2016-05-11 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280855#comment-15280855 ] Yufei Gu commented on YARN-4090: Another minor nit: there are two spaces between "synchroni

[jira] [Updated] (YARN-1946) need Public interface for WebAppUtils.getProxyHostAndPort

2016-05-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1946: -- Target Version/s: 2.9.0 (was: 2.8.0) Priority: Major (was: Critical) > need Public interface for We

[jira] [Updated] (YARN-4484) Available Resource calculation for a queue is not correct when used with labels

2016-05-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4484: - Target Version/s: 2.8.0 > Available Resource calculation for a queue is not correct when used with > label

[jira] [Comment Edited] (YARN-4484) Available Resource calculation for a queue is not correct when used with labels

2016-05-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280860#comment-15280860 ] Wangda Tan edited comment on YARN-4484 at 5/11/16 9:29 PM: --- Uploa

[jira] [Updated] (YARN-4484) Available Resource calculation for a queue is not correct when used with labels

2016-05-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4484: - Attachment: 0005-YARN-4484-rebased.patch Uploaded patch to latest trunk to tick Jenkins. > Available Resou

[jira] [Updated] (YARN-2836) RM behaviour on token renewal failures is broken

2016-05-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2836: -- Target Version/s: 2.9.0 (was: 2.8.0) Priority: Major (was: Blocker) > RM behaviour on token renewal

[jira] [Created] (YARN-5074) RM cycles through container ids for an app that is waiting for resources.

2016-05-11 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-5074: --- Summary: RM cycles through container ids for an app that is waiting for resources. Key: YARN-5074 URL: https://issues.apache.org/jira/browse/YARN-5074 Project:

[jira] [Resolved] (YARN-2506) TimelineClient should NOT be in yarn-common project

2016-05-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-2506. --- Resolution: Won't Fix I think this is too old code to move. close > TimelineClient should NOT be in yarn-commo

[jira] [Resolved] (YARN-3760) Log aggregation failures

2016-05-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-3760. --- Resolution: Cannot Reproduce Without any logs, not sure we are can debug further, close. > Log aggregation fai

[jira] [Commented] (YARN-4866) FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy

2016-05-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280912#comment-15280912 ] Hadoop QA commented on YARN-4866: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5070) upgrade HBase version for first merge

2016-05-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280916#comment-15280916 ] Sangjin Lee commented on YARN-5070: --- Thanks [~enis] for the info. We're keenly interested

[jira] [Commented] (YARN-4006) YARN ATS Alternate Kerberos HTTP Authentication Changes

2016-05-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280917#comment-15280917 ] Jian He commented on YARN-4006: --- [~gss2002], could you please describe what the current probl

[jira] [Commented] (YARN-5024) TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure

2016-05-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280920#comment-15280920 ] Daniel Templeton commented on YARN-5024: [~bibinchundatt], thanks for the patch. I

[jira] [Created] (YARN-5075) Fix findbugs warning in hadoop-yarn-common module

2016-05-11 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created YARN-5075: --- Summary: Fix findbugs warning in hadoop-yarn-common module Key: YARN-5075 URL: https://issues.apache.org/jira/browse/YARN-5075 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-5075) Fix findbugs warning in hadoop-yarn-common module

2016-05-11 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-5075: Attachment: findbugs.html Attaching a html file for the detail. > Fix findbugs warning in hadoop-yar

[jira] [Commented] (YARN-2506) TimelineClient should NOT be in yarn-common project

2016-05-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280994#comment-15280994 ] Hitesh Shah commented on YARN-2506: --- Seems like something useful as part of 3.x given tha

[jira] [Commented] (YARN-2506) TimelineClient should NOT be in yarn-common project

2016-05-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280992#comment-15280992 ] Hitesh Shah commented on YARN-2506: --- Why not do this in trunk? > TimelineClient should

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-05-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280993#comment-15280993 ] Hadoop QA commented on YARN-4577: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-05-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281003#comment-15281003 ] Sangjin Lee commented on YARN-4577: --- I think it's quite close. The hadoop-common test fai

[jira] [Updated] (YARN-867) Isolation of failures in aux services

2016-05-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-867: - Target Version/s: 2.9.0 (was: 2.8.0) Priority: Major (was: Critical) This is an improvement,. Unlikely

[jira] [Updated] (YARN-5074) RM cycles through container ids for an app that is waiting for resources.

2016-05-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5074: - Attachment: YARN-5074-test-case.patch > RM cycles through container ids for an app that is waiting for reso

[jira] [Commented] (YARN-5074) RM cycles through container ids for an app that is waiting for resources.

2016-05-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281017#comment-15281017 ] Wangda Tan commented on YARN-5074: -- Thanks [~sidharta-s] reporting this issue. This hap

[jira] [Commented] (YARN-5074) RM cycles through container ids for an app that is waiting for resources.

2016-05-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281019#comment-15281019 ] Wangda Tan commented on YARN-5074: -- CC: [~jlowe]/[~nroberts] > RM cycles through containe

[jira] [Updated] (YARN-2888) Corrective mechanisms for rebalancing NM container queues

2016-05-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2888: -- Attachment: YARN-2888.008.patch Updating patch with some minor renaming changes suggested by [~kkaranasos

[jira] [Updated] (YARN-3344) procfs stat file is not in the expected format warning

2016-05-11 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-3344: Attachment: YARN-3344.07.patch Nice catch, [~templedf]. Updated the patch to address the comment. >

[jira] [Reopened] (YARN-2506) TimelineClient should NOT be in yarn-common project

2016-05-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reopened YARN-2506: --- > TimelineClient should NOT be in yarn-common project > --- > >

[jira] [Updated] (YARN-2506) TimelineClient should NOT be in yarn-common project

2016-05-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2506: -- Target Version/s: 3.0.0 (was: 2.8.0) bq. Why not do this in trunk? Having two diverged code base to maintain is

[jira] [Commented] (YARN-4963) capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurable

2016-05-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281035#comment-15281035 ] Wangda Tan commented on YARN-4963: -- Thanks [~nroberts], few comments: 1) Configuration na

[jira] [Commented] (YARN-4995) Fair Scheduler: Display demand resource for queues on the scheduler page

2016-05-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281038#comment-15281038 ] Karthik Kambatla commented on YARN-4995: Cool. Looks good per my previous review. C

[jira] [Commented] (YARN-4002) make ResourceTrackerService.nodeHeartbeat more concurrent

2016-05-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281041#comment-15281041 ] Wangda Tan commented on YARN-4002: -- [~rohithsharma], is there any update for the latest pa

[jira] [Commented] (YARN-3997) An Application requesting multiple core containers can't preempt running application made of single core containers

2016-05-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281043#comment-15281043 ] Wangda Tan commented on YARN-3997: -- [~asuresh], do you have plan to finish this recently?

[jira] [Commented] (YARN-1815) RM should record final state for unmanaged AMs

2016-05-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281045#comment-15281045 ] Subru Krishnan commented on YARN-1815: -- [~jianhe], there are actually two problems I n

[jira] [Updated] (YARN-3153) Capacity Scheduler max AM resource limit for queues is defined as percentage but used as ratio

2016-05-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3153: - Target Version/s: 3.0.0 (was: 2.8.0) > Capacity Scheduler max AM resource limit for queues is defined as p

[jira] [Commented] (YARN-3153) Capacity Scheduler max AM resource limit for queues is defined as percentage but used as ratio

2016-05-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281047#comment-15281047 ] Wangda Tan commented on YARN-3153: -- Move this to 3.0.0 release. > Capacity Scheduler max

[jira] [Commented] (YARN-2919) Potential race between renew and cancel in DelegationTokenRenwer

2016-05-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281048#comment-15281048 ] Wangda Tan commented on YARN-2919: -- [~Naganarasimha], do you have bandwidth to finish this

[jira] [Commented] (YARN-2684) FairScheduler: When failing an application due to changes in queue config or placement policy, indicate the cause.

2016-05-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281049#comment-15281049 ] Wangda Tan commented on YARN-2684: -- [~rohithsharma]/[~kasha], do you have bandwidth to fin

[jira] [Commented] (YARN-1815) RM should record final state for unmanaged AMs

2016-05-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281057#comment-15281057 ] Jian He commented on YARN-1815: --- I see, I thought there was not progress since no patch was u

[jira] [Updated] (YARN-4995) FairScheduler: Display demand resource for queues on the scheduler page

2016-05-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4995: --- Summary: FairScheduler: Display demand resource for queues on the scheduler page (was: Fair Sc

[jira] [Updated] (YARN-4995) FairScheduler: Display per-queue demand on the scheduler page

2016-05-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4995: --- Summary: FairScheduler: Display per-queue demand on the scheduler page (was: FairScheduler: Di

[jira] [Updated] (YARN-1815) RM should record final state for unmanaged AMs

2016-05-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1815: -- Target Version/s: 2.8.0 (was: 2.9.0) > RM should record final state for unmanaged AMs > ---

[jira] [Commented] (YARN-2888) Corrective mechanisms for rebalancing NM container queues

2016-05-11 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281059#comment-15281059 ] Konstantinos Karanasos commented on YARN-2888: -- Thanks, [~asuresh]! I went ov

[jira] [Commented] (YARN-4969) Fix more loggings in CapacityScheduler

2016-05-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281068#comment-15281068 ] Hadoop QA commented on YARN-4969: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4971) RM fails to re-bind to wildcard IP after failover in multi homed clusters

2016-05-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281097#comment-15281097 ] Karthik Kambatla commented on YARN-4971: I must be missing something, but can't fig

[jira] [Commented] (YARN-5049) Extend NMStateStore to save queued container information

2016-05-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281101#comment-15281101 ] Hadoop QA commented on YARN-5049: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-3997) An Application requesting multiple core containers can't preempt running application made of single core containers

2016-05-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15281107#comment-15281107 ] Arun Suresh commented on YARN-3997: --- [~leftnoteasy], please go ahead and move it to 2.9

  1   2   >