[jira] [Commented] (YARN-7778) Merging of constraints defined at different levels

2018-02-01 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349924#comment-16349924 ] Konstantinos Karanasos commented on YARN-7778: -- Thanks [~cheersyang], will com

[jira] [Commented] (YARN-4761) NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler

2018-02-01 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349911#comment-16349911 ] Yufei Gu commented on YARN-4761: [~sourabh912], [~sjlee0], make sense to me to replace getT

[jira] [Commented] (YARN-7854) Attach prefixes to different type of node attributes

2018-02-01 Thread LiangYe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349903#comment-16349903 ] LiangYe commented on YARN-7854: --- Thanks [~sunilg] [~cheersyang] for comments. # Agree, use D

[jira] [Commented] (YARN-7876) Workaround ZipInputStream limitation for YARN-2185

2018-02-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349901#comment-16349901 ] genericqa commented on YARN-7876: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7868) Provide improved error message when YARN service is disabled

2018-02-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349880#comment-16349880 ] Jian He commented on YARN-7868: --- lgtm, does it make sense to add one more msg saying "Please

[jira] [Commented] (YARN-4761) NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler

2018-02-01 Thread Sourabh Goyal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349871#comment-16349871 ] Sourabh Goyal commented on YARN-4761: - [~templedf] [~yufeigu]: Looking at the code, I

[jira] [Updated] (YARN-7871) Node attributes reporting from NM to RM

2018-02-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7871: -- Description: Support to initialize proper attribute provider based on user's configuration. NM collects n

[jira] [Commented] (YARN-7800) Bind node constraint once a container is proposed to be placed on this node

2018-02-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349868#comment-16349868 ] Weiwei Yang commented on YARN-7800: --- Hi [~asuresh], [~leftnoteasy] Please take a look at

[jira] [Created] (YARN-7878) Docker container IP detail missing when service is in STABLE state

2018-02-01 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-7878: Summary: Docker container IP detail missing when service is in STABLE state Key: YARN-7878 URL: https://issues.apache.org/jira/browse/YARN-7878 Project: Hadoop YARN

[jira] [Created] (YARN-7877) Node attributes error handling based on RM validation response

2018-02-01 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-7877: - Summary: Node attributes error handling based on RM validation response Key: YARN-7877 URL: https://issues.apache.org/jira/browse/YARN-7877 Project: Hadoop YARN I

[jira] [Updated] (YARN-7856) Validation node attributes in NM

2018-02-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7856: -- Description: NM needs to do proper validation about the attributes before sending them to RM, this inclu

[jira] [Updated] (YARN-7856) Validation node attributes in NM

2018-02-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7856: -- Summary: Validation node attributes in NM (was: Validation and error handling when handling NM-RM with r

[jira] [Commented] (YARN-7854) Attach prefixes to different type of node attributes

2018-02-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349839#comment-16349839 ] Sunil G commented on YARN-7854: --- Thanks [~LambertYe] for investigations. Few general comments

[jira] [Comment Edited] (YARN-7854) Attach prefixes to different type of node attributes

2018-02-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349832#comment-16349832 ] Weiwei Yang edited comment on YARN-7854 at 2/2/18 6:09 AM: --- Hi [~

[jira] [Commented] (YARN-7854) Attach prefixes to different type of node attributes

2018-02-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349832#comment-16349832 ] Weiwei Yang commented on YARN-7854: --- Hi [~LambertYe] Thanks for the investigation. Follo

[jira] [Updated] (YARN-7876) Workaround ZipInputStream limitation for YARN-2185

2018-02-01 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7876: - Attachment: YARN-7876.000.patch > Workaround ZipInputStream limitation for YARN-2185 >

[jira] [Created] (YARN-7876) Workaround ZipInputStream limitation for YARN-2185

2018-02-01 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7876: Summary: Workaround ZipInputStream limitation for YARN-2185 Key: YARN-7876 URL: https://issues.apache.org/jira/browse/YARN-7876 Project: Hadoop YARN Issue Ty

[jira] [Commented] (YARN-7292) Revisit Resource Profile Behavior

2018-02-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349811#comment-16349811 ] genericqa commented on YARN-7292: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7840) Update PB for prefix support of node attributes

2018-02-01 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-7840: --- Fix Version/s: yarn-3409 > Update PB for prefix support of node attributes > --

[jira] [Created] (YARN-7875) AttributeStore for store and recover attributes

2018-02-01 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-7875: -- Summary: AttributeStore for store and recover attributes Key: YARN-7875 URL: https://issues.apache.org/jira/browse/YARN-7875 Project: Hadoop YARN Issue T

[jira] [Updated] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-02-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7757: -- Attachment: nodeLabelsProvider_refactor_v2.pdf > Refactor NodeLabelsProvider to be more generic and reusa

[jira] [Comment Edited] (YARN-7854) Attach prefixes to different type of node attributes

2018-02-01 Thread LiangYe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349752#comment-16349752 ] LiangYe edited comment on YARN-7854 at 2/2/18 4:02 AM: --- In k8s,  [Nam

[jira] [Commented] (YARN-7854) Attach prefixes to different type of node attributes

2018-02-01 Thread LiangYe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349752#comment-16349752 ] LiangYe commented on YARN-7854: --- In k8s,  [Namespace|https://github.com/kubernetes/community/

[jira] [Commented] (YARN-7292) Revisit Resource Profile Behavior

2018-02-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349731#comment-16349731 ] Wangda Tan commented on YARN-7292: -- Attached ver.1 patch (wip) to see how much it breaks.

[jira] [Updated] (YARN-7292) Revisit Resource Profile Behavior

2018-02-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7292: - Attachment: YARN-7292.wip.001.patch > Revisit Resource Profile Behavior > -

[jira] [Commented] (YARN-4882) Change the log level to DEBUG for recovering completed applications

2018-02-01 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349675#comment-16349675 ] Giovanni Matteo Fumarola commented on YARN-4882: Thanks [~jlowe] for the an

[jira] [Updated] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-02-01 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwj updated YARN-7859: - Description:  As everyone knows.In FairScheduler the phenomenon of queue scheduling starvation often occurs wh

[jira] [Commented] (YARN-7778) Merging of constraints defined at different levels

2018-02-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349610#comment-16349610 ] Weiwei Yang commented on YARN-7778: --- Sure thing, thanks for taking care of it [~kkaranaso

[jira] [Updated] (YARN-7873) Revert YARN-6078

2018-02-01 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-7873: - Target Version/s: 3.1.0 > Revert YARN-6078 > > > Key: YARN-7873 >

[jira] [Resolved] (YARN-7874) Improve RSGroupBasedLoadBalancer#

2018-02-01 Thread Xiang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiang Li resolved YARN-7874. Resolution: Invalid Sorry, this one is supposed to open to HBase... > Improve RSGroupBasedLoadBalancer# > --

[jira] [Commented] (YARN-6078) Containers stuck in Localizing state

2018-02-01 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349585#comment-16349585 ] Billie Rinaldi commented on YARN-6078: -- [~bibinchundatt] [~djp] I am planning to rever

[jira] [Created] (YARN-7874) Improve RSGroupBasedLoadBalancer#

2018-02-01 Thread Xiang Li (JIRA)
Xiang Li created YARN-7874: -- Summary: Improve RSGroupBasedLoadBalancer# Key: YARN-7874 URL: https://issues.apache.org/jira/browse/YARN-7874 Project: Hadoop YARN Issue Type: Improvement R

[jira] [Created] (YARN-7873) Revert YARN-6078

2018-02-01 Thread Billie Rinaldi (JIRA)
Billie Rinaldi created YARN-7873: Summary: Revert YARN-6078 Key: YARN-7873 URL: https://issues.apache.org/jira/browse/YARN-7873 Project: Hadoop YARN Issue Type: Bug Affects Versions: 3.0.

[jira] [Commented] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-02-01 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349563#comment-16349563 ] Naganarasimha G R commented on YARN-7757: - {quote}bq. Does this need to be run unde

[jira] [Commented] (YARN-6648) [GPG] Add SubClusterCleaner in Global Policy Generator

2018-02-01 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349491#comment-16349491 ] Botong Huang commented on YARN-6648: Committed to YARN-7402. Thanks [~curino] for the r

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-02-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349474#comment-16349474 ] Eric Yang commented on YARN-7221: - The failed unit test is not related to this patch. > Ad

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349465#comment-16349465 ] Eric Yang commented on YARN-7677: - [~jlowe] I agree with [~billie.rinaldi] and YARN-5714 ap

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349437#comment-16349437 ] Jason Lowe commented on YARN-7677: -- True, but that assumes the user even knows what the pa

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349449#comment-16349449 ] Billie Rinaldi commented on YARN-7677: -- They'd have to be told the available versions

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349435#comment-16349435 ] Billie Rinaldi commented on YARN-7677: -- It would be much more straightforward for the

[jira] [Commented] (YARN-4882) Change the log level to DEBUG for recovering completed applications

2018-02-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349432#comment-16349432 ] Jason Lowe commented on YARN-4882: -- bq. From the above code, if RM fails to recover an app

[jira] [Assigned] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-02-01 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-7859: -- Assignee: wangwj > New feature: add queue scheduling deadLine in fairScheduler. > --

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349420#comment-16349420 ] Jason Lowe commented on YARN-7677: -- bq. the primary use case is AM-defined vars being able

[jira] [Commented] (YARN-7857) -fstack-check compilation flag causes binary incompatibility for container-executor between RHEL 6 and RHEL 7

2018-02-01 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349410#comment-16349410 ] Jim Brennan commented on YARN-7857: --- As this is a change to the command line for containe

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-02-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349350#comment-16349350 ] genericqa commented on YARN-7221: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7781) Update YARN-Services-Examples.md to be in sync with the latest code

2018-02-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349347#comment-16349347 ] genericqa commented on YARN-7781: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349338#comment-16349338 ] Shane Kumpf commented on YARN-7677: --- Thanks for pointing out the existing issue and the p

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349331#comment-16349331 ] Billie Rinaldi commented on YARN-7677: -- bq. In the general case, we're not going to be

[jira] [Commented] (YARN-5714) ContainerExecutor does not order environment map

2018-02-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349312#comment-16349312 ] Jason Lowe commented on YARN-5714: -- Sorry to come to this late. We ran across an instance

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349305#comment-16349305 ] Jim Brennan commented on YARN-7677: --- I have tested a version of the patch where I write o

[jira] [Updated] (YARN-7866) [UI2] Kerberizing the UI doesn't give any warning or content when UI is accessed without kinit

2018-02-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7866: -- Reporter: Sumana Sathish (was: Sunil G) > [UI2] Kerberizing the UI doesn't give any warning or content when UI i

[jira] [Commented] (YARN-5714) ContainerExecutor does not order environment map

2018-02-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349304#comment-16349304 ] genericqa commented on YARN-5714: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349301#comment-16349301 ] Jason Lowe commented on YARN-7677: -- YARN-5714 is very relevant here. In the general case,

[jira] [Commented] (YARN-5028) RMStateStore should trim down app state for completed applications

2018-02-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349286#comment-16349286 ] genericqa commented on YARN-5028: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (YARN-7781) Update YARN-Services-Examples.md to be in sync with the latest code

2018-02-01 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349256#comment-16349256 ] Gour Saha edited comment on YARN-7781 at 2/1/18 8:59 PM: - I filed Y

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-02-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349262#comment-16349262 ] Eric Yang commented on YARN-7221: - Rebased patch to current trunk. > Add security check fo

[jira] [Updated] (YARN-7221) Add security check for privileged docker container

2018-02-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7221: Attachment: YARN-7221.003.patch > Add security check for privileged docker container > --

[jira] [Commented] (YARN-7781) Update YARN-Services-Examples.md to be in sync with the latest code

2018-02-01 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349256#comment-16349256 ] Gour Saha commented on YARN-7781: - I filed YARN-7836 for the component name path not used i

[jira] [Commented] (YARN-4882) Change the log level to DEBUG for recovering completed applications

2018-02-01 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349243#comment-16349243 ] Giovanni Matteo Fumarola commented on YARN-4882: [~templedf], [~rohithsharm

[jira] [Commented] (YARN-7781) Update YARN-Services-Examples.md to be in sync with the latest code

2018-02-01 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349242#comment-16349242 ] Billie Rinaldi commented on YARN-7781: -- With the new multi-component flex call, I thin

[jira] [Commented] (YARN-7516) Security check for trusted docker image

2018-02-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349232#comment-16349232 ] genericqa commented on YARN-7516: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-7781) Update YARN-Services-Examples.md to be in sync with the latest code

2018-02-01 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349226#comment-16349226 ] Gour Saha commented on YARN-7781: - Makes sense. +1 for patch 03. > Update YARN-Services-Ex

[jira] [Commented] (YARN-7781) Update YARN-Services-Examples.md to be in sync with the latest code

2018-02-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349218#comment-16349218 ] Jian He commented on YARN-7781: --- talked with Billie offline, I reverted the changes about ker

[jira] [Updated] (YARN-7781) Update YARN-Services-Examples.md to be in sync with the latest code

2018-02-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7781: -- Attachment: YARN-7781.03.patch > Update YARN-Services-Examples.md to be in sync with the latest code > --

[jira] [Commented] (YARN-7778) Merging of constraints defined at different levels

2018-02-01 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349178#comment-16349178 ] Konstantinos Karanasos commented on YARN-7778: -- +1 on latest patch, thanks [~c

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349168#comment-16349168 ] Jim Brennan commented on YARN-7677: --- Agreed - given that we are just processing the hash

[jira] [Commented] (YARN-7516) Security check for trusted docker image

2018-02-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349150#comment-16349150 ] Eric Yang commented on YARN-7516: - - Patch 16 drops launch command for untrusted image. - F

[jira] [Commented] (YARN-7868) Provide improved error message when YARN service is disabled

2018-02-01 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349123#comment-16349123 ] Chandni Singh commented on YARN-7868: - +1 lgtm > Provide improved error message when Y

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349119#comment-16349119 ] Shane Kumpf commented on YARN-7677: --- I'm not sure if it will be appropriate to address he

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349117#comment-16349117 ] Jim Brennan commented on YARN-7677: --- Thanks [~shaneku...@gmail.com] and [~billie.rinaldi]

[jira] [Updated] (YARN-7516) Security check for trusted docker image

2018-02-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7516: Attachment: YARN-7516.016.patch > Security check for trusted docker image > -

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349085#comment-16349085 ] Hudson commented on YARN-7677: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1359

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-02-01 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349080#comment-16349080 ] Shane Kumpf commented on YARN-7221: --- Sure. I agree that we need protections in place arou

[jira] [Commented] (YARN-7446) Docker container privileged mode and --user flag contradict each other

2018-02-01 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349064#comment-16349064 ] Shane Kumpf commented on YARN-7446: --- Thanks for clarifying. That approach sounds good to

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349042#comment-16349042 ] Shane Kumpf commented on YARN-7677: --- [~Jim_Brennan] - Thanks for the update. [~billie.rin

[jira] [Updated] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7677: - Fix Version/s: (was: 3.0.1) (was: 3.1.0) I reverted this from trunk and branch-3

[jira] [Updated] (YARN-5028) RMStateStore should trim down app state for completed applications

2018-02-01 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-5028: -- Attachment: YARN-5028.000.patch > RMStateStore should trim down app state for completed applications > --

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349024#comment-16349024 ] Jim Brennan commented on YARN-7677: --- [~shaneku...@gmail.com], [~jlowe], [~ebadger] I have

[jira] [Comment Edited] (YARN-7446) Docker container privileged mode and --user flag contradict each other

2018-02-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349008#comment-16349008 ] Eric Yang edited comment on YARN-7446 at 2/1/18 6:00 PM: - [~shaneku

[jira] [Commented] (YARN-7446) Docker container privileged mode and --user flag contradict each other

2018-02-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349008#comment-16349008 ] Eric Yang commented on YARN-7446: - [~shaneku...@gmail.com] It would be better to leave --us

[jira] [Commented] (YARN-7819) Allow PlacementProcessor to be used with the FairScheduler

2018-02-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348928#comment-16348928 ] genericqa commented on YARN-7819: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7857) -fstack-check compilation flag causes binary incompatibility for container-executor between RHEL 6 and RHEL 7

2018-02-01 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348926#comment-16348926 ] genericqa commented on YARN-7857: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348898#comment-16348898 ] Jim Brennan commented on YARN-7677: --- [~shaneku...@gmail.com], I am trying to repro locall

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-02-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1634#comment-1634 ] Eric Yang commented on YARN-7221: - [~shaneku...@gmail.com] How about get this in, and commu

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-02-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348882#comment-16348882 ] Eric Badger commented on YARN-7221: --- bq. I'll just point out that In many organization th

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348876#comment-16348876 ] Eric Badger commented on YARN-7677: --- If all AMs are failing in [~shaneku...@gmail.com]'s

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348841#comment-16348841 ] Jason Lowe commented on YARN-7677: -- Ultimately one way to debug this would be to compare t

[jira] [Commented] (YARN-7850) New UI does not show status for Log Aggregation

2018-02-01 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348832#comment-16348832 ] Yesha Vora commented on YARN-7850: -- yes sure. Thanks for picking up this Jira. > New UI d

[jira] [Updated] (YARN-7223) Document GPU isolation feature

2018-02-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7223: - Priority: Blocker (was: Major) > Document GPU isolation feature > -- > >

[jira] [Updated] (YARN-7223) Document GPU isolation feature

2018-02-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7223: - Fix Version/s: 3.1.0 > Document GPU isolation feature > -- > >

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348815#comment-16348815 ] Shane Kumpf commented on YARN-7677: --- Docker is enabled, but the applications in question

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348810#comment-16348810 ] Jason Lowe commented on YARN-7677: -- Is this with Docker containers or without? There are

[jira] [Updated] (YARN-7857) -fstack-check compilation flag causes binary incompatibility for container-executor between RHEL 6 and RHEL 7

2018-02-01 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-7857: -- Attachment: YARN-7857.001.patch > -fstack-check compilation flag causes binary incompatibility for > con

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348795#comment-16348795 ] Jim Brennan commented on YARN-7677: --- [~shaneku...@gmail.com] are you running with docker?

[jira] [Reopened] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi reopened YARN-7677: -- > Docker image cannot set HADOOP_CONF_DIR > --- > >

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348779#comment-16348779 ] Shane Kumpf commented on YARN-7677: --- [~Jim_Brennan], thanks for putting this together. Wi

[jira] [Commented] (YARN-7819) Allow PlacementProcessor to be used with the FairScheduler

2018-02-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348714#comment-16348714 ] Arun Suresh commented on YARN-7819: --- Updated patch. Fixinig findbugs and checkstyles. [~

[jira] [Updated] (YARN-7819) Allow PlacementProcessor to be used with the FairScheduler

2018-02-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7819: -- Attachment: YARN-7819.003.patch > Allow PlacementProcessor to be used with the FairScheduler > --

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-01 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348684#comment-16348684 ] Jim Brennan commented on YARN-7677: --- Thanks [~jlowe] I will put up a patch for branch-2.

[jira] [Commented] (YARN-7829) Rebalance UI2 cluster overview page

2018-02-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348613#comment-16348613 ] Sunil G commented on YARN-7829: --- perfect! Thanks [~GergelyNovak]. > Rebalance UI2 cluster ov

  1   2   >