[jira] [Updated] (YARN-7766) Introduce a new config property for YARN Service dependency tarball location

2018-01-19 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-7766: Attachment: YARN-7766.003.patch > Introduce a new config property for YARN Service dependency tarball

[jira] [Commented] (YARN-7766) Introduce a new config property for YARN Service dependency tarball location

2018-01-19 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333152#comment-16333152 ] Gour Saha commented on YARN-7766: - [~jianhe], thank you for reviewing the patch. I incorporated your

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-19 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333145#comment-16333145 ] genericqa commented on YARN-2185: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7780) Documentation for Placement Constraints

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333142#comment-16333142 ] Sunil G commented on YARN-7780: --- Thanks [~kkaranasos]. Such an example will really help in case of

[jira] [Commented] (YARN-7780) Documentation for Placement Constraints

2018-01-19 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333138#comment-16333138 ] Konstantinos Karanasos commented on YARN-7780: -- Thanks [~cheersyang] – will upload a first

[jira] [Commented] (YARN-7778) Merging of constraints defined at different levels

2018-01-19 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333136#comment-16333136 ] Konstantinos Karanasos commented on YARN-7778: -- Sure [~cheersyang], go ahead. Let me know if

[jira] [Commented] (YARN-7774) Miscellaneous fixes to the PlacementProcessor

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333135#comment-16333135 ] Sunil G commented on YARN-7774: --- Makes sense. Sorry, I missed that one. Could you also update the exception

[jira] [Commented] (YARN-7774) Miscellaneous fixes to the PlacementProcessor

2018-01-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333132#comment-16333132 ] Arun Suresh commented on YARN-7774: --- [~sunilg], so, do take a look at [this

[jira] [Commented] (YARN-7774) Miscellaneous fixes to the PlacementProcessor

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333127#comment-16333127 ] Sunil G commented on YARN-7774: --- A quick doubt. {{SingleConstraintAppPlacementAllocator}} why maxCardinality

[jira] [Commented] (YARN-7780) Documentation for Placement Constraints

2018-01-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333125#comment-16333125 ] Weiwei Yang commented on YARN-7780: --- [~kkaranasos], please let me know if this task can be split and how

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-19 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333122#comment-16333122 ] Robert Kanter commented on YARN-2185: - +1 LGTM [~jlowe] any other comments? > Use pipes when

[jira] [Commented] (YARN-7774) Miscellaneous fixes to the PlacementProcessor

2018-01-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333121#comment-16333121 ] Weiwei Yang commented on YARN-7774: --- Hi [~asuresh], that sounds good to me. +1 on latest patch. I will

[jira] [Comment Edited] (YARN-7745) Allow DistributedShell to take a placement specification for containers it wants to launch

2018-01-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333112#comment-16333112 ] Arun Suresh edited comment on YARN-7745 at 1/20/18 1:42 AM: [~sunilg], sure,

[jira] [Commented] (YARN-7745) Allow DistributedShell to take a placement specification for containers it wants to launch

2018-01-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333112#comment-16333112 ] Arun Suresh commented on YARN-7745: --- [~sunilg], sure, will file test case JIRAs. In the mean time, in the

[jira] [Comment Edited] (YARN-7774) Miscellaneous fixes to the PlacementProcessor

2018-01-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333097#comment-16333097 ] Arun Suresh edited comment on YARN-7774 at 1/20/18 1:34 AM: The test case error

[jira] [Commented] (YARN-7774) Miscellaneous fixes to the PlacementProcessor

2018-01-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333097#comment-16333097 ] Arun Suresh commented on YARN-7774: --- The test case error is unrelated. [~Weiwei Yang] , [~kkaranasos] ,

[jira] [Commented] (YARN-7778) Merging of constraints defined at different levels

2018-01-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333091#comment-16333091 ] Weiwei Yang commented on YARN-7778: --- I volunteer to help on this task, [~kkaranasos] can I take over? I

[jira] [Commented] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

2018-01-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333090#comment-16333090 ] Weiwei Yang commented on YARN-7763: --- Hi [~sunilg] {quote} i think *constraint* could be updated in *pcm* 

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-19 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333045#comment-16333045 ] genericqa commented on YARN-5473: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-19 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333038#comment-16333038 ] genericqa commented on YARN-2185: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7782) Enable user re-mapping for Docker containers in yarn-default.xml

2018-01-19 Thread Eric Yang (JIRA)
Eric Yang created YARN-7782: --- Summary: Enable user re-mapping for Docker containers in yarn-default.xml Key: YARN-7782 URL: https://issues.apache.org/jira/browse/YARN-7782 Project: Hadoop YARN

[jira] [Updated] (YARN-7782) Enable user re-mapping for Docker containers in yarn-default.xml

2018-01-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7782: Description: In YARN-4266, the recommendation was to use -u [uid]:[gid] numeric values to enforce user and

[jira] [Commented] (YARN-7537) [Atsv2] load hbase configuration from filesystem rather than URL

2018-01-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333023#comment-16333023 ] Hudson commented on YARN-7537: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13527 (See

[jira] [Commented] (YARN-7766) Introduce a new config property for YARN Service dependency tarball location

2018-01-19 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333002#comment-16333002 ] Jian He commented on YARN-7766: --- {code} public int actionDependency(String destinationFolder, boolean

[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2018-01-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-2185: - Attachment: YARN-2185.008.patch > Use pipes when localizing archives >

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332965#comment-16332965 ] Miklos Szegedi commented on YARN-2185: -- Thank you for the review [~rkanter]. I updated the patch. >

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332963#comment-16332963 ] Haibo Chen commented on YARN-5473: -- Thanks [~snemeth] for the review! For 1) and 2), given the patch is

[jira] [Updated] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5473: - Attachment: YARN-5473-YARN-1011.02.patch > Expose per-application over-allocation info in the Resource

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332954#comment-16332954 ] Arun Suresh commented on YARN-7779: --- Definitely a good idea. Thanks for taking this up [~cheersyang] >

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-19 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332948#comment-16332948 ] Robert Kanter commented on YARN-2185: - Thanks for the update [~miklos.szeg...@cloudera.com].  One last

[jira] [Created] (YARN-7781) Update YARN-Services-Examples.md to be in sync with the latest code

2018-01-19 Thread Gour Saha (JIRA)
Gour Saha created YARN-7781: --- Summary: Update YARN-Services-Examples.md to be in sync with the latest code Key: YARN-7781 URL: https://issues.apache.org/jira/browse/YARN-7781 Project: Hadoop YARN

[jira] [Commented] (YARN-7774) Miscellaneous fixes to the PlacementProcessor

2018-01-19 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332945#comment-16332945 ] genericqa commented on YARN-7774: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7732) Support Pluggable AM Simulator

2018-01-19 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332944#comment-16332944 ] genericqa commented on YARN-7732: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7774) Miscellaneous fixes to the PlacementProcessor

2018-01-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332847#comment-16332847 ] Arun Suresh commented on YARN-7774: --- Updating patch * Moved circular iterator to its own class * The

[jira] [Updated] (YARN-7774) Miscellaneous fixes to the PlacementProcessor

2018-01-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7774: -- Attachment: YARN-7774-YARN-6592.005.patch > Miscellaneous fixes to the PlacementProcessor >

[jira] [Commented] (YARN-7777) Fix user name format in YARN Registry DNS name

2018-01-19 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332831#comment-16332831 ] genericqa commented on YARN-: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5428) Allow for specifying the docker client configuration directory

2018-01-19 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332828#comment-16332828 ] Jian He commented on YARN-5428: --- Patch looks good me overall, wondering if we should check the credential

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

2018-01-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332736#comment-16332736 ] Hudson commented on YARN-5094: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13525 (See

[jira] [Commented] (YARN-7777) Fix user name format in YARN Registry DNS name

2018-01-19 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332727#comment-16332727 ] Jian He commented on YARN-: --- yeah, good point, missed that, updated the patch > Fix user name format in

[jira] [Updated] (YARN-7777) Fix user name format in YARN Registry DNS name

2018-01-19 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-: -- Attachment: YARN-.02.patch > Fix user name format in YARN Registry DNS name >

[jira] [Comment Edited] (YARN-6648) [GPG] Add SubClusterCleaner in Global Policy Generator

2018-01-19 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332694#comment-16332694 ] Carlo Curino edited comment on YARN-6648 at 1/19/18 6:37 PM: - [~botong] thanks

[jira] [Commented] (YARN-7774) Miscellaneous fixes to the PlacementProcessor

2018-01-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332708#comment-16332708 ] Arun Suresh commented on YARN-7774: --- Thanks for the comments [~kkaranasos] and [~cheersyang]. bq.

[jira] [Commented] (YARN-7537) [Atsv2] load hbase configuration from filesystem rather than URL

2018-01-19 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332702#comment-16332702 ] Vrushali C commented on YARN-7537: -- +1 on latest patch. Will commit shortly to trunk and branch-2 >

[jira] [Commented] (YARN-6648) [GPG] Add SubClusterCleaner in Global Policy Generator

2018-01-19 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332694#comment-16332694 ] Carlo Curino commented on YARN-6648: [~botong] thanks for the updated patch, I think it is nicer to

[jira] [Commented] (YARN-6648) [GPG] Add SubClusterCleaner in Global Policy Generator

2018-01-19 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332682#comment-16332682 ] genericqa commented on YARN-6648: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7780) Documentation for Placement Constraints

2018-01-19 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7780: - Summary: Documentation for Placement Constraints Key: YARN-7780 URL: https://issues.apache.org/jira/browse/YARN-7780 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-6384) Add configuration property to set max CPU usage when strict-resource-usage is false with cgroups

2018-01-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332616#comment-16332616 ] Miklos Szegedi commented on YARN-6384: -- Thank you for the latest patch [~lolee_k] and for the review

[jira] [Updated] (YARN-6384) Add configuration property to increase max CPU usage when strict-resource-usage is true with cgroups

2018-01-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6384: - Summary: Add configuration property to increase max CPU usage when strict-resource-usage is true

[jira] [Commented] (YARN-7737) prelaunch.err file not found exception on container failure

2018-01-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332614#comment-16332614 ] Zhe Zhang commented on YARN-7737: - +1, looks to me a clear fix. Will wait for [~jhung] to take a look

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

2018-01-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332604#comment-16332604 ] Haibo Chen commented on YARN-5094: -- Thanks [~rohithsharma] for the review. Will commit it shortly. > some

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

2018-01-19 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332598#comment-16332598 ] Rohith Sharma K S commented on YARN-5094: - I cross confirmed that it only happens for NM publishing

[jira] [Assigned] (YARN-6384) Add configuration property to set max CPU usage when strict-resource-usage is false with cgroups

2018-01-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-6384: Assignee: dengkai > Add configuration property to set max CPU usage when

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

2018-01-19 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332573#comment-16332573 ] Rohith Sharma K S commented on YARN-5094: - Yes, we need this to get in. Patch looks fine to me. I

[jira] [Comment Edited] (YARN-7745) Allow DistributedShell to take a placement specification for containers it wants to launch

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332556#comment-16332556 ] Sunil G edited comment on YARN-7745 at 1/19/18 5:10 PM: [~asuresh] is this possible

[jira] [Updated] (YARN-6648) [GPG] Add SubClusterCleaner in Global Policy Generator

2018-01-19 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6648: --- Attachment: YARN-6648-YARN-7402.v3.patch > [GPG] Add SubClusterCleaner in Global Policy Generator >

[jira] [Commented] (YARN-7745) Allow DistributedShell to take a placement specification for containers it wants to launch

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332556#comment-16332556 ] Sunil G commented on YARN-7745: --- [~asuresh] is this possible to have a test case for this? or could share

[jira] [Updated] (YARN-6648) [GPG] Add SubClusterCleaner in Global Policy Generator

2018-01-19 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6648: --- Attachment: YARN-7102.v9.patch > [GPG] Add SubClusterCleaner in Global Policy Generator >

[jira] [Updated] (YARN-6648) [GPG] Add SubClusterCleaner in Global Policy Generator

2018-01-19 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6648: --- Attachment: (was: YARN-7102.v9.patch) > [GPG] Add SubClusterCleaner in Global Policy Generator >

[jira] [Commented] (YARN-7723) Avoid using docker volume --format option to compatible to older docker releases

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332547#comment-16332547 ] Sunil G commented on YARN-7723: --- This patch seems fine to me to work with old version. [~ebadger], if you

[jira] [Commented] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332545#comment-16332545 ] Sunil G commented on YARN-7763: --- [~cheersyang], in {{canSatisfyConstraints}} , we can see that constraint is

[jira] [Assigned] (YARN-7677) HADOOP_CONF_DIR should not be automatically put in task environment

2018-01-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger reassigned YARN-7677: - Assignee: Jim Brennan (was: Eric Badger) > HADOOP_CONF_DIR should not be automatically put in

[jira] [Comment Edited] (YARN-5094) some YARN container events have timestamp of -1

2018-01-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332482#comment-16332482 ] Haibo Chen edited comment on YARN-5094 at 1/19/18 4:13 PM: --- +1 on fixing it.

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

2018-01-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332482#comment-16332482 ] Haibo Chen commented on YARN-5094: -- +1 on fixing it. [~rohithsharma] [~sunilg] [~vrushalic]

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2018-01-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332477#comment-16332477 ] Eric Badger commented on YARN-7516: --- Yes, sorry for the delay, [~eyang]. I recently found out I have

[jira] [Assigned] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

2018-01-19 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-4022: Assignee: Szilard Nemeth > queue not remove from webpage(/cluster/scheduler) when delete

[jira] [Commented] (YARN-7777) Fix user name format in YARN Registry DNS name

2018-01-19 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332356#comment-16332356 ] Billie Rinaldi commented on YARN-: -- I don't think patch 01 will be sufficient, since RegistryDNS

[jira] [Commented] (YARN-7770) Support for setting application priority for Distributed Shell jobs

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332351#comment-16332351 ] Sunil G commented on YARN-7770: --- [~charanh] DS has a property called *--priority*, could u pls check that.

[jira] [Commented] (YARN-7537) [Atsv2] load hbase configuration from filesystem rather than URL

2018-01-19 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332158#comment-16332158 ] genericqa commented on YARN-7537: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7139) FairScheduler: finished applications are always restored to default queue

2018-01-19 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332146#comment-16332146 ] Wilfred Spiegelenburg commented on YARN-7139: - thank you [~snemeth] for the review and

[jira] [Commented] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

2018-01-19 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332140#comment-16332140 ] genericqa commented on YARN-7763: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

2018-01-19 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332103#comment-16332103 ] genericqa commented on YARN-7763: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7753) [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2

2018-01-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332096#comment-16332096 ] Hudson commented on YARN-7753: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13521 (See

[jira] [Commented] (YARN-7528) Resource types that use units need to be defined at RM level and NM level or when using small units you will overflow max_allocation calculation

2018-01-19 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332084#comment-16332084 ] Szilard Nemeth commented on YARN-7528: -- Hey [~gsohn]!  Sure, I will discuss this one with Daniel.

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332033#comment-16332033 ] Weiwei Yang commented on YARN-7779: --- Hi [~kkaranasos], [~asuresh] If this makes sense to you, I can help

[jira] [Created] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-7779: - Summary: Display allocation tags in RM web UI and expose via REST API Key: YARN-7779 URL: https://issues.apache.org/jira/browse/YARN-7779 Project: Hadoop YARN

[jira] [Commented] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

2018-01-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332018#comment-16332018 ] Weiwei Yang commented on YARN-7763: --- Thanks [~kkaranasos], uploaded v6 patch that fixed the position of

[jira] [Updated] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

2018-01-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7763: -- Attachment: YARN-7763-YARN-6592.006.patch > Allow Constraints specified in the SchedulingRequest to

[jira] [Commented] (YARN-7753) [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2

2018-01-19 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332012#comment-16332012 ] genericqa commented on YARN-7753: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

2018-01-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7763: -- Attachment: YARN-7763-YARN-6592.005.patch > Allow Constraints specified in the SchedulingRequest to

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

2018-01-19 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331994#comment-16331994 ] genericqa commented on YARN-5094: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7753) [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2

2018-01-19 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331990#comment-16331990 ] Rohith Sharma K S commented on YARN-7753: - +1lgtm, pending jenkins > [UI2] Application logs has to

[jira] [Commented] (YARN-7762) ATS uses timeline service config to identify local hostname

2018-01-19 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331984#comment-16331984 ] Rohith Sharma K S commented on YARN-7762: - It is done intentionally for secure login from

[jira] [Commented] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

2018-01-19 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331979#comment-16331979 ] Konstantinos Karanasos commented on YARN-7763: -- Thanks [~cheersyang]. Only one minor thing:

[jira] [Commented] (YARN-7753) [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2

2018-01-19 Thread Vasudevan Skm (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331970#comment-16331970 ] Vasudevan Skm commented on YARN-7753: - Looks good. +1 > [UI2] Application logs has to be pulled from

[jira] [Commented] (YARN-7774) Miscellaneous fixes to the PlacementProcessor

2018-01-19 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331969#comment-16331969 ] Konstantinos Karanasos commented on YARN-7774: -- Thanks [~asuresh] for the patch. Looks good

[jira] [Commented] (YARN-7753) [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331959#comment-16331959 ] Sunil G commented on YARN-7753: --- Updated patch after fixing v1 address fix issue. This log will now work for

[jira] [Updated] (YARN-7753) [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7753: -- Attachment: YARN-7753.002.patch > [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2 >

[jira] [Commented] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

2018-01-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331941#comment-16331941 ] Weiwei Yang commented on YARN-7763: --- Thanks [~kkaranasos], I just uploaded v4 patch to address your

[jira] [Updated] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

2018-01-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7763: -- Attachment: YARN-7763-YARN-6592.004.patch > Allow Constraints specified in the SchedulingRequest to

[jira] [Commented] (YARN-7766) Introduce a new config property for YARN Service dependency tarball location

2018-01-19 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331924#comment-16331924 ] genericqa commented on YARN-7766: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

2018-01-19 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331917#comment-16331917 ] Konstantinos Karanasos commented on YARN-7763: -- Thanks [~cheersyang]. {quote}I did not do that

[jira] [Created] (YARN-7778) Merging of constraints defined at different levels

2018-01-19 Thread Konstantinos Karanasos (JIRA)
Konstantinos Karanasos created YARN-7778: Summary: Merging of constraints defined at different levels Key: YARN-7778 URL: https://issues.apache.org/jira/browse/YARN-7778 Project: Hadoop YARN

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331894#comment-16331894 ] Sunil G commented on YARN-5094: --- Container finished time is coming as -1 when new UI pulls container data

[jira] [Comment Edited] (YARN-5094) some YARN container events have timestamp of -1

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331894#comment-16331894 ] Sunil G edited comment on YARN-5094 at 1/19/18 8:25 AM: Container finished time is

[jira] [Updated] (YARN-5094) some YARN container events have timestamp of -1

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5094: -- Affects Version/s: (was: YARN-2928) 2.9.0 3.0.0 > some YARN

[jira] [Updated] (YARN-5094) some YARN container events have timestamp of -1

2018-01-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5094: -- Priority: Critical (was: Major) > some YARN container events have timestamp of -1 >

[jira] [Commented] (YARN-7774) Miscellaneous fixes to the PlacementProcessor

2018-01-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331868#comment-16331868 ] Weiwei Yang commented on YARN-7774: --- Hi [~asuresh] In \{{DefaultPlacementAlgorithm}}, for each