[jira] [Comment Edited] (YARN-7863) Modify placement constraints to support node attributes

2018-01-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346391#comment-16346391 ] Arun Suresh edited comment on YARN-7863 at 1/31/18 7:58 AM: [~s

[jira] [Commented] (YARN-7861) [UI2] Logs page shows duplicated containers with ATS

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346390#comment-16346390 ] genericqa commented on YARN-7861: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-01-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346382#comment-16346382 ] Sunil G commented on YARN-7863: --- [~cheersyang] I thought of creating this ticket under YARN-3

[jira] [Created] (YARN-7863) Modify placement constraints to support node attributes

2018-01-30 Thread Sunil G (JIRA)
Sunil G created YARN-7863: - Summary: Modify placement constraints to support node attributes Key: YARN-7863 URL: https://issues.apache.org/jira/browse/YARN-7863 Project: Hadoop YARN Issue Type: Sub-t

[jira] [Created] (YARN-7862) YARN native service REST endpoint needs user.name as query param

2018-01-30 Thread Sunil G (JIRA)
Sunil G created YARN-7862: - Summary: YARN native service REST endpoint needs user.name as query param Key: YARN-7862 URL: https://issues.apache.org/jira/browse/YARN-7862 Project: Hadoop YARN Issue T

[jira] [Commented] (YARN-7827) Stop and Delete Yarn Service from RM UI fails with HTTP ERROR 404

2018-01-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346370#comment-16346370 ] Sunil G commented on YARN-7827: --- Patch is cancelled as it is not very correct to pass user.na

[jira] [Commented] (YARN-7778) Merging of constraints defined at different levels

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346367#comment-16346367 ] Weiwei Yang commented on YARN-7778: --- Test {{TestPlacementProcessor#testRePlacementAfterSc

[jira] [Commented] (YARN-7778) Merging of constraints defined at different levels

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346365#comment-16346365 ] genericqa commented on YARN-7778: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7778) Merging of constraints defined at different levels

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346362#comment-16346362 ] Weiwei Yang commented on YARN-7778: --- [~kkaranasos] could you please help to review the pa

[jira] [Commented] (YARN-7675) The new UI won't load for pre 2.8 Hadoop versions because queueCapacitiesByPartition is missing from the scheduler API

2018-01-30 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346363#comment-16346363 ] Gergely Novák commented on YARN-7675: - [~sunilg] Thank you for the review. Can you plea

[jira] [Commented] (YARN-7832) Logs page does not work for Running applications

2018-01-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346358#comment-16346358 ] Sunil G commented on YARN-7832: --- YARN-7861 is raised to handle these issues mentioned by me.

[jira] [Updated] (YARN-7861) [UI2] Logs page shows duplicated containers with ATS

2018-01-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7861: -- Description: There were couple of issues: # duplicated container listed from RM and ATS in log container list #

[jira] [Updated] (YARN-7832) Logs page does not work for Running applications

2018-01-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7832: -- Summary: Logs page does not work for Running applications (was: Logs page is not getting rendered correctly) >

[jira] [Updated] (YARN-7861) [UI2] Logs page shows duplicated containers with ATS

2018-01-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7861: -- Attachment: YARN-7861.001.patch > [UI2] Logs page shows duplicated containers with ATS >

[jira] [Updated] (YARN-7832) Logs page is not getting rendered correctly

2018-01-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7832: -- Summary: Logs page is not getting rendered correctly (was: Logs page does not work for Running applications) >

[jira] [Commented] (YARN-7860) Fix UT failure TestRMWebServiceAppsNodelabel#testAppsRunning

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346349#comment-16346349 ] Weiwei Yang commented on YARN-7860: --- Hi [~sunilg] I haven't started a patch, just assign

[jira] [Assigned] (YARN-7860) Fix UT failure TestRMWebServiceAppsNodelabel#testAppsRunning

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-7860: - Assignee: Sunil G (was: Weiwei Yang) > Fix UT failure TestRMWebServiceAppsNodelabel#testAppsRunni

[jira] [Updated] (YARN-7861) [UI2] Logs page shows duplicated containers with ATS

2018-01-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7861: -- Environment: (was: There were couple of issues: # duplicated container listed from RM and ATS in log containe

[jira] [Created] (YARN-7861) [UI2] Logs page shows duplicated containers with ATS

2018-01-30 Thread Sunil G (JIRA)
Sunil G created YARN-7861: - Summary: [UI2] Logs page shows duplicated containers with ATS Key: YARN-7861 URL: https://issues.apache.org/jira/browse/YARN-7861 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-7739) DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346323#comment-16346323 ] genericqa commented on YARN-7739: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-30 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7859: --- Summary: New feature: add queue scheduling deadLine in fairScheduler. (was: New further: add queue scheduling

[jira] [Commented] (YARN-7860) Fix UT failure TestRMWebServiceAppsNodelabel#testAppsRunning

2018-01-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346289#comment-16346289 ] Sunil G commented on YARN-7860: --- Sorry for this. Some how missed this failure.  We need to i

[jira] [Commented] (YARN-7817) Add Resource reference to RM's NodeInfo object so REST API can get non memory/vcore resource usages.

2018-01-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346287#comment-16346287 ] Sunil G commented on YARN-7817: --- Thanks [~cheersyang]. My bad. I ll take care of this. YARN-7

[jira] [Commented] (YARN-7773) YARN Federation used Mysql as state store throw exception, Unknown column 'homeSubCluster' in 'field list'

2018-01-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346284#comment-16346284 ] Sunil G commented on YARN-7773: --- cc/ [~subru] > YARN Federation used Mysql as state store th

[jira] [Created] (YARN-7860) Fix UT failure TestRMWebServiceAppsNodelabel#testAppsRunning

2018-01-30 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-7860: - Summary: Fix UT failure TestRMWebServiceAppsNodelabel#testAppsRunning Key: YARN-7860 URL: https://issues.apache.org/jira/browse/YARN-7860 Project: Hadoop YARN Iss

[jira] [Commented] (YARN-7778) Merging of constraints defined at different levels

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346276#comment-16346276 ] Weiwei Yang commented on YARN-7778: --- Fix the UT failure in {{TestSingleConstraintAppPlace

[jira] [Updated] (YARN-7778) Merging of constraints defined at different levels

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7778: -- Attachment: YARN-7778-YARN-7812.002.patch > Merging of constraints defined at different levels >

[jira] [Comment Edited] (YARN-4761) NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler

2018-01-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346254#comment-16346254 ] Sangjin Lee edited comment on YARN-4761 at 1/31/18 5:12 AM: + [

[jira] [Commented] (YARN-4761) NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler

2018-01-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346254#comment-16346254 ] Sangjin Lee commented on YARN-4761: --- + [~templedf] [~yufeigu] > NMs reconnecting with ch

[jira] [Commented] (YARN-7817) Add Resource reference to RM's NodeInfo object so REST API can get non memory/vcore resource usages.

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346252#comment-16346252 ] Weiwei Yang commented on YARN-7817: --- Seems this caused UT failure {{TestRMWebServiceAppsN

[jira] [Commented] (YARN-7773) YARN Federation used Mysql as state store throw exception, Unknown column 'homeSubCluster' in 'field list'

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346251#comment-16346251 ] genericqa commented on YARN-7773: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-7739) DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation

2018-01-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346250#comment-16346250 ] Wangda Tan commented on YARN-7739: -- Thanks [~sunilg]/[~templedf] for review:  {quote}It wo

[jira] [Assigned] (YARN-7858) Support special Node Attribute scopes in addition to NODE and RACK

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-7858: - Assignee: Weiwei Yang > Support special Node Attribute scopes in addition to NODE and RACK > -

[jira] [Updated] (YARN-7739) DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation

2018-01-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7739: - Attachment: YARN-7339.002.patch > DefaultAMSProcessor should properly check customized resource types again

[jira] [Commented] (YARN-7773) YARN Federation used Mysql as state store throw exception, Unknown column 'homeSubCluster' in 'field list'

2018-01-30 Thread tartarus (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346236#comment-16346236 ] tartarus commented on YARN-7773: Good job! Very helpful to me!!! Thanks > YARN Federation

[jira] [Commented] (YARN-7773) YARN Federation used Mysql as state store throw exception, Unknown column 'homeSubCluster' in 'field list'

2018-01-30 Thread Yiran Wu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346234#comment-16346234 ] Yiran Wu commented on YARN-7773: Cc [~Naganarasimha], [~sunilg], [~bibinchundatt], [~leftno

[jira] [Commented] (YARN-7773) YARN Federation used Mysql as state store throw exception, Unknown column 'homeSubCluster' in 'field list'

2018-01-30 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346230#comment-16346230 ] maobaolong commented on YARN-7773: -- Great job! Seems good! > YARN Federation used Mysql a

[jira] [Commented] (YARN-7778) Merging of constraints defined at different levels

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346225#comment-16346225 ] genericqa commented on YARN-7778: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7816) YARN Service - Two different users are unable to launch a service of the same name

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346217#comment-16346217 ] genericqa commented on YARN-7816: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-7858) Support special Node Attribute scopes in addition to NODE and RACK

2018-01-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346205#comment-16346205 ] Arun Suresh commented on YARN-7858: --- Sure, feel free to take over. Yup, we would need YAR

[jira] [Commented] (YARN-7859) New further: add queue scheduling deadLine in fairScheduler.

2018-01-30 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346184#comment-16346184 ] wangwj commented on YARN-7859: -- [~ka...@cloudera.com] [~yufeigu] Please give me some

[jira] [Updated] (YARN-7859) New further: add queue scheduling deadLine in fairScheduler.

2018-01-30 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwj updated YARN-7859: - Attachment: YARN-7859-v1.patch > New further: add queue scheduling deadLine in fairScheduler. > ---

[jira] [Updated] (YARN-7859) New further: add queue scheduling deadLine in fairScheduler.

2018-01-30 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwj updated YARN-7859: - Attachment: (was: YARN-.patch) > New further: add queue scheduling deadLine in fairScheduler. > ---

[jira] [Created] (YARN-7859) New further: add queue scheduling deadLine in fairScheduler.

2018-01-30 Thread wangwj (JIRA)
wangwj created YARN-7859: Summary: New further: add queue scheduling deadLine in fairScheduler. Key: YARN-7859 URL: https://issues.apache.org/jira/browse/YARN-7859 Project: Hadoop YARN Issue Type: N

[jira] [Resolved] (YARN-7843) Container Localizer is failing with NPE

2018-01-30 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S resolved YARN-7843. - Resolution: Invalid Target Version/s: (was: 3.1.0) I am closing this issue as i

[jira] [Comment Edited] (YARN-7516) Security check for trusted docker image

2018-01-30 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346144#comment-16346144 ] Shane Kumpf edited comment on YARN-7516 at 1/31/18 2:22 AM: Tha

[jira] [Commented] (YARN-7516) Security check for trusted docker image

2018-01-30 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346144#comment-16346144 ] Shane Kumpf commented on YARN-7516: --- Thanks for the quick response and feedback, Eric. At

[jira] [Commented] (YARN-7816) YARN Service - Two different users are unable to launch a service of the same name

2018-01-30 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346138#comment-16346138 ] Gour Saha commented on YARN-7816: - Thanks [~eyang] for reviewing the patch. I have made the

[jira] [Updated] (YARN-7816) YARN Service - Two different users are unable to launch a service of the same name

2018-01-30 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-7816: Attachment: YARN-7816.003.patch > YARN Service - Two different users are unable to launch a service of the sa

[jira] [Updated] (YARN-7778) Merging of constraints defined at different levels

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7778: -- Attachment: YARN-7778-YARN-7812.001.patch > Merging of constraints defined at different levels >

[jira] [Updated] (YARN-7778) Merging of constraints defined at different levels

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7778: -- Attachment: (was: YARN-7778-YARN-7812.001.patch) > Merging of constraints defined at different levels

[jira] [Updated] (YARN-7778) Merging of constraints defined at different levels

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7778: -- Attachment: YARN-7778-YARN-7812.001.patch > Merging of constraints defined at different levels >

[jira] [Updated] (YARN-7811) Service AM should use configured default docker network

2018-01-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7811: Affects Version/s: 3.1.0 Target Version/s: 3.1.0 Fix Version/s: 3.1.0 Component/s: yarn

[jira] [Commented] (YARN-7516) Security check for trusted docker image

2018-01-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346116#comment-16346116 ] Eric Yang commented on YARN-7516: - [~shaneku...@gmail.com] Thank you for the review. When

[jira] [Commented] (YARN-7816) YARN Service - Two different users are unable to launch a service of the same name

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346087#comment-16346087 ] genericqa commented on YARN-7816: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7757: -- Priority: Blocker (was: Critical) > Refactor NodeLabelsProvider to be more generic and reusable for node

[jira] [Updated] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7757: -- Priority: Critical (was: Major) > Refactor NodeLabelsProvider to be more generic and reusable for node

[jira] [Comment Edited] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346083#comment-16346083 ] Weiwei Yang edited comment on YARN-7757 at 1/31/18 1:07 AM: Hi

[jira] [Commented] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346083#comment-16346083 ] Weiwei Yang commented on YARN-7757: --- Hi [~sunilg] Thanks for your comments, bq. we cant

[jira] [Commented] (YARN-7819) Allow PlacementProcessor to be used with the FairScheduler

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346062#comment-16346062 ] genericqa commented on YARN-7819: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346053#comment-16346053 ] genericqa commented on YARN-2185: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-7792) Merge work for YARN-6592

2018-01-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346052#comment-16346052 ] Arun Suresh commented on YARN-7792: --- {{TestRMWebServiceAppsNodelabel}} failure is unrelat

[jira] [Commented] (YARN-7516) Security check for trusted docker image

2018-01-30 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346045#comment-16346045 ] Shane Kumpf commented on YARN-7516: --- Hey Eric, thanks for the patches! I'm sorry to jump

[jira] [Commented] (YARN-7816) YARN Service - Two different users are unable to launch a service of the same name

2018-01-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346031#comment-16346031 ] Eric Yang commented on YARN-7816: - ServiceClient is performed in doAs call, using System.ge

[jira] [Commented] (YARN-7792) Merge work for YARN-6592

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345989#comment-16345989 ] genericqa commented on YARN-7792: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7840) Update PB for prefix support of node attributes

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346002#comment-16346002 ] Weiwei Yang commented on YARN-7840: --- Hi [~Naganarasimha] Can you please take a look at [

[jira] [Updated] (YARN-7816) YARN Service - Two different users are unable to launch a service of the same name

2018-01-30 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-7816: Attachment: YARN-7816.002.patch > YARN Service - Two different users are unable to launch a service of the sa

[jira] [Reopened] (YARN-7265) Hadoop Server Log Correlation

2018-01-30 Thread Tanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanping Wang reopened YARN-7265: [~eyang]  We are not looking into Chukwa at the moment.  There is some conversation regarding to explore

[jira] [Commented] (YARN-7827) Stop and Delete Yarn Service from RM UI fails with HTTP ERROR 404

2018-01-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345973#comment-16345973 ] Eric Yang commented on YARN-7827: - User.name shouldn't be hard code to dr.who.  The end use

[jira] [Commented] (YARN-7858) Support special Node Attribute scopes in addition to NODE and RACK

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345967#comment-16345967 ] Weiwei Yang commented on YARN-7858: --- Hi [~asuresh], thanks for filing this. I've been wor

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-30 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345961#comment-16345961 ] Miklos Szegedi commented on YARN-2185: -- ~[~rohithsharma] I am sorry about the inconven

[jira] [Updated] (YARN-7765) [Atsv2] GSSException: No valid credentials provided - Failed to find any Kerberos tgt thrown by Timelinev2Client & HBaseClient in NM

2018-01-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7765: -- Reporter: Sumana Sathish (was: Rohith Sharma K S) > [Atsv2] GSSException: No valid credentials provided - Failed

[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2018-01-30 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-2185: - Attachment: YARN-2185.014.patch > Use pipes when localizing archives >

[jira] [Created] (YARN-7858) Support special Node Attribute scopes in addition to NODE and RACK

2018-01-30 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7858: - Summary: Support special Node Attribute scopes in addition to NODE and RACK Key: YARN-7858 URL: https://issues.apache.org/jira/browse/YARN-7858 Project: Hadoop YARN

[jira] [Updated] (YARN-7856) Validation and error handling when handling NM-RM with regarding to node-attributes

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7856: -- Description: When NM reports its distributed attributes to RM, RM needs to do proper validation of the re

[jira] [Commented] (YARN-7822) Constraint satisfaction checker support for composite OR and AND constraints

2018-01-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345944#comment-16345944 ] Weiwei Yang commented on YARN-7822: --- Thanks [~asuresh], that sounds nice to me. > Constr

[jira] [Updated] (YARN-7819) Allow PlacementProcessor to be used with the FairScheduler

2018-01-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7819: -- Attachment: YARN-7819-YARN-7812.001.patch > Allow PlacementProcessor to be used with the FairScheduler >

[jira] [Updated] (YARN-7819) Allow PlacementProcessor to be used with the FairScheduler

2018-01-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7819: -- Attachment: (was: YARN-7819-YARN-7812.001.patch) > Allow PlacementProcessor to be used with the FairS

[jira] [Updated] (YARN-7819) Allow PlacementProcessor to be used with the FairScheduler

2018-01-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7819: -- Attachment: YARN-7819-YARN-7812.001.patch > Allow PlacementProcessor to be used with the FairScheduler >

[jira] [Commented] (YARN-7739) DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation

2018-01-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345920#comment-16345920 ] Daniel Templeton commented on YARN-7739: It would be nice to have the test not hard

[jira] [Commented] (YARN-7292) Revisit Resource Profile Behavior

2018-01-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345918#comment-16345918 ] Daniel Templeton commented on YARN-7292: I these are still relevant questions and s

[jira] [Resolved] (YARN-7852) FlowRunReader constructs min_start_time filter for both createdtimestart and createdtimeend.

2018-01-30 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-7852. -- Resolution: Invalid > FlowRunReader constructs min_start_time filter for both createdtimestart and > cre

[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2018-01-30 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-2185: - Attachment: YARN-2185.013.patch > Use pipes when localizing archives >

[jira] [Commented] (YARN-7844) Expose metrics for scheduler operation (allocate, schedulerEvent) to JMX

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345819#comment-16345819 ] genericqa commented on YARN-7844: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7816) YARN Service - Two different users are unable to launch a service of the same name

2018-01-30 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345807#comment-16345807 ] genericqa commented on YARN-7816: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Issue Comment Deleted] (YARN-7857) -fstack-check compilation flag causes binary incompatibility for container-executor between RHEL 6 and RHEL 7

2018-01-30 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-7857: -- Comment: was deleted (was: The SIGSEGV reported in this Jira is a result of compiling with  {{-fstack-che

[jira] [Issue Comment Deleted] (YARN-7857) -fstack-check compilation flag causes binary incompatibility for container-executor between RHEL 6 and RHEL 7

2018-01-30 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-7857: -- Comment: was deleted (was: The {{-fcheck-stack}} flag was introduced by this Jira.) > -fstack-check comp

[jira] [Commented] (YARN-7857) -fstack-check compilation flag causes binary incompatibility for container-executor between RHEL 6 and RHEL 7

2018-01-30 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345776#comment-16345776 ] Jim Brennan commented on YARN-7857: --- The SIGSEGV reported in this Jira is a result of com

[jira] [Commented] (YARN-7857) -fstack-check compilation flag causes binary incompatibility for container-executor between RHEL 6 and RHEL 7

2018-01-30 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345771#comment-16345771 ] Jim Brennan commented on YARN-7857: --- The {{-fcheck-stack}} flag was introduced by this Ji

[jira] [Comment Edited] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-01-30 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345671#comment-16345671 ] Zian Chen edited comment on YARN-7626 at 1/30/18 7:44 PM: -- Hi [~mi

[jira] [Commented] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-01-30 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345671#comment-16345671 ] Zian Chen commented on YARN-7626: - Hi [~miklos.szeg...@cloudera.com]  , thank you so much f

[jira] [Comment Edited] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-01-30 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345671#comment-16345671 ] Zian Chen edited comment on YARN-7626 at 1/30/18 7:43 PM: -- Hi [~mi

[jira] [Commented] (YARN-7844) Expose metrics for scheduler operation (allocate, schedulerEvent) to JMX

2018-01-30 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345657#comment-16345657 ] Wei Yan commented on YARN-7844: --- Put a new diff 001.patch to fix some checkstyles and findbug

[jira] [Updated] (YARN-7844) Expose metrics for scheduler operation (allocate, schedulerEvent) to JMX

2018-01-30 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-7844: -- Attachment: YARN-7844.001.patch > Expose metrics for scheduler operation (allocate, schedulerEvent) to JMX >

[jira] [Commented] (YARN-7677) HADOOP_CONF_DIR should not be automatically put in task environment

2018-01-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345645#comment-16345645 ] Jason Lowe commented on YARN-7677: -- Thanks for the patch! +1 lgtm. I will commit this to

[jira] [Updated] (YARN-7794) SLSRunner is not loading timeline service jars causing failure

2018-01-30 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7794: --- Priority: Blocker (was: Major) > SLSRunner is not loading timeline service jars causing failure >

[jira] [Updated] (YARN-7816) YARN Service - Two different users are unable to launch a service of the same name

2018-01-30 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-7816: Description: Now that YARN-7605 is committed, I am able to create a service in an unsecured cluster from cmd

[jira] [Updated] (YARN-7816) YARN Service - Two different users are unable to launch a service of the same name

2018-01-30 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-7816: Attachment: YARN-7816.001.patch > YARN Service - Two different users are unable to launch a service of the sa

[jira] [Commented] (YARN-7780) Documentation for Placement Constraints

2018-01-30 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345599#comment-16345599 ] Konstantinos Karanasos commented on YARN-7780: -- Thanks [~asuresh], [~cheersyan

[jira] [Commented] (YARN-7843) Container Localizer is failing with NPE

2018-01-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345571#comment-16345571 ] Jason Lowe commented on YARN-7843: -- The NoSuchMethodError implies some code is running wit

  1   2   >