[jira] [Updated] (YARN-8122) Component health threshold monitor

[ https://issues.apache.org/jira/browse/YARN-8122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8122: Attachment: YARN-8122.test.log > Component health threshold monitor > -- > >

[jira] [Commented] (YARN-8178) [Umbrella] Resource Over-commitment Based on Opportunistic Container Preemption

[ https://issues.apache.org/jira/browse/YARN-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16450422#comment-16450422 ] Zian Chen commented on YARN-8178: - eHi Weiwei, thank you so much for your comments. Let me answer those

[jira] [Commented] (YARN-8122) Component health threshold monitor

[ https://issues.apache.org/jira/browse/YARN-8122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16450268#comment-16450268 ] Eric Yang commented on YARN-8122: - Agree with Billie that counting READY state container is better than

[jira] [Updated] (YARN-8122) Component health threshold monitor

[ https://issues.apache.org/jira/browse/YARN-8122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8122: Attachment: YARN-8122.test.json > Component health threshold monitor > -- >

[jira] [Assigned] (YARN-8194) Yarn Service Upgrade: Exception when reinitializing a container using LinuxContainerExecutor

[ https://issues.apache.org/jira/browse/YARN-8194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh reassigned YARN-8194: --- Assignee: Chandni Singh > Yarn Service Upgrade: Exception when reinitializing a container

[jira] [Commented] (YARN-8183) Fix ConcurrentModificationException inside RMAppAttemptMetrics#convertAtomicLongMaptoLongMap

[ https://issues.apache.org/jira/browse/YARN-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451459#comment-16451459 ] Hudson commented on YARN-8183: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #14059 (See

[jira] [Commented] (YARN-8196) yarn.webapp.api-service.enable should be highlighted in the quickstart

[ https://issues.apache.org/jira/browse/YARN-8196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451342#comment-16451342 ] genericqa commented on YARN-8196: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8198) Add Security-Related HTTP Response Header in Yarn WEBUIs.

[ https://issues.apache.org/jira/browse/YARN-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451432#comment-16451432 ] genericqa commented on YARN-8198: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8183) yClient for Kill Application stuck in infinite loop with message "Waiting for Application to be killed"

[ https://issues.apache.org/jira/browse/YARN-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451444#comment-16451444 ] genericqa commented on YARN-8183: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7900) [AMRMProxy] AMRMClientRelayer for stateful FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-7900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451451#comment-16451451 ] genericqa commented on YARN-7900: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8183) Fix ConcurrentModificationException inside RMAppAttemptMetrics#convertAtomicLongMaptoLongMap

[ https://issues.apache.org/jira/browse/YARN-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8183: - Summary: Fix ConcurrentModificationException inside RMAppAttemptMetrics#convertAtomicLongMaptoLongMap

[jira] [Updated] (YARN-8199) Logging fileSize of NM local files

[ https://issues.apache.org/jira/browse/YARN-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-8199: Description: Logging the fileSize of NM local files like log and output files by NodeManager before

[jira] [Updated] (YARN-8199) Logging fileSize of NM local files

[ https://issues.apache.org/jira/browse/YARN-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-8199: Description: Logging the fileSize of NM local files like log and output files by NodeManager before

[jira] [Commented] (YARN-8200) Backport resource types/GPU features to branch-2

[ https://issues.apache.org/jira/browse/YARN-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451384#comment-16451384 ] Konstantin Shvachko commented on YARN-8200: --- What people think if we create a branch so that

[jira] [Created] (YARN-8205) AM launching is delayed, then state is not updated in ATS

Sumana Sathish created YARN-8205: Summary: AM launching is delayed, then state is not updated in ATS Key: YARN-8205 URL: https://issues.apache.org/jira/browse/YARN-8205 Project: Hadoop YARN

[jira] [Updated] (YARN-8199) Loggng fileSize of NM local files

[ https://issues.apache.org/jira/browse/YARN-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-8199: Labels: supportability (was: ) > Loggng fileSize of NM local files >

[jira] [Updated] (YARN-8199) Logging fileSize of NM local files

[ https://issues.apache.org/jira/browse/YARN-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-8199: Summary: Logging fileSize of NM local files (was: Loggng fileSize of NM local files ) > Logging

[jira] [Comment Edited] (YARN-8187) [UI2] clicking on Individual Nodes does not contain breadcums in Nodes Page

[ https://issues.apache.org/jira/browse/YARN-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451341#comment-16451341 ] Zian Chen edited comment on YARN-8187 at 4/24/18 10:30 PM: --- The root cause for

[jira] [Commented] (YARN-7939) Yarn Service Upgrade: add support to upgrade a component instance

[ https://issues.apache.org/jira/browse/YARN-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451518#comment-16451518 ] Chandni Singh commented on YARN-7939: - [~eyang] you are correct. There is existing AM transition logic

[jira] [Commented] (YARN-8183) yClient for Kill Application stuck in infinite loop with message "Waiting for Application to be killed"

[ https://issues.apache.org/jira/browse/YARN-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451339#comment-16451339 ] Wangda Tan commented on YARN-8183: -- Thanks [~suma.shivaprasad], +1, pending Jenkins. > yClient for Kill

[jira] [Commented] (YARN-2674) Distributed shell AM may re-launch containers if RM work preserving restart happens

[ https://issues.apache.org/jira/browse/YARN-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451359#comment-16451359 ] Billie Rinaldi commented on YARN-2674: -- Hey [~shaneku...@gmail.com], thanks for taking up this patch.

[jira] [Commented] (YARN-8200) Backport resource types/GPU features to branch-2

[ https://issues.apache.org/jira/browse/YARN-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451385#comment-16451385 ] Wangda Tan commented on YARN-8200: -- +1 to have a branch for this which we can easier know which patches

[jira] [Updated] (YARN-8196) yarn.webapp.api-service.enable should be highlighted in the quickstart

[ https://issues.apache.org/jira/browse/YARN-8196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8196: Fix Version/s: 3.1.1 > yarn.webapp.api-service.enable should be highlighted in the quickstart >

[jira] [Commented] (YARN-7939) Yarn Service Upgrade: add support to upgrade a component instance

[ https://issues.apache.org/jira/browse/YARN-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451435#comment-16451435 ] Eric Yang commented on YARN-7939: - [~csingh] Thank you for patch 10. It resolved the Invalid event:

[jira] [Comment Edited] (YARN-7939) Yarn Service Upgrade: add support to upgrade a component instance

[ https://issues.apache.org/jira/browse/YARN-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451435#comment-16451435 ] Eric Yang edited comment on YARN-7939 at 4/25/18 12:01 AM: --- [~csingh] Thank you

[jira] [Updated] (YARN-8194) Exception when reinitializing a container using LinuxContainerExecutor

[ https://issues.apache.org/jira/browse/YARN-8194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8194: Summary: Exception when reinitializing a container using LinuxContainerExecutor (was: Yarn Service

[jira] [Updated] (YARN-8187) [UI2] clicking on Individual Nodes does not contain breadcums in Nodes Page

[ https://issues.apache.org/jira/browse/YARN-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8187: Attachment: YARN-8187.002.patch > [UI2] clicking on Individual Nodes does not contain breadcums in Nodes

[jira] [Commented] (YARN-8187) [UI2] clicking on Individual Nodes does not contain breadcums in Nodes Page

[ https://issues.apache.org/jira/browse/YARN-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451341#comment-16451341 ] Zian Chen commented on YARN-8187: - Update the patch v2. > [UI2] clicking on Individual Nodes does not

[jira] [Created] (YARN-8204) Yarn Service Upgrade: Add a flag to disable upgrade

Chandni Singh created YARN-8204: --- Summary: Yarn Service Upgrade: Add a flag to disable upgrade Key: YARN-8204 URL: https://issues.apache.org/jira/browse/YARN-8204 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-8187) [UI2] clicking on Individual Nodes does not contain breadcums in Nodes Page

[ https://issues.apache.org/jira/browse/YARN-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451372#comment-16451372 ] Zian Chen commented on YARN-8187: - The screenshot shows how the UI looks like after the latest patch. >

[jira] [Updated] (YARN-8187) [UI2] clicking on Individual Nodes does not contain breadcums in Nodes Page

[ https://issues.apache.org/jira/browse/YARN-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8187: Attachment: Screen Shot 2018-04-24 at 3.54.11 PM.png > [UI2] clicking on Individual Nodes does not contain

[jira] [Commented] (YARN-8187) [UI2] clicking on Individual Nodes does not contain breadcums in Nodes Page

[ https://issues.apache.org/jira/browse/YARN-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451390#comment-16451390 ] genericqa commented on YARN-8187: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8196) yarn.webapp.api-service.enable should be highlighted in the quickstart

[ https://issues.apache.org/jira/browse/YARN-8196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451406#comment-16451406 ] Hudson commented on YARN-8196: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14058 (See

[jira] [Commented] (YARN-7939) Yarn Service Upgrade: add support to upgrade a component instance

[ https://issues.apache.org/jira/browse/YARN-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451434#comment-16451434 ] genericqa commented on YARN-7939: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8204) Yarn Service Upgrade: Add a flag to disable upgrade

[ https://issues.apache.org/jira/browse/YARN-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8204: Attachment: YARN-8204.001.patch > Yarn Service Upgrade: Add a flag to disable upgrade >

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451531#comment-16451531 ] genericqa commented on YARN-7654: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8198) Add Security-Related HTTP Response Header in Yarn WEBUIs.

[ https://issues.apache.org/jira/browse/YARN-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kanwaljeet Sachdev updated YARN-8198: - Attachment: YARN-8198.003.patch > Add Security-Related HTTP Response Header in Yarn

[jira] [Commented] (YARN-8204) Yarn Service Upgrade: Add a flag to disable upgrade

[ https://issues.apache.org/jira/browse/YARN-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451671#comment-16451671 ] genericqa commented on YARN-8204: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451687#comment-16451687 ] genericqa commented on YARN-7654: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449383#comment-16449383 ] Manikandan R commented on YARN-4606: Thanks [~eepayne] for the patch explaining your suggestions. I

[jira] [Assigned] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R reassigned YARN-4606: -- Assignee: Manikandan R > CapacityScheduler: applications could get starved because computation

[jira] [Commented] (YARN-7939) Yarn Service Upgrade: add support to upgrade a component instance

[ https://issues.apache.org/jira/browse/YARN-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449430#comment-16449430 ] genericqa commented on YARN-7939: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7598) Document how to use classpath isolation for aux-services in YARN

[ https://issues.apache.org/jira/browse/YARN-7598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449445#comment-16449445 ] Junping Du commented on YARN-7598: -- +1. Latest patch LGTM. Committing. > Document how to use classpath

[jira] [Updated] (YARN-8191) Fair scheduler: queue deletion without RM restart

[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-8191: -- Attachment: YARN-8191.002.patch > Fair scheduler: queue deletion without RM restart >

[jira] [Commented] (YARN-8148) Update decimal values for queue capacities shown on queue status cli

[ https://issues.apache.org/jira/browse/YARN-8148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449588#comment-16449588 ] Prabhu Joseph commented on YARN-8148: - [~sunilg] Can you review this when you get some time. > Update

[jira] [Commented] (YARN-7598) Document how to use classpath isolation for aux-services in YARN

[ https://issues.apache.org/jira/browse/YARN-7598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449602#comment-16449602 ] Hudson commented on YARN-7598: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #14055 (See

[jira] [Updated] (YARN-8191) Fair scheduler: queue deletion without RM restart

[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-8191: -- Attachment: (was: YARN-8191.002.patch) > Fair scheduler: queue deletion without RM restart >

[jira] [Updated] (YARN-8191) Fair scheduler: queue deletion without RM restart

[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-8191: -- Attachment: YARN-8191.002.patch > Fair scheduler: queue deletion without RM restart >

[jira] [Commented] (YARN-8174) Add containerId to ResourceLocalizationService fetch failure

[ https://issues.apache.org/jira/browse/YARN-8174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449589#comment-16449589 ] Prabhu Joseph commented on YARN-8174: - [~bibinchundatt] Can you review this when you get some time. >

[jira] [Commented] (YARN-2674) Distributed shell AM may re-launch containers if RM work preserving restart happens

[ https://issues.apache.org/jira/browse/YARN-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449773#comment-16449773 ] Shane Kumpf commented on YARN-2674: --- I've spent some time looking into what issues are already opened for

[jira] [Comment Edited] (YARN-2674) Distributed shell AM may re-launch containers if RM work preserving restart happens

[ https://issues.apache.org/jira/browse/YARN-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449773#comment-16449773 ] Shane Kumpf edited comment on YARN-2674 at 4/24/18 12:47 PM: - I've spent some

[jira] [Commented] (YARN-8178) [Umbrella] Resource Over-commitment Based on Opportunistic Container Preemption

[ https://issues.apache.org/jira/browse/YARN-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449842#comment-16449842 ] Weiwei Yang commented on YARN-8178: --- Hi [~Zian Chen] This is a very interesting idea. The design doc

[jira] [Commented] (YARN-8191) Fair scheduler: queue deletion without RM restart

[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449872#comment-16449872 ] genericqa commented on YARN-8191: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7892) Revisit NodeAttribute class structure

[ https://issues.apache.org/jira/browse/YARN-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449901#comment-16449901 ] Bibin A Chundatt commented on YARN-7892: [~Naganarasimha] # NodeAttributeManager

[jira] [Updated] (YARN-8201) Skip stacktrace of ApplicationNotFoundException at server side

[ https://issues.apache.org/jira/browse/YARN-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8201: --- Priority: Minor (was: Major) Description: Currently full stack trace of exception like

[jira] [Created] (YARN-8201) Suppress stack trace of exception from ClientRMService

Bibin A Chundatt created YARN-8201: -- Summary: Suppress stack trace of exception from ClientRMService Key: YARN-8201 URL: https://issues.apache.org/jira/browse/YARN-8201 Project: Hadoop YARN

[jira] [Updated] (YARN-7654) Support ENTRY_POINT for docker container

[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7654: Attachment: YARN-7654.017.patch > Support ENTRY_POINT for docker container >

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16450105#comment-16450105 ] Eric Yang commented on YARN-7654: - Patch 17 fixed checkstyle and unused variable issue. > Support

[jira] [Commented] (YARN-8122) Component health threshold monitor

[ https://issues.apache.org/jira/browse/YARN-8122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16450113#comment-16450113 ] Billie Rinaldi commented on YARN-8122: -- I think it would be a better health check to count the number

[jira] [Created] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

Szilard Nemeth created YARN-8202: Summary: DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation Key: YARN-8202 URL:

[jira] [Updated] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8202: - Description:   When I execute a pi job with arguments:  *-Dmapreduce.map.resource.memory-mb=200

[jira] [Commented] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16450126#comment-16450126 ] Szilard Nemeth commented on YARN-8202: -- YARN-7739 fixed the missing check for custom resource types

[jira] [Updated] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8202: - Description:   When I execute a pi job with arguments:  {code:java}

<    1   2