[jira] [Updated] (YARN-5576) Core change to localize resource while container is running

2016-09-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5576: -- Attachment: YARN-5576.3.patch > Core change to localize resource while container is running >

[jira] [Commented] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2016-08-31 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15454389#comment-15454389 ] Jian He commented on YARN-5554: --- For the permission part: should we check (submit_acl_on_target_queue ||

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-08-31 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15454199#comment-15454199 ] Jian He commented on YARN-3854: --- Thanks [~tangzhankun], question on this: bq. leave a hint file in

[jira] [Commented] (YARN-5601) Make the RM epoch base value configurable

2016-08-31 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15454177#comment-15454177 ] Jian He commented on YARN-5601: --- sounds good, can you suppress the findbugs warning ? > Make the RM epoch

[jira] [Commented] (YARN-5601) Make the RM epoch base value configurable

2016-08-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451110#comment-15451110 ] Jian He commented on YARN-5601: --- [~subru], could you please explain what the typical practice is to set this

[jira] [Updated] (YARN-5576) Core change to localize resource while container is running

2016-08-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5576: -- Attachment: YARN-5576.2.patch Upload a new path that fixed the comments > Core change to localize resource

[jira] [Comment Edited] (YARN-5576) Core change to localize resource while container is running

2016-08-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449258#comment-15449258 ] Jian He edited comment on YARN-5576 at 8/30/16 3:05 PM: Thanks for the review,

[jira] [Commented] (YARN-5576) Core change to localize resource while container is running

2016-08-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449258#comment-15449258 ] Jian He commented on YARN-5576: --- Thanks for the review, Varun bq. Can we move this logic into the

[jira] [Commented] (YARN-4793) [Umbrella] Simplified API layer for services and beyond

2016-08-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15448934#comment-15448934 ] Jian He commented on YARN-4793: --- Thanks Gour ! some comments I have on the patch: *API Models* - {artifact,

[jira] [Commented] (YARN-3671) Integrate Federation services with ResourceManager

2016-08-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447986#comment-15447986 ] Jian He commented on YARN-3671: --- Looks good, Committed to YARN-2915. Thanks Subru ! > Integrate Federation

[jira] [Commented] (YARN-5576) Core change to localize resource while container is running

2016-08-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15444892#comment-15444892 ] Jian He commented on YARN-5576: --- - The patch adds the functionality to localize resource while the container

[jira] [Updated] (YARN-5576) Core change to localize resource while container is running

2016-08-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5576: -- Attachment: YARN-5576.1.patch > Core change to localize resource while container is running >

[jira] [Created] (YARN-5576) Core change to localize resource while container is running

2016-08-28 Thread Jian He (JIRA)
Jian He created YARN-5576: - Summary: Core change to localize resource while container is running Key: YARN-5576 URL: https://issues.apache.org/jira/browse/YARN-5576 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-3671) Integrate Federation services with ResourceManager

2016-08-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15444529#comment-15444529 ] Jian He commented on YARN-3671: --- Thanks Subru for updating ! - Here, the scheduler is passed in via

[jira] [Commented] (YARN-5557) Add localize API to the ContainerManagementProtocol

2016-08-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439275#comment-15439275 ] Jian He commented on YARN-5557: --- I'd like to do it in trunk as I only need one more patch to get the core

[jira] [Commented] (YARN-3671) Integrate Federation services with ResourceManager

2016-08-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15438463#comment-15438463 ] Jian He commented on YARN-3671: --- bq. RM_CLUSTER_ID is currently used for HA but Federation can work both with

[jira] [Commented] (YARN-1503) Support making additional 'LocalResources' available to running containers

2016-08-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15438392#comment-15438392 ] Jian He commented on YARN-1503: --- It is differentiated. To clarify, here, I'm referring to the re-localization

[jira] [Commented] (YARN-5557) Add localize API to the ContainerManagementProtocol

2016-08-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15438379#comment-15438379 ] Jian He commented on YARN-5557: --- bq. I think a resource string should be unique within the same NM here. yes,

[jira] [Issue Comment Deleted] (YARN-5557) Add localize API to the ContainerManagementProtocol

2016-08-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5557: -- Comment: was deleted (was: bq. I think a resource string should be unique within the same NM here. yes, it is

[jira] [Commented] (YARN-5557) Add localize API to the ContainerManagementProtocol

2016-08-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15438380#comment-15438380 ] Jian He commented on YARN-5557: --- bq. I think a resource string should be unique within the same NM here. yes,

[jira] [Updated] (YARN-5557) Add localize API to the ContainerManagementProtocol

2016-08-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5557: -- Attachment: YARN-5557.4.patch Latest patch removed one unused import > Add localize API to the

[jira] [Commented] (YARN-5557) Add localize API to the ContainerManagementProtocol

2016-08-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436923#comment-15436923 ] Jian He commented on YARN-5557: --- I've fixed the ones that are obvious, the rest should be fine. > Add

[jira] [Commented] (YARN-3671) Integrate Federation services with ResourceManager

2016-08-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436536#comment-15436536 ] Jian He commented on YARN-3671: --- - we already have RM_CLUSTER_ID, any chance that this can be used for

[jira] [Updated] (YARN-5557) Add localize API to the ContainerManagementProtocol

2016-08-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5557: -- Attachment: YARN-5557.3.patch for the checkstyles, fixed the ones that make sense > Add localize API to the

[jira] [Commented] (YARN-1503) Support making additional 'LocalResources' available to running containers

2016-08-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436378#comment-15436378 ] Jian He commented on YARN-1503: --- Thanks for the feedback, Arun, Varun, Junping. bq. I was wondering how this

[jira] [Updated] (YARN-5557) Add localize API to the ContainerManagementProtocol

2016-08-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5557: -- Attachment: YARN-5557.2.patch > Add localize API to the ContainerManagementProtocol >

[jira] [Commented] (YARN-5557) Add localize API to the ContainerManagementProtocol

2016-08-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436300#comment-15436300 ] Jian He commented on YARN-5557: --- Junping, thanks for the review. bq. If so, ResourceLocalizationResponse may

[jira] [Commented] (YARN-5559) Analyse 2.8.0/3.0.0 jdiff reports and fix any issues

2016-08-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436243#comment-15436243 ] Jian He commented on YARN-5559: --- - Do we need the change in GetClusterNodeLabelsResponse ? it’s evolving. it

[jira] [Updated] (YARN-5430) Return container's ip and host from NM ContainerStatus call

2016-08-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: (was: YARN-5430.9.patch) > Return container's ip and host from NM ContainerStatus call >

[jira] [Updated] (YARN-5430) Return container's ip and host from NM ContainerStatus call

2016-08-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.9.patch > Return container's ip and host from NM ContainerStatus call >

[jira] [Commented] (YARN-5430) Return container's ip and host from NM ContainerStatus call

2016-08-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434567#comment-15434567 ] Jian He commented on YARN-5430: --- Thanks Billie, I've fixed the issues in the latest patch. > Return

[jira] [Updated] (YARN-5430) Return container's ip and host from NM ContainerStatus call

2016-08-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.9.branch-2.patch > Return container's ip and host from NM ContainerStatus call >

[jira] [Updated] (YARN-5430) Return container's ip and host from NM ContainerStatus call

2016-08-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.9.patch > Return container's ip and host from NM ContainerStatus call >

[jira] [Updated] (YARN-5557) Add localize API to the ContainerManagementProtocol

2016-08-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5557: -- Attachment: YARN-5557.1.patch patch uploaded > Add localize API to the ContainerManagementProtocol >

[jira] [Created] (YARN-5557) Add localize API to the ContainerManagementProtocol

2016-08-24 Thread Jian He (JIRA)
Jian He created YARN-5557: - Summary: Add localize API to the ContainerManagementProtocol Key: YARN-5557 URL: https://issues.apache.org/jira/browse/YARN-5557 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-1503) Continuous resource-localization for YARN containers

2016-08-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434227#comment-15434227 ] Jian He commented on YARN-1503: --- Jason, Karthik, thanks for the comments ! bq. Omit the localization info for

[jira] [Updated] (YARN-1503) Continuous resource-localization for YARN containers

2016-08-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1503: -- Description: We have a use case, where additional resources (jars, libraries etc) need to be made available to

[jira] [Commented] (YARN-1503) Support making additional 'LocalResources' available to running containers

2016-08-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432722#comment-15432722 ] Jian He commented on YARN-1503: --- I uploaded a design doc for this and update the title / description

[jira] [Updated] (YARN-1503) Support making additional 'LocalResources' available to running containers

2016-08-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1503: -- Attachment: Continuous-resource-localization.pdf > Support making additional 'LocalResources' available to

[jira] [Updated] (YARN-1503) Continuous resource-localization for YARN containers

2016-08-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1503: -- Summary: Continuous resource-localization for YARN containers (was: Support making additional 'LocalResources'

[jira] [Resolved] (YARN-5532) Continuous resource-localization for YARN containers

2016-08-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-5532. --- Resolution: Duplicate > Continuous resource-localization for YARN containers >

[jira] [Assigned] (YARN-1503) Support making additional 'LocalResources' available to running containers

2016-08-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-1503: - Assignee: Jian He > Support making additional 'LocalResources' available to running containers >

[jira] [Commented] (YARN-5532) Continuous resource-localization for YARN containers

2016-08-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432630#comment-15432630 ] Jian He commented on YARN-5532: --- Yep, didn't know that was open, closed as a dup > Continuous

[jira] [Commented] (YARN-5505) Create an agent-less docker provider

2016-08-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432620#comment-15432620 ] Jian He commented on YARN-5505: --- Thanks Billie, some comments on the patch - DockerProviderService#

[jira] [Commented] (YARN-3673) Create a FailoverProxy for Federation services

2016-08-18 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427536#comment-15427536 ] Jian He commented on YARN-3673: --- - If FederationRMFailoverProxyProvider is used for standalone RM, we only

[jira] [Commented] (YARN-3673) Create a FailoverProxy for Federation services

2016-08-18 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425967#comment-15425967 ] Jian He commented on YARN-3673: --- Test: IIUC, I don't actually see FederationRMFailoverProxyProvider

[jira] [Commented] (YARN-3673) Create a FailoverProxy for Federation services

2016-08-18 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425963#comment-15425963 ] Jian He commented on YARN-3673: --- - I think for this patch the FEDERATION_FAILOVER_ENABLED and

[jira] [Updated] (YARN-5430) Return container's ip and host from NM ContainerStatus call

2016-08-17 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430-branch-2.patch uploaded branch-2 patch > Return container's ip and host from NM

[jira] [Updated] (YARN-5532) Continuous resource-localization for YARN containers

2016-08-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5532: -- Issue Type: New Feature (was: Bug) > Continuous resource-localization for YARN containers >

[jira] [Created] (YARN-5532) Continuous resource-localization for YARN containers

2016-08-16 Thread Jian He (JIRA)
Jian He created YARN-5532: - Summary: Continuous resource-localization for YARN containers Key: YARN-5532 URL: https://issues.apache.org/jira/browse/YARN-5532 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-5461) Port initial slider-core module code into yarn

2016-08-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5461: -- Fix Version/s: yarn-native-services > Port initial slider-core module code into yarn >

[jira] [Resolved] (YARN-5461) Port initial slider-core module code into yarn

2016-08-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-5461. --- Resolution: Fixed Initial slider-code is ported > Port initial slider-core module code into yarn >

[jira] [Commented] (YARN-5513) Move Java only tests from slider develop to yarn-native-services

2016-08-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15422973#comment-15422973 ] Jian He commented on YARN-5513: --- looks good, committing > Move Java only tests from slider develop to

[jira] [Commented] (YARN-3672) Create Facade for Federation State and Policy Store

2016-08-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420589#comment-15420589 ] Jian He commented on YARN-3672: --- - How will the RM failover play together with YARN-3673 ? Let’s say

[jira] [Commented] (YARN-5430) Get container's ip and host from NM

2016-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416566#comment-15416566 ] Jian He commented on YARN-5430: --- The remaining warnings are not related to this patch. > Get container's ip

[jira] [Commented] (YARN-4833) For Queue AccessControlException client retries multiple times on both RM

2016-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416492#comment-15416492 ] Jian He commented on YARN-4833: --- lgtm too, thanks > For Queue AccessControlException client retries multiple

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.8.patch Fixing checkstyles > Get container's ip and host from NM >

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.7.patch > Get container's ip and host from NM > --- > >

[jira] [Commented] (YARN-5430) Get container's ip and host from NM

2016-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414808#comment-15414808 ] Jian He commented on YARN-5430: --- Varun, thanks for the review. I uploaded a new one. > Get container's ip

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.6.patch > Get container's ip and host from NM > --- > >

[jira] [Commented] (YARN-5483) Optimize RMAppAttempt#pullJustFinishedContainers

2016-08-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413113#comment-15413113 ] Jian He commented on YARN-5483: --- thanks for the catch ! A minor typo in the existing code,

[jira] [Commented] (YARN-5407) In-memory based implementation of the FederationApplicationStateStore, FederationPolicyStateStore

2016-08-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413102#comment-15413102 ] Jian He commented on YARN-5407: --- lgtm > In-memory based implementation of the

[jira] [Commented] (YARN-5382) RM does not audit log kill request for active applications

2016-08-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412869#comment-15412869 ] Jian He commented on YARN-5382: --- ah, I missed it.. thanks for catching this ! > RM does not audit log kill

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.5.patch > Get container's ip and host from NM > --- > >

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: (was: YARN-5430.4.patch) > Get container's ip and host from NM >

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.4.patch > Get container's ip and host from NM > --- > >

[jira] [Commented] (YARN-5382) RM does not audit log kill request for active applications

2016-08-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15411191#comment-15411191 ] Jian He commented on YARN-5382: --- lgtm, [~jlowe], would you like to check? > RM does not audit log kill

[jira] [Issue Comment Deleted] (YARN-5333) Some recovered apps are put into default queue when RM HA

2016-08-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5333: -- Comment: was deleted (was: Im fine with that, thx) > Some recovered apps are put into default queue when RM HA

[jira] [Commented] (YARN-5333) Some recovered apps are put into default queue when RM HA

2016-08-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15409576#comment-15409576 ] Jian He commented on YARN-5333: --- Im fine with that, thx > Some recovered apps are put into default queue

[jira] [Commented] (YARN-5333) Some recovered apps are put into default queue when RM HA

2016-08-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15409577#comment-15409577 ] Jian He commented on YARN-5333: --- Im fine with that, thx > Some recovered apps are put into default queue

[jira] [Commented] (YARN-5382) RM does not audit log kill request for active applications

2016-08-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15409011#comment-15409011 ] Jian He commented on YARN-5382: --- [~vrushalic], looks like you reformatted the whole RMAppImpl java file, and

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.4.patch > Get container's ip and host from NM > --- > >

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: (was: YARN-5430.4.patch) > Get container's ip and host from NM >

[jira] [Commented] (YARN-5430) Get container's ip and host from NM

2016-08-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15408799#comment-15408799 ] Jian He commented on YARN-5430: --- Thanks for the review, Varun ! fixed other comments, uploaded a new patch >

[jira] [Commented] (YARN-5430) Get container's ip and host from NM

2016-08-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15408798#comment-15408798 ] Jian He commented on YARN-5430: --- bq. Similarly we should change getIpAndHost and split them up into getIps

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.4.patch > Get container's ip and host from NM > --- > >

[jira] [Commented] (YARN-5333) Some recovered apps are put into default queue when RM HA

2016-08-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407363#comment-15407363 ] Jian He commented on YARN-5333: --- I see, I think this makes sense. Otherwise, RM will continuously retry.

[jira] [Commented] (YARN-5079) [Umbrella] Native YARN framework layer for services and beyond

2016-08-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15407057#comment-15407057 ] Jian He commented on YARN-5079: --- Hi [~asuresh], Short answer is, agent in Slider will be thrown away once

[jira] [Commented] (YARN-5333) Some recovered apps are put into default queue when RM HA

2016-08-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405539#comment-15405539 ] Jian He commented on YARN-5333: --- bq. then call rm.handleTransitionToStandBy. I think the ActiveStandbyElector

[jira] [Commented] (YARN-5333) Some recovered apps are put into default queue when RM HA

2016-08-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405478#comment-15405478 ] Jian He commented on YARN-5333: --- Not related to this patch, I noticed that, if anything fails in the refresh

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.3.patch > Get container's ip and host from NM > --- > >

[jira] [Commented] (YARN-5382) RM does not audit log kill request for active applications

2016-08-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405321#comment-15405321 ] Jian He commented on YARN-5382: --- bq. I see only one audit log message when I ran a sleep job and killed it on

[jira] [Created] (YARN-5461) Port initial slider-core module code into yarn

2016-08-02 Thread Jian He (JIRA)
Jian He created YARN-5461: - Summary: Port initial slider-core module code into yarn Key: YARN-5461 URL: https://issues.apache.org/jira/browse/YARN-5461 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.2.patch > Get container's ip and host from NM > --- > >

[jira] [Commented] (YARN-5406) In-memory based implementation of the FederationMembershipStateStore

2016-08-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15403480#comment-15403480 ] Jian He commented on YARN-5406: --- Also, should the .impl package be under the .store package ? > In-memory

[jira] [Commented] (YARN-5406) In-memory based implementation of the FederationMembershipStateStore

2016-08-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15403473#comment-15403473 ] Jian He commented on YARN-5406: --- lgtm, not related to this patch. I think mentioning the default value in

[jira] [Commented] (YARN-5333) Some recovered apps are put into default queue when RM HA

2016-08-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15403439#comment-15403439 ] Jian He commented on YARN-5333: --- Instead of reusing the existing refreshAll method, I checked each refresh

[jira] [Commented] (YARN-5382) RM does not audit log kill request for active applications

2016-08-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15403414#comment-15403414 ] Jian He commented on YARN-5382: --- With this patch, looks like killing a normal running app will cause RM audit

[jira] [Commented] (YARN-5443) Add support for docker inspect

2016-07-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399008#comment-15399008 ] Jian He commented on YARN-5443: --- [~shaneku...@gmail.com], I think container-executor.c#run_docker also needs

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-07-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.1.patch > Get container's ip and host from NM > --- > >

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-07-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: (was: YARN-5430.1.patch) > Get container's ip and host from NM >

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-07-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: (was: YARN-5430.2.patch) > Get container's ip and host from NM >

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-07-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.2.patch > Get container's ip and host from NM > --- > >

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-07-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.1.patch What the patch does: - For docker container: container-executable runs the docker

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-07-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Description: In YARN-4757, we introduced a DNS mechanism for containers. That's based on the assumption that we

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-07-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Summary: Get container's ip and host from NM (was: Get docker container's ip and host from NM) > Get

[jira] [Created] (YARN-5430) Get docker container's ip and host from NM

2016-07-26 Thread Jian He (JIRA)
Jian He created YARN-5430: - Summary: Get docker container's ip and host from NM Key: YARN-5430 URL: https://issues.apache.org/jira/browse/YARN-5430 Project: Hadoop YARN Issue Type: Bug

[jira] [Assigned] (YARN-5430) Get docker container's ip and host from NM

2016-07-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-5430: - Assignee: Jian He > Get docker container's ip and host from NM >

[jira] [Commented] (YARN-5333) Some recovered apps are put into default queue when RM HA

2016-07-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393292#comment-15393292 ] Jian He commented on YARN-5333: --- I prefer doing initialization of services before starting it. Then we don't

[jira] [Updated] (YARN-5426) Enable distributed shell to launch docker containers

2016-07-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5426: -- Description: This could be the easiest way to bring up docker containers on YARN. It's also very useful for

<    8   9   10   11   12   13   14   15   16   17   >