[jira] [Commented] (YARN-8040) [UI2] yarn new ui web-app does not respect current pathname for REST api

2018-03-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16403261#comment-16403261 ] Wangda Tan commented on YARN-8040: -- +1, thanks [~sunilg]. > [UI2] yarn new ui web-app doe

[jira] [Commented] (YARN-8002) Support NOT_SELF and ALL namespace types for allocation tag

2018-03-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16403162#comment-16403162 ] Wangda Tan commented on YARN-8002: -- +1 to latest patch, will commit it by tomorrow if no o

[jira] [Commented] (YARN-8028) Support authorizeUserAccessToQueue in RMWebServices

2018-03-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16403159#comment-16403159 ] Wangda Tan commented on YARN-8028: -- Attached ver.3 patch > Support authorizeUserAccessToQ

[jira] [Commented] (YARN-8028) Support authorizeUserAccessToQueue in RMWebServices

2018-03-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16403157#comment-16403157 ] Wangda Tan commented on YARN-8028: -- [~sunilg], Thanks for review. 1/2: updated. 3: The

[jira] [Commented] (YARN-8028) Support authorizeUserAccessToQueue in RMWebServices

2018-03-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16403154#comment-16403154 ] Wangda Tan commented on YARN-8028: -- Thanks [~bibinchundatt] for review. For BadRequestExc

[jira] [Updated] (YARN-8028) Support authorizeUserAccessToQueue in RMWebServices

2018-03-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8028: - Attachment: YARN-8028.002.patch > Support authorizeUserAccessToQueue in RMWebServices > ---

[jira] [Updated] (YARN-8028) Support authorizeUserAccessToQueue in RMWebServices

2018-03-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8028: - Attachment: (was: YARN-8028.002.patch) > Support authorizeUserAccessToQueue in RMWebServices >

[jira] [Updated] (YARN-8028) Support authorizeUserAccessToQueue in RMWebServices

2018-03-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8028: - Attachment: YARN-8028.002.patch > Support authorizeUserAccessToQueue in RMWebServices > ---

[jira] [Commented] (YARN-7512) Support service upgrade via YARN Service API and CLI

2018-03-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16401140#comment-16401140 ] Wangda Tan commented on YARN-7512: -- Thanks [~csingh] for working on this design, a couple

[jira] [Commented] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2018-03-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399907#comment-16399907 ] Wangda Tan commented on YARN-7461: -- Thanks [~Tao Yang], [~cheersyang], [~templedf].  I'm

[jira] [Commented] (YARN-8002) Support NOT_SELF and ALL namespace types for allocation tag

2018-03-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399443#comment-16399443 ] Wangda Tan commented on YARN-8002: -- Thanks [~cheersyang], the latest patch looks much bett

[jira] [Commented] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

2018-03-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399416#comment-16399416 ] Wangda Tan commented on YARN-7636: -- Thanks [~Tao Yang] for the nice catching! Patch LGTM.

[jira] [Commented] (YARN-8028) Support authorizeUserAccessToQueue in RMWebServices

2018-03-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399244#comment-16399244 ] Wangda Tan commented on YARN-8028: -- [~sunilg], could you help to review this patch? > Sup

[jira] [Updated] (YARN-8028) Support authorizeUserAccessToQueue in RMWebServices

2018-03-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8028: - Attachment: YARN-8028.001.patch > Support authorizeUserAccessToQueue in RMWebServices > ---

[jira] [Commented] (YARN-8020) when DRF is used, preemption does not trigger due to incorrect idealAssigned

2018-03-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398088#comment-16398088 ] Wangda Tan commented on YARN-8020: -- [~eepayne], could you explain why preemption doesn't h

[jira] [Updated] (YARN-8028) Support authorizeUserAccessToQueue in RMWebServices

2018-03-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8028: - Description: Currently we have {{QueueUserACLInfo}} in ApplicationClient, we should support similar API in

[jira] [Created] (YARN-8028) Support authorizeUserAccessToQueue in RMWebServices

2018-03-13 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-8028: Summary: Support authorizeUserAccessToQueue in RMWebServices Key: YARN-8028 URL: https://issues.apache.org/jira/browse/YARN-8028 Project: Hadoop YARN Issue Type: Imp

[jira] [Commented] (YARN-8022) ResourceManager UI cluster/app/ page fails to render

2018-03-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16397525#comment-16397525 ] Wangda Tan commented on YARN-8022: -- Thanks [~rohithsharma]/[~tarunparimi], Please commit

[jira] [Updated] (YARN-8016) Refine PlacementRule interface and add a app-name queue mapping rule as an example

2018-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8016: - Description: After YARN-3635/YARN-6689, PlacementRule becomes a common interface which can be used by sche

[jira] [Updated] (YARN-8016) Refine PlacementRule interface and add a app-name queue mapping rule as an example

2018-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8016: - Summary: Refine PlacementRule interface and add a app-name queue mapping rule as an example (was: Provide

[jira] [Commented] (YARN-8016) Provide a common interface for queues mapping rules

2018-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16396488#comment-16396488 ] Wangda Tan commented on YARN-8016: -- Thanks [~yufeigu] for looking at this JIRA, I discusse

[jira] [Commented] (YARN-7657) Queue Mapping could provide options to provide 'user' specific auto-created queues under a specified group parent queue

2018-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16396484#comment-16396484 ] Wangda Tan commented on YARN-7657: -- Thanks [~suma.shivaprasad], the latest patch looks goo

[jira] [Commented] (YARN-8022) ResourceManager UI cluster/app/ page fails to render

2018-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16396481#comment-16396481 ] Wangda Tan commented on YARN-8022: -- Thanks [~tarunparimi],  A couple of questions to [~ro

[jira] [Comment Edited] (YARN-8016) Provide a common interface for queues mapping rules

2018-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16396474#comment-16396474 ] Wangda Tan edited comment on YARN-8016 at 3/13/18 3:11 AM: --- Thank

[jira] [Commented] (YARN-8016) Provide a common interface for queues mapping rules

2018-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16396474#comment-16396474 ] Wangda Tan commented on YARN-8016: -- 1) updatePlacementRules, why add readLock? It is alrea

[jira] [Comment Edited] (YARN-8002) Support NOT_SELF and ALL namespace types for allocation tag

2018-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16395878#comment-16395878 ] Wangda Tan edited comment on YARN-8002 at 3/12/18 9:00 PM: --- Thank

[jira] [Commented] (YARN-8002) Support NOT_SELF and ALL namespace types for allocation tag

2018-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16395878#comment-16395878 ] Wangda Tan commented on YARN-8002: -- Thanks [~cheersyang], bq. The approach in this patch a

[jira] [Commented] (YARN-5015) Support sliding window retry capability for container restart

2018-03-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16395819#comment-16395819 ] Wangda Tan commented on YARN-5015: -- +1, thanks [~csingh], I will commit the patch by tomor

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2018-03-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16394328#comment-16394328 ] Wangda Tan commented on YARN-5764: -- Looks good, +1 to the latest patch. Thanks [~devaraj.k

[jira] [Comment Edited] (YARN-8002) Support NOT_SELF and ALL namespace types for allocation tag

2018-03-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16393974#comment-16393974 ] Wangda Tan edited comment on YARN-8002 at 3/10/18 2:26 AM: --- Thank

[jira] [Commented] (YARN-8002) Support NOT_SELF and ALL namespace types for allocation tag

2018-03-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16393974#comment-16393974 ] Wangda Tan commented on YARN-8002: -- Thanks [~cheersyang] for the contexts, suggestions fro

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2018-03-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16393910#comment-16393910 ] Wangda Tan commented on YARN-5764: -- [~devaraj.k] Just took a very quick look at overall i

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2018-03-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16393891#comment-16393891 ] Wangda Tan commented on YARN-5764: -- [~miklos.szeg...@cloudera.com], plz hold on, let me qu

[jira] [Commented] (YARN-5015) Support sliding window retry capability for container restart

2018-03-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16393877#comment-16393877 ] Wangda Tan commented on YARN-5015: -- [~csingh], It seems the findbugs warning is related

[jira] [Commented] (YARN-5015) Support sliding window retry capability for container restart

2018-03-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392164#comment-16392164 ] Wangda Tan commented on YARN-5015: -- [~csingh], it looks like some classes are missing, plz

[jira] [Commented] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392160#comment-16392160 ] Wangda Tan commented on YARN-7952: -- Thanks [~rkanter] > RM should be able to recover log

[jira] [Commented] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391991#comment-16391991 ] Wangda Tan commented on YARN-7952: -- Thanks [~xgong], the latest patch looks good, could yo

[jira] [Commented] (YARN-7657) Queue Mapping could provide options to provide 'user' specific auto-created queues under a specified group parent queue

2018-03-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391987#comment-16391987 ] Wangda Tan commented on YARN-7657: -- [~suma.shivaprasad], Thanks for working on the fix,

[jira] [Commented] (YARN-4488) CapacityScheduler: Compute per-container allocation latency and roll up to get per-application and per-queue

2018-03-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391687#comment-16391687 ] Wangda Tan commented on YARN-4488: -- [~ywskycn], apologize that I missed your ping in YARN-

[jira] [Commented] (YARN-7844) Expose metrics for scheduler operation (allocate, schedulerEvent) to JMX

2018-03-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391672#comment-16391672 ] Wangda Tan commented on YARN-7844: -- Thanks [~ywskycn], I briefly took a look at the patch,

[jira] [Updated] (YARN-7844) Expose metrics for scheduler operation (allocate, schedulerEvent) to JMX

2018-03-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7844: - Priority: Major (was: Minor) > Expose metrics for scheduler operation (allocate, schedulerEvent) to JMX >

[jira] [Updated] (YARN-7844) Expose metrics for scheduler operation (allocate, schedulerEvent) to JMX

2018-03-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7844: - Target Version/s: 3.2.0 > Expose metrics for scheduler operation (allocate, schedulerEvent) to JMX > --

[jira] [Updated] (YARN-7944) Remove master node link from headers of application pages

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7944: - Fix Version/s: (was: 3.1.0) > Remove master node link from headers of application pages > -

[jira] [Commented] (YARN-7944) Remove master node link from headers of application pages

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390710#comment-16390710 ] Wangda Tan commented on YARN-7944: -- And [~yeshavora], just removed fix version, it should

[jira] [Commented] (YARN-7944) Remove master node link from headers of application pages

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390709#comment-16390709 ] Wangda Tan commented on YARN-7944: -- [~sunilg], did you commit this one? I saw this is stil

[jira] [Commented] (YARN-5028) RMStateStore should trim down app state for completed applications

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390707#comment-16390707 ] Wangda Tan commented on YARN-5028: -- [~yufeigu], since this isn't committed to branch-3.1,

[jira] [Updated] (YARN-5028) RMStateStore should trim down app state for completed applications

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5028: - Target Version/s: (was: 3.1.0) > RMStateStore should trim down app state for completed applications > ---

[jira] [Updated] (YARN-5028) RMStateStore should trim down app state for completed applications

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5028: - Fix Version/s: (was: 3.1.0) 3.2.0 > RMStateStore should trim down app state for comp

[jira] [Commented] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390650#comment-16390650 ] Wangda Tan commented on YARN-7952: -- Thanks [~xgong] for update, mostly looks good, few nit

[jira] [Commented] (YARN-5015) Support sliding window retry capability for container restart

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390626#comment-16390626 ] Wangda Tan commented on YARN-5015: -- [~csingh], could you explain a bit about how this logi

[jira] [Commented] (YARN-7891) LogAggregationIndexedFileController should support read from HAR file

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390457#comment-16390457 ] Wangda Tan commented on YARN-7891: -- oops, I committed a wrong patch, just reverted from tr

[jira] [Updated] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7952: - Attachment: (was: YARN-7952.4.patch) > RM should be able to recover log aggregation status after restar

[jira] [Updated] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7952: - Attachment: (was: YARN-7952.4.patch) > RM should be able to recover log aggregation status after restar

[jira] [Updated] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7952: - Attachment: YARN-7952.4.patch > RM should be able to recover log aggregation status after restart/fail-over

[jira] [Commented] (YARN-5015) Support sliding window retry capability for container restart

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390428#comment-16390428 ] Wangda Tan commented on YARN-5015: -- Thanks [~csingh], see my comments below: 1) Instead o

[jira] [Commented] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390237#comment-16390237 ] Wangda Tan commented on YARN-7952: -- Thanks [~xgong], I just updated title/description base

[jira] [Updated] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7952: - Attachment: YARN-7952.4.patch > RM should be able to recover log aggregation status after restart/fail-over

[jira] [Updated] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7952: - Summary: RM should be able to recover log aggregation status after restart/fail-over (was: Find a way to p

[jira] [Updated] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7952: - Description: Right now, the NM would send its own log aggregation status to RM periodically to RM. And RM w

[jira] [Comment Edited] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390081#comment-16390081 ] Wangda Tan edited comment on YARN-7626 at 3/7/18 7:32 PM: -- Committ

[jira] [Commented] (YARN-5015) Unify restart policies across AM and container restarts

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390068#comment-16390068 ] Wangda Tan commented on YARN-5015: -- [~csingh], could you please elaborate approach and sco

[jira] [Updated] (YARN-7891) LogAggregationIndexedFileController should support read from HAR file

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7891: - Summary: LogAggregationIndexedFileController should support read from HAR file (was: LogAggregationIndexed

[jira] [Commented] (YARN-7891) LogAggregationIndexedFileController should support HAR file

2018-03-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388686#comment-16388686 ] Wangda Tan commented on YARN-7891: -- Thanks [~xgong] for confirmation, +1 to latest patch.

[jira] [Commented] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-03-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388685#comment-16388685 ] Wangda Tan commented on YARN-7626: -- Thanks [~miklos.szeg...@cloudera.com]/[~Zian Chen], wi

[jira] [Commented] (YARN-7935) Expose container's hostname to applications running within the docker container

2018-03-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16386946#comment-16386946 ] Wangda Tan commented on YARN-7935: -- Thanks [~suma.shivaprasad], the latest patch looks goo

[jira] [Commented] (YARN-7952) Find a way to persist the log aggregation status

2018-03-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16386700#comment-16386700 ] Wangda Tan commented on YARN-7952: -- Thanks [~xgong],  It might be better to update defaul

[jira] [Commented] (YARN-7891) LogAggregationIndexedFileController should support HAR file

2018-03-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16386633#comment-16386633 ] Wangda Tan commented on YARN-7891: -- [~xgong],  Thanks for explanation, so IIUC, logic of

[jira] [Commented] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-03-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16385580#comment-16385580 ] Wangda Tan commented on YARN-7626: -- Thanks [~Zian Chen]. +1, LGTM, [~miklos.szeg...@cloude

[jira] [Commented] (YARN-7952) Find a way to persist the log aggregation status

2018-03-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16382934#comment-16382934 ] Wangda Tan commented on YARN-7952: -- Thanks Xuan Gong for working on the patch, A quick qu

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-03-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16382864#comment-16382864 ] Wangda Tan commented on YARN-7494: -- Thanks [~sunilg] for updating the patch, reviewed over

[jira] [Commented] (YARN-4488) CapacityScheduler: Compute per-container allocation latency and roll up to get per-application and per-queue

2018-03-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16382744#comment-16382744 ] Wangda Tan commented on YARN-4488: -- [~maniraj...@gmail.com], thanks for the explanation, I

[jira] [Commented] (YARN-7935) Expose container's hostname to applications running within the docker container

2018-03-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16382721#comment-16382721 ] Wangda Tan commented on YARN-7935: -- Thanks [~suma.shivaprasad] for working on the change,

[jira] [Commented] (YARN-7891) LogAggregationIndexedFileController should support HAR file

2018-03-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16382612#comment-16382612 ] Wangda Tan commented on YARN-7891: -- Thanks [~xgong] *Overall questions:* What's the JIRA

[jira] [Updated] (YARN-7637) GPU volume creation command fails when work preserving is disabled at NM

2018-03-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7637: - Fix Version/s: (was: 3.2.0) > GPU volume creation command fails when work preserving is disabled at NM

[jira] [Updated] (YARN-7934) [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos

2018-02-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7934: - Fix Version/s: 3.2.0 > [GQ] Refactor preemption calculators to allow overriding for Federation > Global Al

[jira] [Commented] (YARN-7934) [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos

2018-02-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16381067#comment-16381067 ] Wangda Tan commented on YARN-7934: -- Set proper fix version (3.2.0) > [GQ] Refactor preemp

[jira] [Commented] (YARN-7972) Support inter-app placement constraints for allocation tags by application ID

2018-02-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16381059#comment-16381059 ] Wangda Tan commented on YARN-7972: -- [~cheersyang], I'd prefer to remove the {{ns:}} prefix

[jira] [Updated] (YARN-7637) GPU volume creation command fails when work preserving is disabled at NM

2018-02-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7637: - Target Version/s: 3.1.0 > GPU volume creation command fails when work preserving is disabled at NM > --

[jira] [Commented] (YARN-7637) GPU volume creation command fails when work preserving is disabled at NM

2018-02-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16379368#comment-16379368 ] Wangda Tan commented on YARN-7637: -- Set target version to 3.1.0. > GPU volume creation co

[jira] [Commented] (YARN-7972) Support inter-app placement constraints for allocation tags by application ID

2018-02-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16379358#comment-16379358 ] Wangda Tan commented on YARN-7972: -- Thanks [~cheersyang], 1) It might not be necessary to

[jira] [Commented] (YARN-7959) Add .vm extension to PlacementConstraints.md to ensure proper filtering

2018-02-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16377340#comment-16377340 ] Wangda Tan commented on YARN-7959: -- LGTM, thanks [~cheersyang], will commit shortly. > Ad

[jira] [Commented] (YARN-7893) Document the FPGA isolation feature

2018-02-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16377338#comment-16377338 ] Wangda Tan commented on YARN-7893: -- Thanks [~tangzhankun] for updating the JIRA, latest pa

[jira] [Commented] (YARN-7920) Simplify configuration for PlacementConstraints

2018-02-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16372527#comment-16372527 ] Wangda Tan commented on YARN-7920: -- [~cheersyang], I think it should be fine, user should

[jira] [Commented] (YARN-7738) CapacityScheduler: Support refresh maximum allocation for multiple resource types

2018-02-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16372526#comment-16372526 ] Wangda Tan commented on YARN-7738: -- [~yufeigu], CS support refresh maximum allocation whil

[jira] [Updated] (YARN-7223) Document GPU isolation feature

2018-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7223: - Attachment: YARN-7223.003.patch > Document GPU isolation feature > -- > >

[jira] [Commented] (YARN-7223) Document GPU isolation feature

2018-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370934#comment-16370934 ] Wangda Tan commented on YARN-7223: -- Thanks [~sunilg], attached ver.3 patch, please review.

[jira] [Commented] (YARN-7952) Find a way to persist the log aggregation status

2018-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370930#comment-16370930 ] Wangda Tan commented on YARN-7952: -- Thanks [~xgong], I prefer option #2. > Find a way to

[jira] [Commented] (YARN-4488) CapacityScheduler: Compute per-container allocation latency and roll up to get per-application and per-queue

2018-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370884#comment-16370884 ] Wangda Tan commented on YARN-4488: -- [~maniraj...@gmail.com], thanks for working on the pat

[jira] [Assigned] (YARN-4488) CapacityScheduler: Compute per-container allocation latency and roll up to get per-application and per-queue

2018-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-4488: Assignee: Manikandan R (was: Wangda Tan) > CapacityScheduler: Compute per-container allocation late

[jira] [Commented] (YARN-7732) Support Generic AM Simulator from SynthGenerator

2018-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370881#comment-16370881 ] Wangda Tan commented on YARN-7732: -- [~curino], according to https://issues.apache.org/jira

[jira] [Reopened] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reopened YARN-7677: -- Thanks [~rohithsharma] for reporting this issue. This is reproducible and resolved after revert of YARN-767

[jira] [Updated] (YARN-7799) YARN Service dependency follow up work

2018-02-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7799: - Target Version/s: 3.2.0 (was: 3.1.0) > YARN Service dependency follow up work > --

[jira] [Commented] (YARN-7799) YARN Service dependency follow up work

2018-02-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368431#comment-16368431 ] Wangda Tan commented on YARN-7799: -- [~gsaha], we originally plan to start vote by end of t

[jira] [Commented] (YARN-7940) Service AM gets NoAuth with secure ZK

2018-02-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368428#comment-16368428 ] Wangda Tan commented on YARN-7940: -- +1 to the patch, will commit shortly. > Service AM ge

[jira] [Updated] (YARN-7505) RM REST endpoints generate malformed JSON

2018-02-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7505: - Target Version/s: 3.2.0 (was: 3.1.0) > RM REST endpoints generate malformed JSON > ---

[jira] [Commented] (YARN-7505) RM REST endpoints generate malformed JSON

2018-02-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368427#comment-16368427 ] Wangda Tan commented on YARN-7505: -- [~templedf], since 3.1 is approaching, I'm going to mo

[jira] [Updated] (YARN-7893) Document the FPGA isolation feature

2018-02-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7893: - Target Version/s: 3.1.0 > Document the FPGA isolation feature > --- > >

[jira] [Commented] (YARN-7893) Document the FPGA isolation feature

2018-02-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368098#comment-16368098 ] Wangda Tan commented on YARN-7893: -- Boost the priority to blocker and set target version t

[jira] [Updated] (YARN-7893) Document the FPGA isolation feature

2018-02-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7893: - Fix Version/s: 3.1.0 > Document the FPGA isolation feature > --- > >

[jira] [Updated] (YARN-7893) Document the FPGA isolation feature

2018-02-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7893: - Priority: Blocker (was: Major) > Document the FPGA isolation feature > ---

<    8   9   10   11   12   13   14   15   16   17   >