[jira] [Commented] (YARN-7953) [GQ] Data structures for federation global queues calculations

2018-03-06 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388325#comment-16388325 ] Carlo Curino commented on YARN-7953: [~asuresh] I like this suggestion, and from our offline convo I

[jira] [Updated] (YARN-7403) [GQ] Compute global and local "IdealAllocation"

2018-02-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7403: --- Attachment: YARN-7403.v3.patch > [GQ] Compute global and local "IdealAllocation" >

[jira] [Commented] (YARN-7403) [GQ] Compute global and local "IdealAllocation"

2018-02-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372324#comment-16372324 ] Carlo Curino commented on YARN-7403: [~kkaranasos] thanks for looking at this. I initially put it

[jira] [Comment Edited] (YARN-7953) [GQ] Data structures for federation global queues calculations

2018-02-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372305#comment-16372305 ] Carlo Curino edited comment on YARN-7953 at 2/22/18 1:41 AM: - Per [this

[jira] [Assigned] (YARN-7953) [GQ] Data structures for federation global queues calculations

2018-02-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-7953: -- Assignee: Carlo Curino > [GQ] Data structures for federation global queues calculations >

[jira] [Updated] (YARN-7953) [GQ] Data structures for federation global queues calculations

2018-02-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7953: --- Attachment: YARN-7953.v1.patch > [GQ] Data structures for federation global queues calculations >

[jira] [Created] (YARN-7953) [GQ] Data structures for federation global queues calculations

2018-02-21 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-7953: -- Summary: [GQ] Data structures for federation global queues calculations Key: YARN-7953 URL: https://issues.apache.org/jira/browse/YARN-7953 Project: Hadoop YARN

[jira] [Commented] (YARN-7732) Support Generic AM Simulator from SynthGenerator

2018-02-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371824#comment-16371824 ] Carlo Curino commented on YARN-7732: Thanks [~leftnoteasy], so should we then push to branch-3.0 (for

[jira] [Commented] (YARN-7798) Refactor SLS Reservation Creation

2018-02-20 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370822#comment-16370822 ] Carlo Curino commented on YARN-7798: Cherry-picked back to branch-3 with a clean cherry-pick (and spot

[jira] [Commented] (YARN-7732) Support Generic AM Simulator from SynthGenerator

2018-02-20 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370821#comment-16370821 ] Carlo Curino commented on YARN-7732: Thanks [~youchen] for the contribution, and [~leftnoteasy] for

[jira] [Commented] (YARN-7732) Support Generic AM Simulator from SynthGenerator

2018-02-20 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370610#comment-16370610 ] Carlo Curino commented on YARN-7732: Thanks [~leftnoteasy] forĀ  the review. [~youchen] please fix the

[jira] [Commented] (YARN-7403) [GQ] Compute global and local "IdealAllocation"

2018-02-20 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370506#comment-16370506 ] Carlo Curino commented on YARN-7403: Fixing TestYarnConfigurationFields unit test failure (the rest

[jira] [Updated] (YARN-7403) [GQ] Compute global and local "IdealAllocation"

2018-02-20 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7403: --- Attachment: YARN-7403.v2.patch > [GQ] Compute global and local "IdealAllocation" >

[jira] [Commented] (YARN-7934) [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos

2018-02-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368062#comment-16368062 ] Carlo Curino commented on YARN-7934: [~subru] thanks for the review. I agree the test seems unrelated

[jira] [Updated] (YARN-7934) [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos

2018-02-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7934: --- Attachment: YARN-7934.v4.patch > [GQ] Refactor preemption calculators to allow overriding for

[jira] [Commented] (YARN-7934) [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos

2018-02-15 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366516#comment-16366516 ] Carlo Curino commented on YARN-7934: [~subru] thanks for the quick review. I have adressed the javadoc

[jira] [Updated] (YARN-7934) [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos

2018-02-15 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7934: --- Attachment: YARN-7934.v3.patch > [GQ] Refactor preemption calculators to allow overriding for

[jira] [Commented] (YARN-7834) [GQ] Rebalance queue configuration for load-balancing and locality affinities

2018-02-15 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366372#comment-16366372 ] Carlo Curino commented on YARN-7834: The uploaded patch provides an Linear Programming (LP)

[jira] [Updated] (YARN-7834) [GQ] Rebalance queue configuration for load-balancing and locality affinities

2018-02-15 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7834: --- Attachment: YARN-7834.v1.patch > [GQ] Rebalance queue configuration for load-balancing and locality

[jira] [Resolved] (YARN-7725) [GQ] Compute global "ideal allocation" including locality biases

2018-02-15 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino resolved YARN-7725. Resolution: Duplicate Fix Version/s: yarn-7403 Newer version of YARN-7403 subsumes this task.

[jira] [Updated] (YARN-7403) [GQ] Compute global and local "IdealAllocation"

2018-02-15 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7403: --- Description: This JIRA tracks algorithmic effort to combine the local queue views of capacity

[jira] [Commented] (YARN-7934) [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos

2018-02-15 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366215#comment-16366215 ] Carlo Curino commented on YARN-7934: Patch v2 attempts to please the YETUS gods. This patch does not

[jira] [Updated] (YARN-7934) [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos

2018-02-15 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7934: --- Attachment: YARN-7934.v2.patch > [GQ] Refactor preemption calculators to allow overriding for

[jira] [Commented] (YARN-7403) [GQ] Compute global and local "IdealAllocation"

2018-02-14 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365063#comment-16365063 ] Carlo Curino commented on YARN-7403: The v1 patch contains a much reworked version of the code. This

[jira] [Updated] (YARN-7403) [GQ] Compute global and local "IdealAllocation"

2018-02-14 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7403: --- Attachment: YARN-7403.v1.patch > [GQ] Compute global and local "IdealAllocation" >

[jira] [Commented] (YARN-7934) [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos

2018-02-14 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364966#comment-16364966 ] Carlo Curino commented on YARN-7934: [~leftnoteasy] the intention is to commit this directly to trunk,

[jira] [Updated] (YARN-7934) [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos

2018-02-14 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7934: --- Attachment: (was: More.url) > [GQ] Refactor preemption calculators to allow overriding for

[jira] [Updated] (YARN-7934) [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos

2018-02-14 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7934: --- Attachment: YARN-7934.v1.patch > [GQ] Refactor preemption calculators to allow overriding for

[jira] [Updated] (YARN-7934) [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos

2018-02-14 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7934: --- Attachment: More.url > [GQ] Refactor preemption calculators to allow overriding for Federation >

[jira] [Assigned] (YARN-7934) [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos

2018-02-14 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-7934: -- Assignee: Carlo Curino > [GQ] Refactor preemption calculators to allow overriding for

[jira] [Created] (YARN-7934) [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos

2018-02-14 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-7934: -- Summary: [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos Key: YARN-7934 URL: https://issues.apache.org/jira/browse/YARN-7934

[jira] [Updated] (YARN-6528) [PERF/TEST] Add JMX metrics for Plan Follower and Agent Placement and Plan Operations

2018-02-14 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6528: --- Summary: [PERF/TEST] Add JMX metrics for Plan Follower and Agent Placement and Plan Operations (was:

[jira] [Commented] (YARN-6528) Add JMX metrics for Plan Follower and Agent Placement and Plan Operations

2018-02-14 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364757#comment-16364757 ] Carlo Curino commented on YARN-6528: Thanks [~seanpo03], I am ok with the left-over checkstyle. I am

[jira] [Assigned] (YARN-6528) Add JMX metrics for Plan Follower and Agent Placement and Plan Operations

2018-02-14 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-6528: -- Assignee: Xiaohua (Victor) Liang (was: Carlo Curino) > Add JMX metrics for Plan Follower and

[jira] [Updated] (YARN-6528) Add JMX metrics for Plan Follower and Agent Placement and Plan Operations

2018-02-14 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6528: --- Issue Type: Sub-task (was: Task) Parent: YARN-7402 > Add JMX metrics for Plan Follower and

[jira] [Assigned] (YARN-7614) [RESERVATION] Support Reservation APIs in Federation Router

2018-01-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-7614: -- Assignee: Giovanni Matteo Fumarola > [RESERVATION] Support Reservation APIs in Federation

[jira] [Assigned] (YARN-7404) [GQ] propagate to GPG queue-level utilization/pending information

2018-01-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-7404: -- Assignee: Jose Miguel Arreola > [GQ] propagate to GPG queue-level utilization/pending

[jira] [Assigned] (YARN-7870) [PERF/TEST] Performance testing of ReservationSystem at high job submission rates

2018-01-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-7870: -- Assignee: Xiaohua (Victor) Liang > [PERF/TEST] Performance testing of ReservationSystem at high

[jira] [Assigned] (YARN-7869) [PERF/TEST] Performance testing of CapacityScheudler at many-thousands of queues

2018-01-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-7869: -- Assignee: Abhishek Modi > [PERF/TEST] Performance testing of CapacityScheudler at

[jira] [Commented] (YARN-7870) [PERF/TEST] Performance testing of ReservationSystem at high job submission rates

2018-01-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347741#comment-16347741 ] Carlo Curino commented on YARN-7870: Yes! It is, in fact, already extended to support reservations

[jira] [Updated] (YARN-7833) [PERF/TEST] Extend SLS to support simulation of a Federated Environment

2018-01-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7833: --- Summary: [PERF/TEST] Extend SLS to support simulation of a Federated Environment (was: Extend SLS to

[jira] [Created] (YARN-7870) [PERF/TEST] Performance testing of ReservationSystem at high job submission rates

2018-01-31 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-7870: -- Summary: [PERF/TEST] Performance testing of ReservationSystem at high job submission rates Key: YARN-7870 URL: https://issues.apache.org/jira/browse/YARN-7870 Project:

[jira] [Created] (YARN-7869) [PERF/TEST] Performance testing of CapacityScheudler at many-thousands of queues

2018-01-31 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-7869: -- Summary: [PERF/TEST] Performance testing of CapacityScheudler at many-thousands of queues Key: YARN-7869 URL: https://issues.apache.org/jira/browse/YARN-7869 Project:

[jira] [Assigned] (YARN-7833) Extend SLS to support simulation of a Federated Environment

2018-01-26 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-7833: -- Assignee: Jose Miguel Arreola > Extend SLS to support simulation of a Federated Environment >

[jira] [Assigned] (YARN-7615) [RESERVATION] Federation StateStore: support storage/retrieval of reservations

2018-01-26 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-7615: -- Assignee: Giovanni Matteo Fumarola > [RESERVATION] Federation StateStore: support

[jira] [Assigned] (YARN-7405) [GQ] Bias container allocations based on global view

2018-01-26 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-7405: -- Assignee: Subru Krishnan > [GQ] Bias container allocations based on global view >

[jira] [Created] (YARN-7834) [GQ] Rebalance queue configuration for load-balancing and locality affinities

2018-01-26 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-7834: -- Summary: [GQ] Rebalance queue configuration for load-balancing and locality affinities Key: YARN-7834 URL: https://issues.apache.org/jira/browse/YARN-7834 Project:

[jira] [Assigned] (YARN-7834) [GQ] Rebalance queue configuration for load-balancing and locality affinities

2018-01-26 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-7834: -- Assignee: Carlo Curino > [GQ] Rebalance queue configuration for load-balancing and locality

[jira] [Updated] (YARN-7403) [GQ] Compute global and local "IdealAllocation"

2018-01-26 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7403: --- Summary: [GQ] Compute global and local "IdealAllocation" (was: [GQ] Compute global and local

[jira] [Created] (YARN-7833) Extend SLS to support simulation of a Federated Environment

2018-01-26 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-7833: -- Summary: Extend SLS to support simulation of a Federated Environment Key: YARN-7833 URL: https://issues.apache.org/jira/browse/YARN-7833 Project: Hadoop YARN

[jira] [Commented] (YARN-6648) [GPG] Add SubClusterCleaner in Global Policy Generator

2018-01-24 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338144#comment-16338144 ] Carlo Curino commented on YARN-6648: [~botong] thanks for updating the patch, +1 from me, with the

[jira] [Comment Edited] (YARN-6648) [GPG] Add SubClusterCleaner in Global Policy Generator

2018-01-19 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332694#comment-16332694 ] Carlo Curino edited comment on YARN-6648 at 1/19/18 6:37 PM: - [~botong] thanks

[jira] [Commented] (YARN-6648) [GPG] Add SubClusterCleaner in Global Policy Generator

2018-01-19 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332694#comment-16332694 ] Carlo Curino commented on YARN-6648: [~botong] thanks for the updated patch, I think it is nicer to

[jira] [Commented] (YARN-3660) [GPG] Federation Global Policy Generator (service hook only)

2018-01-18 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331562#comment-16331562 ] Carlo Curino commented on YARN-3660: [~botong] thanks for the contribution, v4 patch looks good. I

[jira] [Commented] (YARN-6648) [GPG] Add FederationStateStore interfaces for Global Policy Generator

2018-01-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324373#comment-16324373 ] Carlo Curino commented on YARN-6648: [~botong] the changes in this JIRA seem fine/harmless. However,

[jira] [Commented] (YARN-3660) [GPG] Federation Global Policy Generator (service hook only)

2018-01-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324362#comment-16324362 ] Carlo Curino commented on YARN-3660: [~botong] the patch seems generally ok but please: # Address

[jira] [Updated] (YARN-3660) [GPG] Federation Global Policy Generator (service hook only)

2018-01-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-3660: --- Summary: [GPG] Federation Global Policy Generator (service hook only) (was: [GPG] Federation Global

[jira] [Commented] (YARN-7402) Federation V2: Global Optimizations

2018-01-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319464#comment-16319464 ] Carlo Curino commented on YARN-7402: I created a dev-branch YARN-7402 for the activities of this

[jira] [Created] (YARN-7725) [GQ] Compute global "ideal allocation" including locality biases

2018-01-09 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-7725: -- Summary: [GQ] Compute global "ideal allocation" including locality biases Key: YARN-7725 URL: https://issues.apache.org/jira/browse/YARN-7725 Project: Hadoop YARN

[jira] [Assigned] (YARN-7725) [GQ] Compute global "ideal allocation" including locality biases

2018-01-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-7725: -- Assignee: Carlo Curino > [GQ] Compute global "ideal allocation" including locality biases >

[jira] [Updated] (YARN-7403) [GQ] Compute global and local preemption

2018-01-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7403: --- Summary: [GQ] Compute global and local preemption (was: Compute global and local preemption) > [GQ]

[jira] [Updated] (YARN-7405) [GQ] Bias container allocations based on global view

2018-01-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7405: --- Summary: [GQ] Bias container allocations based on global view (was: Bias container allocations based

[jira] [Updated] (YARN-7404) [GQ] propagate to GPG queue-level utilization/pending information

2018-01-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7404: --- Summary: [GQ] propagate to GPG queue-level utilization/pending information (was: RM federation

[jira] [Updated] (YARN-7614) Support Reservation APIs in Federation Router

2018-01-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7614: --- Component/s: reservation system > Support Reservation APIs in Federation Router >

[jira] [Updated] (YARN-7615) [RESERVATION] Federation StateStore: support storage/retrieval of reservations

2018-01-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7615: --- Summary: [RESERVATION] Federation StateStore: support storage/retrieval of reservations (was:

[jira] [Updated] (YARN-7614) [RESERVATION] Support Reservation APIs in Federation Router

2018-01-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7614: --- Summary: [RESERVATION] Support Reservation APIs in Federation Router (was: Support Reservation APIs

[jira] [Updated] (YARN-5871) [RESERVATION] Add support for reservation-based routing.

2018-01-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5871: --- Labels: federation reservation (was: federation) > [RESERVATION] Add support for reservation-based

[jira] [Updated] (YARN-5871) [RESERVATION] Add support for reservation-based routing.

2018-01-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5871: --- Summary: [RESERVATION] Add support for reservation-based routing. (was: Add support for

[jira] [Updated] (YARN-7402) Federation V2: Global Optimizations

2018-01-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7402: --- Summary: Federation V2: Global Optimizations (was: Federation: Global Queues) Description:

[jira] [Updated] (YARN-7708) [GPG] Load based policy generator

2018-01-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7708: --- Parent Issue: YARN-7402 (was: YARN-5597) > [GPG] Load based policy generator >

[jira] [Updated] (YARN-7599) [GPG] Application cleaner and subcluster cleaner in Global Policy Generator

2018-01-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7599: --- Parent Issue: YARN-7402 (was: YARN-5597) > [GPG] Application cleaner and subcluster cleaner in Global

[jira] [Updated] (YARN-7707) [GPG] Policy generator framework

2018-01-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7707: --- Parent Issue: YARN-7402 (was: YARN-5597) > [GPG] Policy generator framework >

[jira] [Updated] (YARN-6648) [GPG] Add FederationStateStore interfaces for Global Policy Generator

2018-01-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6648: --- Parent Issue: YARN-7402 (was: YARN-5597) > [GPG] Add FederationStateStore interfaces for Global

[jira] [Updated] (YARN-3660) [GPG] Federation Global Policy Generator (load balancing)

2018-01-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-3660: --- Parent Issue: YARN-7402 (was: YARN-5597) > [GPG] Federation Global Policy Generator (load balancing)

[jira] [Updated] (YARN-5597) YARN Federation improvements

2018-01-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5597: --- Summary: YARN Federation improvements (was: YARN Federation phase 2) > YARN Federation improvements >

[jira] [Assigned] (YARN-7708) [GPG] Load based policy generator

2018-01-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-7708: -- Assignee: Young Chen > [GPG] Load based policy generator > - >

[jira] [Assigned] (YARN-7707) [GPG] Policy generator framework

2018-01-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-7707: -- Assignee: Young Chen (was: Carlo Curino) > [GPG] Policy generator framework >

[jira] [Updated] (YARN-7707) [GPG] Policy generator framework

2018-01-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7707: --- Labels: federation gpg (was: ) > [GPG] Policy generator framework >

[jira] [Assigned] (YARN-7707) [GPG] Policy generator framework

2018-01-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-7707: -- Assignee: Carlo Curino (was: Young Chen) > [GPG] Policy generator framework >

[jira] [Assigned] (YARN-7707) [GPG] Policy generator framework

2018-01-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-7707: -- Assignee: Young Chen > [GPG] Policy generator framework > > >

[jira] [Created] (YARN-7708) [GPG] Load based policy generator

2018-01-05 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-7708: -- Summary: [GPG] Load based policy generator Key: YARN-7708 URL: https://issues.apache.org/jira/browse/YARN-7708 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-7707) [GPG] Policy generator framework

2018-01-05 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-7707: -- Summary: [GPG] Policy generator framework Key: YARN-7707 URL: https://issues.apache.org/jira/browse/YARN-7707 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-7599) [GPG] Application cleaner and subcluster cleaner in Global Policy Generator

2018-01-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7599: --- Summary: [GPG] Application cleaner and subcluster cleaner in Global Policy Generator (was:

[jira] [Updated] (YARN-7599) [GPG] Application cleaner and subcluster cleaner in Global Policy Generator

2018-01-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7599: --- Labels: federation gpg (was: ) > [GPG] Application cleaner and subcluster cleaner in Global Policy

[jira] [Updated] (YARN-6648) [GPG] Add FederationStateStore interfaces for Global Policy Generator

2018-01-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6648: --- Labels: federation gpg (was: ) > [GPG] Add FederationStateStore interfaces for Global Policy

[jira] [Updated] (YARN-3660) [GPG] Federation Global Policy Generator (load balancing)

2018-01-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-3660: --- Summary: [GPG] Federation Global Policy Generator (load balancing) (was: Federation Global Policy

[jira] [Updated] (YARN-3660) [GPG] Federation Global Policy Generator (load balancing)

2018-01-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-3660: --- Labels: federation gpg (was: ) > [GPG] Federation Global Policy Generator (load balancing) >

[jira] [Updated] (YARN-6648) [GPG] Add FederationStateStore interfaces for Global Policy Generator

2018-01-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6648: --- Summary: [GPG] Add FederationStateStore interfaces for Global Policy Generator (was: Add

[jira] [Assigned] (YARN-3660) Federation Global Policy Generator (load balancing)

2018-01-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-3660: -- Assignee: Botong Huang (was: Subru Krishnan) > Federation Global Policy Generator (load

[jira] [Created] (YARN-7615) Federation StateStore: support storage/retrieval of reservations

2017-12-05 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-7615: -- Summary: Federation StateStore: support storage/retrieval of reservations Key: YARN-7615 URL: https://issues.apache.org/jira/browse/YARN-7615 Project: Hadoop YARN

[jira] [Created] (YARN-7614) Support Reservation APIs in Federation Router

2017-12-05 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-7614: -- Summary: Support Reservation APIs in Federation Router Key: YARN-7614 URL: https://issues.apache.org/jira/browse/YARN-7614 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7439) Minor improvements to Reservation System documentation/exceptions

2017-11-03 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238099#comment-16238099 ] Carlo Curino commented on YARN-7439: # The main documentation page for the ReservationSystem

[jira] [Created] (YARN-7439) Minor improvements to Reservation System documentation/exceptions

2017-11-03 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-7439: -- Summary: Minor improvements to Reservation System documentation/exceptions Key: YARN-7439 URL: https://issues.apache.org/jira/browse/YARN-7439 Project: Hadoop YARN

[jira] [Commented] (YARN-7434) Router getApps REST invocation fails with multiple RMs

2017-11-02 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236910#comment-16236910 ] Carlo Curino commented on YARN-7434: Thanks [~elgoiri] for the patch. LGTM, let's wait for Yetus. Also

[jira] [Commented] (YARN-7431) resource estimator has findbugs problems

2017-11-02 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236804#comment-16236804 ] Carlo Curino commented on YARN-7431: The patch LGTM vs the issues listed, though let's see what yetus

[jira] [Commented] (YARN-7403) Compute global and local preemption

2017-10-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227507#comment-16227507 ] Carlo Curino commented on YARN-7403: The attached screenshot shows an example of "globally" calculated

[jira] [Updated] (YARN-7403) Compute global and local preemption

2017-10-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7403: --- Attachment: global-queues-preemption.PNG > Compute global and local preemption >

[jira] [Updated] (YARN-7403) Compute global and local preemption

2017-10-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7403: --- Attachment: YARN-7403.draft3.patch > Compute global and local preemption >

[jira] [Updated] (YARN-7403) Compute global and local preemption

2017-10-26 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7403: --- Attachment: YARN-7403.draft2.patch Fixing ASF license. > Compute global and local preemption >

[jira] [Created] (YARN-7405) Bias container allocations based on global view

2017-10-26 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-7405: -- Summary: Bias container allocations based on global view Key: YARN-7405 URL: https://issues.apache.org/jira/browse/YARN-7405 Project: Hadoop YARN Issue Type:

  1   2   3   4   5   6   7   8   9   10   >