[jira] [Updated] (MESOS-7521) Major performance regression in DRF sorter.
[
https://issues.apache.org/jira/browse/MESOS-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neil Conway updated MESOS-7521:
---
Summary: Major performance regression in DRF sorter. (was: Major
performance regression in drf sorter)
> Major performance regression in DRF sorter.
> ---
>
> Key: MESOS-7521
> URL: https://issues.apache.org/jira/browse/MESOS-7521
> Project: Mesos
> Issue Type: Bug
> Components: allocation
>Affects Versions: 1.3.0
>Reporter: Dario Rexin
>Assignee: Neil Conway
>Priority: Blocker
> Labels: perfomance
>
> The addition of hierarchical roles to the framework sorter
> (https://github.com/apache/mesos/commit/e5ef1992b2b8e84b5d1487f1578f18f2291cd082)
> has introduced a major performance regression to 1.2. Suppressing offers for
> frameworks does not seem to reduce allocation time anymore, like it used to
> in 1.2. Here are some relevant benchmark results:
> Mesos 1.2:
> {noformat}
> [ RUN ]
> SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
> Using 1000 agents and 6000 frameworks
> Added 6000 frameworks in 105957us
> Added 1000 agents in 34.937438secs
> allocate() took 27.408828secs to make 1000 offers with 1200 out of 6000
> frameworks suppressing offers
> allocate() took 20.121897secs to make 1000 offers with 2400 out of 6000
> frameworks suppressing offers
> allocate() took 12.964302secs to make 1000 offers with 3600 out of 6000
> frameworks suppressing offers
> allocate() took 6.534221secs to make 1000 offers with 4800 out of 6000
> frameworks suppressing offers
> allocate() took 8953us to make 0 offers with 6000 out of 6000 frameworks
> suppressing offers
> [ OK ]
> SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
> (106198 ms)
> {noformat}
> Mesos 1.3:
> {noformat}
> [ RUN ]
> SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
> Using 1000 agents and 6000 frameworks
> Added 6000 frameworks in 1.036217secs
> Added 1000 agents in 10.093938secs
> allocate() took 10.629448secs to make 1000 offers with 1200 out of 6000
> frameworks suppressing offers
> allocate() took 11.607185secs to make 1000 offers with 2400 out of 6000
> frameworks suppressing offers
> allocate() took 12.896578secs to make 1000 offers with 3600 out of 6000
> frameworks suppressing offers
> allocate() took 14.162431secs to make 1000 offers with 4800 out of 6000
> frameworks suppressing offers
> allocate() took 257060us to make 0 offers with 6000 out of 6000 frameworks
> suppressing offers
> [ OK ]
> SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
> (64011 ms)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Updated] (MESOS-7521) Major performance regression in DRF sorter.
[
https://issues.apache.org/jira/browse/MESOS-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexander Rukletsov updated MESOS-7521:
---
Labels: performance (was: perfomance)
> Major performance regression in DRF sorter.
> ---
>
> Key: MESOS-7521
> URL: https://issues.apache.org/jira/browse/MESOS-7521
> Project: Mesos
> Issue Type: Bug
> Components: allocation
>Affects Versions: 1.3.0
>Reporter: Dario Rexin
>Assignee: Neil Conway
>Priority: Blocker
> Labels: performance
> Fix For: 1.3.0
>
>
> The addition of hierarchical roles to the framework sorter
> (https://github.com/apache/mesos/commit/e5ef1992b2b8e84b5d1487f1578f18f2291cd082)
> has introduced a major performance regression to 1.2. Suppressing offers for
> frameworks does not seem to reduce allocation time anymore, like it used to
> in 1.2. Here are some relevant benchmark results:
> Mesos 1.2:
> {noformat}
> [ RUN ]
> SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
> Using 1000 agents and 6000 frameworks
> Added 6000 frameworks in 105957us
> Added 1000 agents in 34.937438secs
> allocate() took 27.408828secs to make 1000 offers with 1200 out of 6000
> frameworks suppressing offers
> allocate() took 20.121897secs to make 1000 offers with 2400 out of 6000
> frameworks suppressing offers
> allocate() took 12.964302secs to make 1000 offers with 3600 out of 6000
> frameworks suppressing offers
> allocate() took 6.534221secs to make 1000 offers with 4800 out of 6000
> frameworks suppressing offers
> allocate() took 8953us to make 0 offers with 6000 out of 6000 frameworks
> suppressing offers
> [ OK ]
> SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
> (106198 ms)
> {noformat}
> Mesos 1.3:
> {noformat}
> [ RUN ]
> SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
> Using 1000 agents and 6000 frameworks
> Added 6000 frameworks in 1.036217secs
> Added 1000 agents in 10.093938secs
> allocate() took 10.629448secs to make 1000 offers with 1200 out of 6000
> frameworks suppressing offers
> allocate() took 11.607185secs to make 1000 offers with 2400 out of 6000
> frameworks suppressing offers
> allocate() took 12.896578secs to make 1000 offers with 3600 out of 6000
> frameworks suppressing offers
> allocate() took 14.162431secs to make 1000 offers with 4800 out of 6000
> frameworks suppressing offers
> allocate() took 257060us to make 0 offers with 6000 out of 6000 frameworks
> suppressing offers
> [ OK ]
> SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
> (64011 ms)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Updated] (MESOS-7521) Major performance regression in drf sorter
[ https://issues.apache.org/jira/browse/MESOS-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neil Conway updated MESOS-7521: --- Priority: Blocker (was: Major) > Major performance regression in drf sorter > -- > > Key: MESOS-7521 > URL: https://issues.apache.org/jira/browse/MESOS-7521 > Project: Mesos > Issue Type: Bug > Components: allocation >Affects Versions: 1.3.0 >Reporter: Dario Rexin >Priority: Blocker > Labels: perfomance > > The addition of hierarchical roles to the framework sorter > (https://github.com/apache/mesos/commit/e5ef1992b2b8e84b5d1487f1578f18f2291cd082) > has introduced a major performance regression to 1.2. Suppressing offers for > frameworks does not seem to reduce allocation time anymore, like it used to > in 1.2. Here are some relevant benchmark results: > Mesos 1.2: > [ RUN ] > SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7 > Using 1000 agents and 6000 frameworks > Added 6000 frameworks in 105957us > Added 1000 agents in 34.937438secs > allocate() took 27.408828secs to make 1000 offers with 1200 out of 6000 > frameworks suppressing offers > allocate() took 20.121897secs to make 1000 offers with 2400 out of 6000 > frameworks suppressing offers > allocate() took 12.964302secs to make 1000 offers with 3600 out of 6000 > frameworks suppressing offers > allocate() took 6.534221secs to make 1000 offers with 4800 out of 6000 > frameworks suppressing offers > allocate() took 8953us to make 0 offers with 6000 out of 6000 frameworks > suppressing offers > [ OK ] > SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7 > (106198 ms) > Mesos 1.3: > [ RUN ] > SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7 > Using 1000 agents and 6000 frameworks > Added 6000 frameworks in 1.036217secs > Added 1000 agents in 10.093938secs > allocate() took 10.629448secs to make 1000 offers with 1200 out of 6000 > frameworks suppressing offers > allocate() took 11.607185secs to make 1000 offers with 2400 out of 6000 > frameworks suppressing offers > allocate() took 12.896578secs to make 1000 offers with 3600 out of 6000 > frameworks suppressing offers > allocate() took 14.162431secs to make 1000 offers with 4800 out of 6000 > frameworks suppressing offers > allocate() took 257060us to make 0 offers with 6000 out of 6000 frameworks > suppressing offers > [ OK ] > SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7 > (64011 ms) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (MESOS-7521) Major performance regression in drf sorter
[
https://issues.apache.org/jira/browse/MESOS-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
James Peach updated MESOS-7521:
---
Description:
The addition of hierarchical roles to the framework sorter
(https://github.com/apache/mesos/commit/e5ef1992b2b8e84b5d1487f1578f18f2291cd082)
has introduced a major performance regression to 1.2. Suppressing offers for
frameworks does not seem to reduce allocation time anymore, like it used to in
1.2. Here are some relevant benchmark results:
Mesos 1.2:
{noformat}
[ RUN ]
SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
Using 1000 agents and 6000 frameworks
Added 6000 frameworks in 105957us
Added 1000 agents in 34.937438secs
allocate() took 27.408828secs to make 1000 offers with 1200 out of 6000
frameworks suppressing offers
allocate() took 20.121897secs to make 1000 offers with 2400 out of 6000
frameworks suppressing offers
allocate() took 12.964302secs to make 1000 offers with 3600 out of 6000
frameworks suppressing offers
allocate() took 6.534221secs to make 1000 offers with 4800 out of 6000
frameworks suppressing offers
allocate() took 8953us to make 0 offers with 6000 out of 6000 frameworks
suppressing offers
[ OK ]
SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
(106198 ms)
{noformat}
Mesos 1.3:
{noformat}
[ RUN ]
SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
Using 1000 agents and 6000 frameworks
Added 6000 frameworks in 1.036217secs
Added 1000 agents in 10.093938secs
allocate() took 10.629448secs to make 1000 offers with 1200 out of 6000
frameworks suppressing offers
allocate() took 11.607185secs to make 1000 offers with 2400 out of 6000
frameworks suppressing offers
allocate() took 12.896578secs to make 1000 offers with 3600 out of 6000
frameworks suppressing offers
allocate() took 14.162431secs to make 1000 offers with 4800 out of 6000
frameworks suppressing offers
allocate() took 257060us to make 0 offers with 6000 out of 6000 frameworks
suppressing offers
[ OK ]
SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
(64011 ms)
{noformat}
was:
The addition of hierarchical roles to the framework sorter
(https://github.com/apache/mesos/commit/e5ef1992b2b8e84b5d1487f1578f18f2291cd082)
has introduced a major performance regression to 1.2. Suppressing offers for
frameworks does not seem to reduce allocation time anymore, like it used to in
1.2. Here are some relevant benchmark results:
Mesos 1.2:
[ RUN ]
SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
Using 1000 agents and 6000 frameworks
Added 6000 frameworks in 105957us
Added 1000 agents in 34.937438secs
allocate() took 27.408828secs to make 1000 offers with 1200 out of 6000
frameworks suppressing offers
allocate() took 20.121897secs to make 1000 offers with 2400 out of 6000
frameworks suppressing offers
allocate() took 12.964302secs to make 1000 offers with 3600 out of 6000
frameworks suppressing offers
allocate() took 6.534221secs to make 1000 offers with 4800 out of 6000
frameworks suppressing offers
allocate() took 8953us to make 0 offers with 6000 out of 6000 frameworks
suppressing offers
[ OK ]
SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
(106198 ms)
Mesos 1.3:
[ RUN ]
SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
Using 1000 agents and 6000 frameworks
Added 6000 frameworks in 1.036217secs
Added 1000 agents in 10.093938secs
allocate() took 10.629448secs to make 1000 offers with 1200 out of 6000
frameworks suppressing offers
allocate() took 11.607185secs to make 1000 offers with 2400 out of 6000
frameworks suppressing offers
allocate() took 12.896578secs to make 1000 offers with 3600 out of 6000
frameworks suppressing offers
allocate() took 14.162431secs to make 1000 offers with 4800 out of 6000
frameworks suppressing offers
allocate() took 257060us to make 0 offers with 6000 out of 6000 frameworks
suppressing offers
[ OK ]
SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
(64011 ms)
> Major performance regression in drf sorter
> --
>
> Key: MESOS-7521
> URL: https://issues.apache.org/jira/browse/MESOS-7521
> Project: Mesos
> Issue Type: Bug
> Components: allocation
>Affects Versions: 1.3.0
>Reporter: Dario Rexin
>Priority: Blocker
> Labels: perfomance
>
> The addition of hierarchical roles to the framework sorter
> (https://github.com/apache/mesos/commit/e5ef1992b2b8e84b5d1487f1578f18f2291cd082)
> has introduced a major performance regression to 1.2. Suppressing offers for
> frameworks does not seem to reduce allocation time anymore, like it used to
> in 1.2. Here are some
[jira] [Updated] (MESOS-7521) Major performance regression in drf sorter
[
https://issues.apache.org/jira/browse/MESOS-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Adam B updated MESOS-7521:
--
Target Version/s: 1.3.0
> Major performance regression in drf sorter
> --
>
> Key: MESOS-7521
> URL: https://issues.apache.org/jira/browse/MESOS-7521
> Project: Mesos
> Issue Type: Bug
> Components: allocation
>Affects Versions: 1.3.0
>Reporter: Dario Rexin
>Assignee: Neil Conway
>Priority: Blocker
> Labels: perfomance
>
> The addition of hierarchical roles to the framework sorter
> (https://github.com/apache/mesos/commit/e5ef1992b2b8e84b5d1487f1578f18f2291cd082)
> has introduced a major performance regression to 1.2. Suppressing offers for
> frameworks does not seem to reduce allocation time anymore, like it used to
> in 1.2. Here are some relevant benchmark results:
> Mesos 1.2:
> {noformat}
> [ RUN ]
> SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
> Using 1000 agents and 6000 frameworks
> Added 6000 frameworks in 105957us
> Added 1000 agents in 34.937438secs
> allocate() took 27.408828secs to make 1000 offers with 1200 out of 6000
> frameworks suppressing offers
> allocate() took 20.121897secs to make 1000 offers with 2400 out of 6000
> frameworks suppressing offers
> allocate() took 12.964302secs to make 1000 offers with 3600 out of 6000
> frameworks suppressing offers
> allocate() took 6.534221secs to make 1000 offers with 4800 out of 6000
> frameworks suppressing offers
> allocate() took 8953us to make 0 offers with 6000 out of 6000 frameworks
> suppressing offers
> [ OK ]
> SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
> (106198 ms)
> {noformat}
> Mesos 1.3:
> {noformat}
> [ RUN ]
> SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
> Using 1000 agents and 6000 frameworks
> Added 6000 frameworks in 1.036217secs
> Added 1000 agents in 10.093938secs
> allocate() took 10.629448secs to make 1000 offers with 1200 out of 6000
> frameworks suppressing offers
> allocate() took 11.607185secs to make 1000 offers with 2400 out of 6000
> frameworks suppressing offers
> allocate() took 12.896578secs to make 1000 offers with 3600 out of 6000
> frameworks suppressing offers
> allocate() took 14.162431secs to make 1000 offers with 4800 out of 6000
> frameworks suppressing offers
> allocate() took 257060us to make 0 offers with 6000 out of 6000 frameworks
> suppressing offers
> [ OK ]
> SlaveAndFrameworkCount/HierarchicalAllocator_BENCHMARK_Test.SuppressOffers/7
> (64011 ms)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
