[jira] [Updated] (GEODE-9778) Benchmark degradation in RedisHsetBenchmark since netty bump
[ https://issues.apache.org/jira/browse/GEODE-9778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Murmann updated GEODE-9778: - Labels: needsTriage (was: ) > Benchmark degradation in RedisHsetBenchmark since netty bump > > > Key: GEODE-9778 > URL: https://issues.apache.org/jira/browse/GEODE-9778 > Project: Geode > Issue Type: Bug > Components: benchmarks, redis >Affects Versions: 1.15.0 >Reporter: Owen Nichols >Priority: Major > Labels: needsTriage > > examples: > [https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-radish/builds/179] > #179 seems to show a consistent 10-15% degradation in only in the Hset > benchmark > {noformat} > ... > This is ITERATION 3 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:234210.78 Test:207591.61 Difference: -11.4% > avg latency > Baseline: 3070166.30 Test: 3468289.49 Difference: +13.0% > This is ITERATION 4 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:238884.30 Test:216618.91 Difference: -9.3% > avg latency > Baseline: 3016750.52 Test: 3319615.79 Difference: +10.0% > This is ITERATION 5 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:248656.29 Test:211220.74 Difference: -15.1% > avg latency > Baseline: 2894368.00 Test: 3405200.04 Difference: +17.6% {noformat} > > Also > [https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-radish/builds/180] > shows similar results: > {noformat} > This is ITERATION 2 of benchmarking against baseline. > RedisHsetAndHgetBenchmark avg ops/sec > Baseline:146409.80 Test:134019.47 Difference: -8.5% > avg latency > Baseline: 4914049.28 Test: 5365514.18 Difference: +9.2% > RedisHsetBenchmark avg ops/sec > Baseline:217729.26 Test:191512.40 Difference: -12.0% > avg latency > Baseline: 3302672.13 Test: 3750731.05 Difference: +13.6% > This is ITERATION 3 of benchmarking against baseline. > RedisHsetAndHgetBenchmark avg ops/sec > Baseline:141960.20 Test:129616.40 Difference: -8.7% > avg latency > Baseline: 5065570.96 Test: 5554949.31 Difference: +9.7% > RedisHsetBenchmark avg ops/sec > Baseline:219985.85 Test:199572.01 Difference: -9.3% > avg latency > Baseline: 3268138.34 Test: 3603197.51 Difference: +10.3% > This is ITERATION 4 of benchmarking against baseline. > RedisHsetAndHgetBenchmark avg ops/sec > Baseline:140404.88 Test:134341.05 Difference: -4.3% > avg latency > Baseline: 5127629.59 Test: 5354599.94 Difference: +4.4% > RedisHsetBenchmark avg ops/sec > Baseline:224728.82 Test:194024.96 Difference: -13.7% > avg latency > Baseline: 3205365.68 Test: 3706058.86 Difference: +15.6% > This is ITERATION 5 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:220019.47 Test:192107.91 Difference: -12.7% > avg latency > Baseline: 3268273.76 Test: 3744842.51 Difference: +14.6% > {noformat} > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (GEODE-9778) Benchmark degradation in RedisHsetBenchmark since netty bump
[ https://issues.apache.org/jira/browse/GEODE-9778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated GEODE-9778: -- Labels: needsTriage pull-request-available (was: needsTriage) > Benchmark degradation in RedisHsetBenchmark since netty bump > > > Key: GEODE-9778 > URL: https://issues.apache.org/jira/browse/GEODE-9778 > Project: Geode > Issue Type: Bug > Components: benchmarks, redis >Affects Versions: 1.15.0 >Reporter: Owen Nichols >Assignee: Jens Deppe >Priority: Major > Labels: needsTriage, pull-request-available > > examples: > [https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-radish/builds/179] > #179 seems to show a consistent 10-15% degradation in only in the Hset > benchmark > {noformat} > ... > This is ITERATION 3 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:234210.78 Test:207591.61 Difference: -11.4% > avg latency > Baseline: 3070166.30 Test: 3468289.49 Difference: +13.0% > This is ITERATION 4 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:238884.30 Test:216618.91 Difference: -9.3% > avg latency > Baseline: 3016750.52 Test: 3319615.79 Difference: +10.0% > This is ITERATION 5 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:248656.29 Test:211220.74 Difference: -15.1% > avg latency > Baseline: 2894368.00 Test: 3405200.04 Difference: +17.6% {noformat} > > Also > [https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-radish/builds/180] > shows similar results: > {noformat} > This is ITERATION 2 of benchmarking against baseline. > RedisHsetAndHgetBenchmark avg ops/sec > Baseline:146409.80 Test:134019.47 Difference: -8.5% > avg latency > Baseline: 4914049.28 Test: 5365514.18 Difference: +9.2% > RedisHsetBenchmark avg ops/sec > Baseline:217729.26 Test:191512.40 Difference: -12.0% > avg latency > Baseline: 3302672.13 Test: 3750731.05 Difference: +13.6% > This is ITERATION 3 of benchmarking against baseline. > RedisHsetAndHgetBenchmark avg ops/sec > Baseline:141960.20 Test:129616.40 Difference: -8.7% > avg latency > Baseline: 5065570.96 Test: 5554949.31 Difference: +9.7% > RedisHsetBenchmark avg ops/sec > Baseline:219985.85 Test:199572.01 Difference: -9.3% > avg latency > Baseline: 3268138.34 Test: 3603197.51 Difference: +10.3% > This is ITERATION 4 of benchmarking against baseline. > RedisHsetAndHgetBenchmark avg ops/sec > Baseline:140404.88 Test:134341.05 Difference: -4.3% > avg latency > Baseline: 5127629.59 Test: 5354599.94 Difference: +4.4% > RedisHsetBenchmark avg ops/sec > Baseline:224728.82 Test:194024.96 Difference: -13.7% > avg latency > Baseline: 3205365.68 Test: 3706058.86 Difference: +15.6% > This is ITERATION 5 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:220019.47 Test:192107.91 Difference: -12.7% > avg latency > Baseline: 3268273.76 Test: 3744842.51 Difference: +14.6% > {noformat} > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (GEODE-9778) Benchmark degradation in RedisHsetBenchmark since netty bump
[ https://issues.apache.org/jira/browse/GEODE-9778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen Nichols updated GEODE-9778: Fix Version/s: 1.14.1 > Benchmark degradation in RedisHsetBenchmark since netty bump > > > Key: GEODE-9778 > URL: https://issues.apache.org/jira/browse/GEODE-9778 > Project: Geode > Issue Type: Bug > Components: benchmarks, redis >Affects Versions: 1.15.0 >Reporter: Owen Nichols >Assignee: Jens Deppe >Priority: Major > Labels: needsTriage, pull-request-available > Fix For: 1.14.1, 1.15.0 > > > examples: > [https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-radish/builds/179] > #179 seems to show a consistent 10-15% degradation in only in the Hset > benchmark > {noformat} > ... > This is ITERATION 3 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:234210.78 Test:207591.61 Difference: -11.4% > avg latency > Baseline: 3070166.30 Test: 3468289.49 Difference: +13.0% > This is ITERATION 4 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:238884.30 Test:216618.91 Difference: -9.3% > avg latency > Baseline: 3016750.52 Test: 3319615.79 Difference: +10.0% > This is ITERATION 5 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:248656.29 Test:211220.74 Difference: -15.1% > avg latency > Baseline: 2894368.00 Test: 3405200.04 Difference: +17.6% {noformat} > > Also > [https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-radish/builds/180] > shows similar results: > {noformat} > This is ITERATION 2 of benchmarking against baseline. > RedisHsetAndHgetBenchmark avg ops/sec > Baseline:146409.80 Test:134019.47 Difference: -8.5% > avg latency > Baseline: 4914049.28 Test: 5365514.18 Difference: +9.2% > RedisHsetBenchmark avg ops/sec > Baseline:217729.26 Test:191512.40 Difference: -12.0% > avg latency > Baseline: 3302672.13 Test: 3750731.05 Difference: +13.6% > This is ITERATION 3 of benchmarking against baseline. > RedisHsetAndHgetBenchmark avg ops/sec > Baseline:141960.20 Test:129616.40 Difference: -8.7% > avg latency > Baseline: 5065570.96 Test: 5554949.31 Difference: +9.7% > RedisHsetBenchmark avg ops/sec > Baseline:219985.85 Test:199572.01 Difference: -9.3% > avg latency > Baseline: 3268138.34 Test: 3603197.51 Difference: +10.3% > This is ITERATION 4 of benchmarking against baseline. > RedisHsetAndHgetBenchmark avg ops/sec > Baseline:140404.88 Test:134341.05 Difference: -4.3% > avg latency > Baseline: 5127629.59 Test: 5354599.94 Difference: +4.4% > RedisHsetBenchmark avg ops/sec > Baseline:224728.82 Test:194024.96 Difference: -13.7% > avg latency > Baseline: 3205365.68 Test: 3706058.86 Difference: +15.6% > This is ITERATION 5 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:220019.47 Test:192107.91 Difference: -12.7% > avg latency > Baseline: 3268273.76 Test: 3744842.51 Difference: +14.6% > {noformat} > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (GEODE-9778) Benchmark degradation in RedisHsetBenchmark since netty bump
[ https://issues.apache.org/jira/browse/GEODE-9778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hale Bales updated GEODE-9778: -- Labels: pull-request-available (was: needsTriage pull-request-available) > Benchmark degradation in RedisHsetBenchmark since netty bump > > > Key: GEODE-9778 > URL: https://issues.apache.org/jira/browse/GEODE-9778 > Project: Geode > Issue Type: Bug > Components: benchmarks, redis >Affects Versions: 1.15.0 >Reporter: Owen Nichols >Assignee: Jens Deppe >Priority: Major > Labels: pull-request-available > Fix For: 1.14.1, 1.15.0 > > > examples: > [https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-radish/builds/179] > #179 seems to show a consistent 10-15% degradation in only in the Hset > benchmark > {noformat} > ... > This is ITERATION 3 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:234210.78 Test:207591.61 Difference: -11.4% > avg latency > Baseline: 3070166.30 Test: 3468289.49 Difference: +13.0% > This is ITERATION 4 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:238884.30 Test:216618.91 Difference: -9.3% > avg latency > Baseline: 3016750.52 Test: 3319615.79 Difference: +10.0% > This is ITERATION 5 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:248656.29 Test:211220.74 Difference: -15.1% > avg latency > Baseline: 2894368.00 Test: 3405200.04 Difference: +17.6% {noformat} > > Also > [https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-radish/builds/180] > shows similar results: > {noformat} > This is ITERATION 2 of benchmarking against baseline. > RedisHsetAndHgetBenchmark avg ops/sec > Baseline:146409.80 Test:134019.47 Difference: -8.5% > avg latency > Baseline: 4914049.28 Test: 5365514.18 Difference: +9.2% > RedisHsetBenchmark avg ops/sec > Baseline:217729.26 Test:191512.40 Difference: -12.0% > avg latency > Baseline: 3302672.13 Test: 3750731.05 Difference: +13.6% > This is ITERATION 3 of benchmarking against baseline. > RedisHsetAndHgetBenchmark avg ops/sec > Baseline:141960.20 Test:129616.40 Difference: -8.7% > avg latency > Baseline: 5065570.96 Test: 5554949.31 Difference: +9.7% > RedisHsetBenchmark avg ops/sec > Baseline:219985.85 Test:199572.01 Difference: -9.3% > avg latency > Baseline: 3268138.34 Test: 3603197.51 Difference: +10.3% > This is ITERATION 4 of benchmarking against baseline. > RedisHsetAndHgetBenchmark avg ops/sec > Baseline:140404.88 Test:134341.05 Difference: -4.3% > avg latency > Baseline: 5127629.59 Test: 5354599.94 Difference: +4.4% > RedisHsetBenchmark avg ops/sec > Baseline:224728.82 Test:194024.96 Difference: -13.7% > avg latency > Baseline: 3205365.68 Test: 3706058.86 Difference: +15.6% > This is ITERATION 5 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:220019.47 Test:192107.91 Difference: -12.7% > avg latency > Baseline: 3268273.76 Test: 3744842.51 Difference: +14.6% > {noformat} > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (GEODE-9778) Benchmark degradation in RedisHsetBenchmark since netty bump
[ https://issues.apache.org/jira/browse/GEODE-9778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anthony Baker updated GEODE-9778: - Labels: pull-request-available testing unreleased (was: pull-request-available unreleased) > Benchmark degradation in RedisHsetBenchmark since netty bump > > > Key: GEODE-9778 > URL: https://issues.apache.org/jira/browse/GEODE-9778 > Project: Geode > Issue Type: Bug > Components: benchmarks, redis >Affects Versions: 1.15.0 >Reporter: Owen Nichols >Assignee: Jens Deppe >Priority: Major > Labels: pull-request-available, testing, unreleased > Fix For: 1.14.1, 1.15.0 > > > examples: > [https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-radish/builds/179] > #179 seems to show a consistent 10-15% degradation in only in the Hset > benchmark > {noformat} > ... > This is ITERATION 3 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:234210.78 Test:207591.61 Difference: -11.4% > avg latency > Baseline: 3070166.30 Test: 3468289.49 Difference: +13.0% > This is ITERATION 4 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:238884.30 Test:216618.91 Difference: -9.3% > avg latency > Baseline: 3016750.52 Test: 3319615.79 Difference: +10.0% > This is ITERATION 5 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:248656.29 Test:211220.74 Difference: -15.1% > avg latency > Baseline: 2894368.00 Test: 3405200.04 Difference: +17.6% {noformat} > > Also > [https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-radish/builds/180] > shows similar results: > {noformat} > This is ITERATION 2 of benchmarking against baseline. > RedisHsetAndHgetBenchmark avg ops/sec > Baseline:146409.80 Test:134019.47 Difference: -8.5% > avg latency > Baseline: 4914049.28 Test: 5365514.18 Difference: +9.2% > RedisHsetBenchmark avg ops/sec > Baseline:217729.26 Test:191512.40 Difference: -12.0% > avg latency > Baseline: 3302672.13 Test: 3750731.05 Difference: +13.6% > This is ITERATION 3 of benchmarking against baseline. > RedisHsetAndHgetBenchmark avg ops/sec > Baseline:141960.20 Test:129616.40 Difference: -8.7% > avg latency > Baseline: 5065570.96 Test: 5554949.31 Difference: +9.7% > RedisHsetBenchmark avg ops/sec > Baseline:219985.85 Test:199572.01 Difference: -9.3% > avg latency > Baseline: 3268138.34 Test: 3603197.51 Difference: +10.3% > This is ITERATION 4 of benchmarking against baseline. > RedisHsetAndHgetBenchmark avg ops/sec > Baseline:140404.88 Test:134341.05 Difference: -4.3% > avg latency > Baseline: 5127629.59 Test: 5354599.94 Difference: +4.4% > RedisHsetBenchmark avg ops/sec > Baseline:224728.82 Test:194024.96 Difference: -13.7% > avg latency > Baseline: 3205365.68 Test: 3706058.86 Difference: +15.6% > This is ITERATION 5 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:220019.47 Test:192107.91 Difference: -12.7% > avg latency > Baseline: 3268273.76 Test: 3744842.51 Difference: +14.6% > {noformat} > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (GEODE-9778) Benchmark degradation in RedisHsetBenchmark since netty bump
[ https://issues.apache.org/jira/browse/GEODE-9778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anthony Baker updated GEODE-9778: - Labels: pull-request-available unreleased (was: pull-request-available) > Benchmark degradation in RedisHsetBenchmark since netty bump > > > Key: GEODE-9778 > URL: https://issues.apache.org/jira/browse/GEODE-9778 > Project: Geode > Issue Type: Bug > Components: benchmarks, redis >Affects Versions: 1.15.0 >Reporter: Owen Nichols >Assignee: Jens Deppe >Priority: Major > Labels: pull-request-available, unreleased > Fix For: 1.14.1, 1.15.0 > > > examples: > [https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-radish/builds/179] > #179 seems to show a consistent 10-15% degradation in only in the Hset > benchmark > {noformat} > ... > This is ITERATION 3 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:234210.78 Test:207591.61 Difference: -11.4% > avg latency > Baseline: 3070166.30 Test: 3468289.49 Difference: +13.0% > This is ITERATION 4 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:238884.30 Test:216618.91 Difference: -9.3% > avg latency > Baseline: 3016750.52 Test: 3319615.79 Difference: +10.0% > This is ITERATION 5 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:248656.29 Test:211220.74 Difference: -15.1% > avg latency > Baseline: 2894368.00 Test: 3405200.04 Difference: +17.6% {noformat} > > Also > [https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-radish/builds/180] > shows similar results: > {noformat} > This is ITERATION 2 of benchmarking against baseline. > RedisHsetAndHgetBenchmark avg ops/sec > Baseline:146409.80 Test:134019.47 Difference: -8.5% > avg latency > Baseline: 4914049.28 Test: 5365514.18 Difference: +9.2% > RedisHsetBenchmark avg ops/sec > Baseline:217729.26 Test:191512.40 Difference: -12.0% > avg latency > Baseline: 3302672.13 Test: 3750731.05 Difference: +13.6% > This is ITERATION 3 of benchmarking against baseline. > RedisHsetAndHgetBenchmark avg ops/sec > Baseline:141960.20 Test:129616.40 Difference: -8.7% > avg latency > Baseline: 5065570.96 Test: 5554949.31 Difference: +9.7% > RedisHsetBenchmark avg ops/sec > Baseline:219985.85 Test:199572.01 Difference: -9.3% > avg latency > Baseline: 3268138.34 Test: 3603197.51 Difference: +10.3% > This is ITERATION 4 of benchmarking against baseline. > RedisHsetAndHgetBenchmark avg ops/sec > Baseline:140404.88 Test:134341.05 Difference: -4.3% > avg latency > Baseline: 5127629.59 Test: 5354599.94 Difference: +4.4% > RedisHsetBenchmark avg ops/sec > Baseline:224728.82 Test:194024.96 Difference: -13.7% > avg latency > Baseline: 3205365.68 Test: 3706058.86 Difference: +15.6% > This is ITERATION 5 of benchmarking against baseline. > RedisHsetBenchmark avg ops/sec > Baseline:220019.47 Test:192107.91 Difference: -12.7% > avg latency > Baseline: 3268273.76 Test: 3744842.51 Difference: +14.6% > {noformat} > -- This message was sent by Atlassian Jira (v8.20.1#820001)