[
https://issues.apache.org/jira/browse/GEODE-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kamilla Aslami resolved GEODE-9847.
-----------------------------------
Resolution: Duplicate
Closing this ticket as there’s not enough evidence to think that this issue is
different from GEODE-9340. 1.14 and 1.15 haven’t diverged very far, so most
likely this is the same issue popping up in a different place.
> Benchmark instability in PartitionedPutLongBenchmark with security manager on
> support/1.14
> ------------------------------------------------------------------------------------------
>
> Key: GEODE-9847
> URL: https://issues.apache.org/jira/browse/GEODE-9847
> Project: Geode
> Issue Type: Bug
> Components: benchmarks
> Affects Versions: 1.14.1
> Reporter: Kamilla Aslami
> Priority: Major
>
> PartitionedPutLongBenchmark failed in
> apache-support-1-14-main/benchmark-with-security-manager. This issue could
> have the same root cause as GEODE-9340, but GEODE-9340 fails on 1.15 and in
> another CI job (apache-develop-main/benchmark-base).
> {noformat}
> org.apache.geode.benchmark.tests.PartitionedPutLongBenchmark
> 05:20:08 average ops/second Baseline: 381785.31 Test:
> 351135.20 Difference: -8.0%
> 05:20:08 ops/second standard error Baseline: 2163.90 Test:
> 3115.81 Difference: +44.0%
> 05:20:08 ops/second standard deviation Baseline: 37417.40 Test:
> 53877.38 Difference: +44.0%
> 05:20:08 YS 99th percentile latency Baseline: 1606.00 Test:
> 1606.00 Difference: +0.0%
> 05:20:08 median latency Baseline: 1068031.00 Test:
> 1065983.00 Difference: -0.2%
> 05:20:08 90th percentile latency Baseline: 1364991.00 Test:
> 1356799.00 Difference: -0.6%
> 05:20:08 99th percentile latency Baseline: 7688191.00 Test:
> 8138751.00 Difference: +5.9%
> 05:20:08 99.9th percentile latency Baseline: 209584127.00 Test:
> 260964351.00 Difference: +24.5%
> 05:20:08 average latency Baseline: 1884576.09 Test:
> 2050262.70 Difference: +8.8%
> 05:20:08 latency standard deviation Baseline: 11587055.57 Test:
> 14728140.58 Difference: +27.1%
> 05:20:08 latency standard error Baseline: 1083.17 Test:
> 1435.92 Difference: +32.6%
> 05:20:08 average ops/second Baseline: 381621.08 Test:
> 350789.84 Difference: -8.1%
> 05:20:08BENCHMARK FAILED:
> org.apache.geode.benchmark.tests.PartitionedPutLongBenchmark average latency
> is 5% worse than baseline.
> 05:20:08{noformat}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
