Kamilla Aslami created GEODE-9847:
-------------------------------------
Summary: Benchmark instability in PartitionedPutLongBenchmark with
security manager on support/1.14
Key: GEODE-9847
URL: https://issues.apache.org/jira/browse/GEODE-9847
Project: Geode
Issue Type: Bug
Components: benchmarks
Affects Versions: 1.14.1
Reporter: Kamilla Aslami
PartitionedPutLongBenchmark failed in
apache-support-1-14-main/benchmark-with-security-manager. This issue could have
the same root cause as GEODE-9340, but GEODE-9340 fails on 1.15 and in another
CI job (apache-develop-main/benchmark-base).
{noformat}
org.apache.geode.benchmark.tests.PartitionedPutLongBenchmark
05:20:08 average ops/second Baseline: 381785.31 Test:
351135.20 Difference: -8.0%
05:20:08 ops/second standard error Baseline: 2163.90 Test:
3115.81 Difference: +44.0%
05:20:08 ops/second standard deviation Baseline: 37417.40 Test:
53877.38 Difference: +44.0%
05:20:08 YS 99th percentile latency Baseline: 1606.00 Test:
1606.00 Difference: +0.0%
05:20:08 median latency Baseline: 1068031.00 Test:
1065983.00 Difference: -0.2%
05:20:08 90th percentile latency Baseline: 1364991.00 Test:
1356799.00 Difference: -0.6%
05:20:08 99th percentile latency Baseline: 7688191.00 Test:
8138751.00 Difference: +5.9%
05:20:08 99.9th percentile latency Baseline: 209584127.00 Test:
260964351.00 Difference: +24.5%
05:20:08 average latency Baseline: 1884576.09 Test:
2050262.70 Difference: +8.8%
05:20:08 latency standard deviation Baseline: 11587055.57 Test:
14728140.58 Difference: +27.1%
05:20:08 latency standard error Baseline: 1083.17 Test:
1435.92 Difference: +32.6%
05:20:08 average ops/second Baseline: 381621.08 Test:
350789.84 Difference: -8.1%
05:20:08BENCHMARK FAILED:
org.apache.geode.benchmark.tests.PartitionedPutLongBenchmark average latency is
5% worse than baseline.
05:20:08{noformat}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
