Kamilla Aslami created GEODE-9847: ------------------------------------- Summary: Benchmark instability in PartitionedPutLongBenchmark with security manager on support/1.14 Key: GEODE-9847 URL: https://issues.apache.org/jira/browse/GEODE-9847 Project: Geode Issue Type: Bug Components: benchmarks Affects Versions: 1.14.1 Reporter: Kamilla Aslami
PartitionedPutLongBenchmark failed in apache-support-1-14-main/benchmark-with-security-manager. This issue could have the same root cause as GEODE-9340, but GEODE-9340 fails on 1.15 and in another CI job (apache-develop-main/benchmark-base). {noformat} org.apache.geode.benchmark.tests.PartitionedPutLongBenchmark 05:20:08 average ops/second Baseline: 381785.31 Test: 351135.20 Difference: -8.0% 05:20:08 ops/second standard error Baseline: 2163.90 Test: 3115.81 Difference: +44.0% 05:20:08 ops/second standard deviation Baseline: 37417.40 Test: 53877.38 Difference: +44.0% 05:20:08 YS 99th percentile latency Baseline: 1606.00 Test: 1606.00 Difference: +0.0% 05:20:08 median latency Baseline: 1068031.00 Test: 1065983.00 Difference: -0.2% 05:20:08 90th percentile latency Baseline: 1364991.00 Test: 1356799.00 Difference: -0.6% 05:20:08 99th percentile latency Baseline: 7688191.00 Test: 8138751.00 Difference: +5.9% 05:20:08 99.9th percentile latency Baseline: 209584127.00 Test: 260964351.00 Difference: +24.5% 05:20:08 average latency Baseline: 1884576.09 Test: 2050262.70 Difference: +8.8% 05:20:08 latency standard deviation Baseline: 11587055.57 Test: 14728140.58 Difference: +27.1% 05:20:08 latency standard error Baseline: 1083.17 Test: 1435.92 Difference: +32.6% 05:20:08 average ops/second Baseline: 381621.08 Test: 350789.84 Difference: -8.1% 05:20:08BENCHMARK FAILED: org.apache.geode.benchmark.tests.PartitionedPutLongBenchmark average latency is 5% worse than baseline. 05:20:08{noformat} -- This message was sent by Atlassian Jira (v8.20.1#820001)