[ https://issues.apache.org/jira/browse/GEODE-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alexander Murmann reassigned GEODE-9847: ---------------------------------------- Assignee: Kamilla Aslami > Benchmark instability in PartitionedPutLongBenchmark with security manager on > support/1.14 > ------------------------------------------------------------------------------------------ > > Key: GEODE-9847 > URL: https://issues.apache.org/jira/browse/GEODE-9847 > Project: Geode > Issue Type: Bug > Components: benchmarks > Affects Versions: 1.14.1 > Reporter: Kamilla Aslami > Assignee: Kamilla Aslami > Priority: Major > > PartitionedPutLongBenchmark failed in > apache-support-1-14-main/benchmark-with-security-manager. This issue could > have the same root cause as GEODE-9340, but GEODE-9340 fails on 1.15 and in > another CI job (apache-develop-main/benchmark-base). > {noformat} > org.apache.geode.benchmark.tests.PartitionedPutLongBenchmark > 05:20:08 average ops/second Baseline: 381785.31 Test: > 351135.20 Difference: -8.0% > 05:20:08 ops/second standard error Baseline: 2163.90 Test: > 3115.81 Difference: +44.0% > 05:20:08 ops/second standard deviation Baseline: 37417.40 Test: > 53877.38 Difference: +44.0% > 05:20:08 YS 99th percentile latency Baseline: 1606.00 Test: > 1606.00 Difference: +0.0% > 05:20:08 median latency Baseline: 1068031.00 Test: > 1065983.00 Difference: -0.2% > 05:20:08 90th percentile latency Baseline: 1364991.00 Test: > 1356799.00 Difference: -0.6% > 05:20:08 99th percentile latency Baseline: 7688191.00 Test: > 8138751.00 Difference: +5.9% > 05:20:08 99.9th percentile latency Baseline: 209584127.00 Test: > 260964351.00 Difference: +24.5% > 05:20:08 average latency Baseline: 1884576.09 Test: > 2050262.70 Difference: +8.8% > 05:20:08 latency standard deviation Baseline: 11587055.57 Test: > 14728140.58 Difference: +27.1% > 05:20:08 latency standard error Baseline: 1083.17 Test: > 1435.92 Difference: +32.6% > 05:20:08 average ops/second Baseline: 381621.08 Test: > 350789.84 Difference: -8.1% > 05:20:08BENCHMARK FAILED: > org.apache.geode.benchmark.tests.PartitionedPutLongBenchmark average latency > is 5% worse than baseline. > 05:20:08{noformat} -- This message was sent by Atlassian Jira (v8.20.1#820001)