[jira] [Updated] (GEODE-9641) Benchmark instability in P2pPartitionedPutBytesBenchmark

2022-02-08 Thread Anthony Baker (Jira)


 [ 
https://issues.apache.org/jira/browse/GEODE-9641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anthony Baker updated GEODE-9641:
-
Labels: pull-request-available testing  (was: pull-request-available)

> Benchmark instability in P2pPartitionedPutBytesBenchmark
> 
>
> Key: GEODE-9641
> URL: https://issues.apache.org/jira/browse/GEODE-9641
> Project: Geode
>  Issue Type: Bug
>  Components: membership
>Reporter: Kamilla Aslami
>Assignee: Kamilla Aslami
>Priority: Major
>  Labels: pull-request-available, testing
> Fix For: 1.15.0
>
>
> P2pPartitionedPutBytesBenchmark started failing in CI after the fix for 
> GEODE-9204 was merged.
> {code:java}
> org.apache.geode.benchmark.tests.P2pPartitionedPutBytesBenchmark
>   average ops/second  Baseline:179582.83  Test:170268.31  
> Difference:   -5.2%
>ops/second standard error  Baseline:   849.15  Test:   649.44  
> Difference:  -23.5%
>ops/second standard deviation  Baseline: 25346.86  Test: 19374.76  
> Difference:  -23.6%
>   YS 99th percentile latency  Baseline:  5010.00  Test:  5110.00  
> Difference:   +2.0%
>   median latency  Baseline:   2416639.00  Test:   2412543.00  
> Difference:   -0.2%
>  90th percentile latency  Baseline:   4698111.00  Test:   4567039.00  
> Difference:   -2.8%
>  99th percentile latency  Baseline:  38141951.00  Test:  81723391.00  
> Difference: +114.3%
>99.9th percentile latency  Baseline: 196214783.00  Test: 205389823.00  
> Difference:   +4.7%
>  average latency  Baseline:   4033453.68  Test:   4258029.39  
> Difference:   +5.6%
>   latency standard deviation  Baseline:  14549153.77  Test:  15673393.37  
> Difference:   +7.7%
>   latency standard error  Baseline:  1149.00  Test:  1271.79  
> Difference:  +10.7%
>   average ops/second  Baseline:533863.27  Test:505986.13  
> Difference:   -5.2%
> BENCHMARK FAILED: 
> org.apache.geode.benchmark.tests.P2pPartitionedPutBytesBenchmark average 
> latency is 5% worse than baseline.{code}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (GEODE-9641) Benchmark instability in P2pPartitionedPutBytesBenchmark

2022-01-20 Thread Hale Bales (Jira)


 [ 
https://issues.apache.org/jira/browse/GEODE-9641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hale Bales updated GEODE-9641:
--
Labels: pull-request-available  (was: needsTriage pull-request-available)

> Benchmark instability in P2pPartitionedPutBytesBenchmark
> 
>
> Key: GEODE-9641
> URL: https://issues.apache.org/jira/browse/GEODE-9641
> Project: Geode
>  Issue Type: Bug
>  Components: membership
>Reporter: Kamilla Aslami
>Assignee: Kamilla Aslami
>Priority: Major
>  Labels: pull-request-available
> Fix For: 1.15.0
>
>
> P2pPartitionedPutBytesBenchmark started failing in CI after the fix for 
> GEODE-9204 was merged.
> {code:java}
> org.apache.geode.benchmark.tests.P2pPartitionedPutBytesBenchmark
>   average ops/second  Baseline:179582.83  Test:170268.31  
> Difference:   -5.2%
>ops/second standard error  Baseline:   849.15  Test:   649.44  
> Difference:  -23.5%
>ops/second standard deviation  Baseline: 25346.86  Test: 19374.76  
> Difference:  -23.6%
>   YS 99th percentile latency  Baseline:  5010.00  Test:  5110.00  
> Difference:   +2.0%
>   median latency  Baseline:   2416639.00  Test:   2412543.00  
> Difference:   -0.2%
>  90th percentile latency  Baseline:   4698111.00  Test:   4567039.00  
> Difference:   -2.8%
>  99th percentile latency  Baseline:  38141951.00  Test:  81723391.00  
> Difference: +114.3%
>99.9th percentile latency  Baseline: 196214783.00  Test: 205389823.00  
> Difference:   +4.7%
>  average latency  Baseline:   4033453.68  Test:   4258029.39  
> Difference:   +5.6%
>   latency standard deviation  Baseline:  14549153.77  Test:  15673393.37  
> Difference:   +7.7%
>   latency standard error  Baseline:  1149.00  Test:  1271.79  
> Difference:  +10.7%
>   average ops/second  Baseline:533863.27  Test:505986.13  
> Difference:   -5.2%
> BENCHMARK FAILED: 
> org.apache.geode.benchmark.tests.P2pPartitionedPutBytesBenchmark average 
> latency is 5% worse than baseline.{code}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (GEODE-9641) Benchmark instability in P2pPartitionedPutBytesBenchmark

2021-10-06 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/GEODE-9641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated GEODE-9641:
--
Labels: needsTriage pull-request-available  (was: needsTriage)

> Benchmark instability in P2pPartitionedPutBytesBenchmark
> 
>
> Key: GEODE-9641
> URL: https://issues.apache.org/jira/browse/GEODE-9641
> Project: Geode
>  Issue Type: Bug
>  Components: membership
>Reporter: Kamilla Aslami
>Assignee: Kamilla Aslami
>Priority: Major
>  Labels: needsTriage, pull-request-available
>
> P2pPartitionedPutBytesBenchmark started failing in CI after the fix for 
> GEODE-9204 was merged.
> {code:java}
> org.apache.geode.benchmark.tests.P2pPartitionedPutBytesBenchmark
>   average ops/second  Baseline:179582.83  Test:170268.31  
> Difference:   -5.2%
>ops/second standard error  Baseline:   849.15  Test:   649.44  
> Difference:  -23.5%
>ops/second standard deviation  Baseline: 25346.86  Test: 19374.76  
> Difference:  -23.6%
>   YS 99th percentile latency  Baseline:  5010.00  Test:  5110.00  
> Difference:   +2.0%
>   median latency  Baseline:   2416639.00  Test:   2412543.00  
> Difference:   -0.2%
>  90th percentile latency  Baseline:   4698111.00  Test:   4567039.00  
> Difference:   -2.8%
>  99th percentile latency  Baseline:  38141951.00  Test:  81723391.00  
> Difference: +114.3%
>99.9th percentile latency  Baseline: 196214783.00  Test: 205389823.00  
> Difference:   +4.7%
>  average latency  Baseline:   4033453.68  Test:   4258029.39  
> Difference:   +5.6%
>   latency standard deviation  Baseline:  14549153.77  Test:  15673393.37  
> Difference:   +7.7%
>   latency standard error  Baseline:  1149.00  Test:  1271.79  
> Difference:  +10.7%
>   average ops/second  Baseline:533863.27  Test:505986.13  
> Difference:   -5.2%
> BENCHMARK FAILED: 
> org.apache.geode.benchmark.tests.P2pPartitionedPutBytesBenchmark average 
> latency is 5% worse than baseline.{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (GEODE-9641) Benchmark instability in P2pPartitionedPutBytesBenchmark

2021-09-24 Thread Alexander Murmann (Jira)


 [ 
https://issues.apache.org/jira/browse/GEODE-9641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alexander Murmann updated GEODE-9641:
-
Labels: needsTriage  (was: )

> Benchmark instability in P2pPartitionedPutBytesBenchmark
> 
>
> Key: GEODE-9641
> URL: https://issues.apache.org/jira/browse/GEODE-9641
> Project: Geode
>  Issue Type: Bug
>  Components: membership
>Reporter: Kamilla Aslami
>Priority: Major
>  Labels: needsTriage
>
> P2pPartitionedPutBytesBenchmark started failing in CI after the fix for 
> GEODE-9204 was merged.
> {code:java}
> org.apache.geode.benchmark.tests.P2pPartitionedPutBytesBenchmark
>   average ops/second  Baseline:179582.83  Test:170268.31  
> Difference:   -5.2%
>ops/second standard error  Baseline:   849.15  Test:   649.44  
> Difference:  -23.5%
>ops/second standard deviation  Baseline: 25346.86  Test: 19374.76  
> Difference:  -23.6%
>   YS 99th percentile latency  Baseline:  5010.00  Test:  5110.00  
> Difference:   +2.0%
>   median latency  Baseline:   2416639.00  Test:   2412543.00  
> Difference:   -0.2%
>  90th percentile latency  Baseline:   4698111.00  Test:   4567039.00  
> Difference:   -2.8%
>  99th percentile latency  Baseline:  38141951.00  Test:  81723391.00  
> Difference: +114.3%
>99.9th percentile latency  Baseline: 196214783.00  Test: 205389823.00  
> Difference:   +4.7%
>  average latency  Baseline:   4033453.68  Test:   4258029.39  
> Difference:   +5.6%
>   latency standard deviation  Baseline:  14549153.77  Test:  15673393.37  
> Difference:   +7.7%
>   latency standard error  Baseline:  1149.00  Test:  1271.79  
> Difference:  +10.7%
>   average ops/second  Baseline:533863.27  Test:505986.13  
> Difference:   -5.2%
> BENCHMARK FAILED: 
> org.apache.geode.benchmark.tests.P2pPartitionedPutBytesBenchmark average 
> latency is 5% worse than baseline.{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)