subject:"\[jira\] \[Commented\] \(GEODE\-9302\) Benchmark instability in PartitionedPutStringBenchmark"

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2022-01-18 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478085#comment-17478085
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#97|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/97].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-11-23 Thread Donal Evans (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17448250#comment-17448250
 ] 

Donal Evans commented on GEODE-9302:


Failures of this benchmark are due to the test being overly sensitive to minor 
changes in performance, particularly those related to memory. The failure 
threshold for benchmarks should probably be adjusted on a per-test basis so 
that overly sensitive tests don't produce false positives.

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>  Labels: needsTriage
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Dif

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-10-14 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17428856#comment-17428856
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#277|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/277].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>  Labels: needsTriage
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.7

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-10-07 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17425810#comment-17425810
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#250|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/250].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>  Labels: needsTriage
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.7

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-10-01 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423444#comment-17423444
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#235|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/235].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-10-01 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423351#comment-17423351
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#230|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/230].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-10-01 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423352#comment-17423352
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#231|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/231].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-10-01 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423354#comment-17423354
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#229|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/229].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-10-01 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423348#comment-17423348
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#234|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/234].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-09-30 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17422886#comment-17422886
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#227|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/227].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-09-30 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17422881#comment-17422881
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#226|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/226].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-09-30 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17422879#comment-17422879
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#225|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/225].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-09-30 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17422877#comment-17422877
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#223|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/223].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-09-30 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17422875#comment-17422875
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#222|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/222].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-09-29 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17422166#comment-17422166
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#220|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/220].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-09-28 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421857#comment-17421857
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#219|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/219].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-09-27 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421076#comment-17421076
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#211|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/211].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-09-27 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421073#comment-17421073
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#215|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/215].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-09-22 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418589#comment-17418589
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#205|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/205].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-09-16 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17416187#comment-17416187
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#189|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/189].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-09-14 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415043#comment-17415043
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#183|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/183].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-09-10 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413386#comment-17413386
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#175|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/175].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-09-10 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413385#comment-17413385
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#177|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/177].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-08-30 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17406950#comment-17406950
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#153|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/153].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-08-27 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17406108#comment-17406108
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#149|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/149].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-08-19 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402065#comment-17402065
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#132|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/132].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-08-19 Thread Ray Ingles (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17401795#comment-17401795
 ] 

Ray Ingles commented on GEODE-9302:
---

(Note that for [benchmark-base 
#128|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/128],
 there may have been other issues with this run.) 

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-08-19 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17401750#comment-17401750
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#128|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/128].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-08-11 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397540#comment-17397540
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#110|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/110].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-08-11 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397539#comment-17397539
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#111|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/111].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-07-28 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17389204#comment-17389204
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#102|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/102].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-07-28 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17388839#comment-17388839
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#99|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/99].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-07-22 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385790#comment-17385790
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [benchmark-base 
#92|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/92].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

2021-05-24 Thread Geode Integration (Jira)



[ 
https://issues.apache.org/jira/browse/GEODE-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17350600#comment-17350600
 ] 

Geode Integration commented on GEODE-9302:
--

Seen in [Benchmark_base 
#234|https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark_base/builds/234].

> Benchmark instability in PartitionedPutStringBenchmark
> --
>
> Key: GEODE-9302
> URL: https://issues.apache.org/jira/browse/GEODE-9302
> Project: Geode
>  Issue Type: Bug
>  Components: benchmarks
>Affects Versions: 1.15.0
>Reporter: Donal Evans
>Priority: Major
>
> A benchmark failure due to the recently-introduced 
> PartitionedPutStringBenchmark was observed:
> {noformat}
> This is ITERATION 1 of benchmarking against baseline.
>   P2pPartitionedGetBenchmark avg ops/sec  
> Baseline:853001.60  Test:867151.67  Difference:   +1.7%
>  avg latency  
> Baseline:842007.55  Test:828545.06  Difference:   -1.6%
>   P2pPartitionedPutBenchmark avg ops/sec  
> Baseline:128283.47  Test:126510.92  Difference:   -1.4%
>  avg latency  
> Baseline:   5785619.62  Test:   5915913.49  Difference:   +2.3%
>  P2pPartitionedPutBytesBenchmark avg ops/sec  
> Baseline:175658.08  Test:174865.97  Difference:   -0.5%
>  avg latency  
> Baseline:   4130071.43  Test:   4130753.09  Difference:   +0.0%
>PartitionedFunctionExecutionBenchmark avg ops/sec  
> Baseline:254788.26  Test:268132.99  Difference:   +5.2%
>  avg latency  
> Baseline:846158.41  Test:804199.42  Difference:   -5.0%
>   PartitionedFunctionExecutionWithArgumentsBenchmark avg ops/sec  
> Baseline:278669.87  Test:281504.58  Difference:   +1.0%
>  avg latency  
> Baseline:   1031826.82  Test:   1021314.54  Difference:   -1.0%
> PartitionedFunctionExecutionWithFiltersBenchmark avg ops/sec  
> Baseline:372204.82  Test:348815.81  Difference:   -6.3%
>  avg latency  
> Baseline:   1545217.38  Test:   1649706.37  Difference:   +6.8%
>  PartitionedGetBenchmark avg ops/sec  
> Baseline:823740.09  Test:819044.99  Difference:   -0.6%
>  avg latency  
> Baseline:872172.75  Test:877580.02  Difference:   +0.6%
>  PartitionedGetLongBenchmark avg ops/sec  
> Baseline:   1047221.43  Test:   1045565.89  Difference:   -0.2%
>  avg latency  
> Baseline:685757.55  Test:687005.43  Difference:   +0.2%
>PartitionedGetStringBenchmark avg ops/sec  
> Baseline:   1055904.14  Test:   1045420.73  Difference:   -1.0%
>  avg latency  
> Baseline:680031.44  Test:687045.15  Difference:   +1.0%
> PartitionedIndexedQueryBenchmark avg ops/sec  
> Baseline: 31596.35  Test: 31653.48  Difference:   +0.2%
>  avg latency  
> Baseline:  18221302.10  Test:  18216097.86  Difference:   -0.0%
>  PartitionedNonIndexedQueryBenchmark avg ops/sec  
> Baseline:95.78  Test:   100.35  Difference:   +4.8%
>  avg latency  
> Baseline: 750871203.78  Test: 716853923.95  Difference:   -4.5%
>   PartitionedPutAllBenchmark avg ops/sec  
> Baseline:  8675.75  Test:  8628.10  Difference:   -0.5%
>  avg latency  
> Baseline:  16595044.73  Test:  16685258.91  Difference:   +0.5%
>   PartitionedPutAllLongBenchmark avg ops/sec  
> Baseline:  1382.38  Test:  1380.50  Difference:   -0.1%
>  avg latency  
> Baseline: 104866853.92  Test: 104775538.34  Difference:   -0.1%
>  PartitionedPutBenchmark avg ops/sec  
> Baseline:491790.40  Test:479926.75  Difference:   -2.4%
>  avg latency  
> Baseline:   1461947.23  Test:   1497519.77  Difference:   +2.4%
>

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

[jira] [Commented] (GEODE-9302) Benchmark instability in PartitionedPutStringBenchmark

34 matches

Site Navigation

Mail list logo

Footer information