This is an automated email from the ASF dual-hosted git repository.
srowen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new bee8187d731 [SPARK-43495][BUILD] Upgrade RoaringBitmap to 0.9.44
bee8187d731 is described below
commit bee8187d7319ededf82701b4fd2a2928cd56c7f8
Author: yangjie01 <yangji...@baidu.com>
AuthorDate: Mon May 15 08:46:20 2023 -0500
[SPARK-43495][BUILD] Upgrade RoaringBitmap to 0.9.44
### What changes were proposed in this pull request?
This pr aims upgrade `RoaringBitmap` from 0.9.39 to 0.9.44.
### Why are the changes needed?
The new version brings 2 bug fix:
- https://github.com/RoaringBitmap/RoaringBitmap/issues/619 |
https://github.com/RoaringBitmap/RoaringBitmap/pull/620
- https://github.com/RoaringBitmap/RoaringBitmap/issues/623 |
https://github.com/RoaringBitmap/RoaringBitmap/pull/624
The full release notes as follows:
- https://github.com/RoaringBitmap/RoaringBitmap/releases/tag/0.9.40
- https://github.com/RoaringBitmap/RoaringBitmap/releases/tag/0.9.41
- https://github.com/RoaringBitmap/RoaringBitmap/releases/tag/0.9.44
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Pass GitHub Actions
Closes #41165 from LuciferYang/SPARK-43495.
Authored-by: yangjie01 <yangji...@baidu.com>
Signed-off-by: Sean Owen <sro...@gmail.com>
---
core/benchmarks/MapStatusesConvertBenchmark-jdk11-results.txt | 10 +++++-----
core/benchmarks/MapStatusesConvertBenchmark-jdk17-results.txt | 10 +++++-----
core/benchmarks/MapStatusesConvertBenchmark-results.txt | 10 +++++-----
dev/deps/spark-deps-hadoop-3-hive-2.3 | 4 ++--
pom.xml | 2 +-
5 files changed, 18 insertions(+), 18 deletions(-)
diff --git a/core/benchmarks/MapStatusesConvertBenchmark-jdk11-results.txt
b/core/benchmarks/MapStatusesConvertBenchmark-jdk11-results.txt
index ef9dd139ff2..f42b95e8d4c 100644
--- a/core/benchmarks/MapStatusesConvertBenchmark-jdk11-results.txt
+++ b/core/benchmarks/MapStatusesConvertBenchmark-jdk11-results.txt
@@ -2,12 +2,12 @@
MapStatuses Convert Benchmark
================================================================================================
-OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
-Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
+OpenJDK 64-Bit Server VM 11.0.19+7 on Linux 5.15.0-1037-azure
+Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
MapStatuses Convert: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Num Maps: 50000 Fetch partitions:500 1288 1317
38 0.0 1288194389.0 1.0X
-Num Maps: 50000 Fetch partitions:1000 2608 2671
65 0.0 2607771122.0 0.5X
-Num Maps: 50000 Fetch partitions:1500 3985 4026
64 0.0 3984885770.0 0.3X
+Num Maps: 50000 Fetch partitions:500 1346 1367
28 0.0 1345826909.0 1.0X
+Num Maps: 50000 Fetch partitions:1000 2807 2818
11 0.0 2806866333.0 0.5X
+Num Maps: 50000 Fetch partitions:1500 4287 4308
19 0.0 4286688536.0 0.3X
diff --git a/core/benchmarks/MapStatusesConvertBenchmark-jdk17-results.txt
b/core/benchmarks/MapStatusesConvertBenchmark-jdk17-results.txt
index 12af87d9689..b0b61cc11ef 100644
--- a/core/benchmarks/MapStatusesConvertBenchmark-jdk17-results.txt
+++ b/core/benchmarks/MapStatusesConvertBenchmark-jdk17-results.txt
@@ -2,12 +2,12 @@
MapStatuses Convert Benchmark
================================================================================================
-OpenJDK 64-Bit Server VM 17.0.6+10 on Linux 5.15.0-1031-azure
-Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
+OpenJDK 64-Bit Server VM 17.0.7+7 on Linux 5.15.0-1037-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
MapStatuses Convert: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Num Maps: 50000 Fetch partitions:500 1052 1061
12 0.0 1051946292.0 1.0X
-Num Maps: 50000 Fetch partitions:1000 1888 2007
109 0.0 1888235523.0 0.6X
-Num Maps: 50000 Fetch partitions:1500 3070 3149
81 0.0 3070386448.0 0.3X
+Num Maps: 50000 Fetch partitions:500 1041 1050
16 0.0 1040911290.0 1.0X
+Num Maps: 50000 Fetch partitions:1000 2139 2201
57 0.0 2139264609.0 0.5X
+Num Maps: 50000 Fetch partitions:1500 3233 3260
26 0.0 3233193041.0 0.3X
diff --git a/core/benchmarks/MapStatusesConvertBenchmark-results.txt
b/core/benchmarks/MapStatusesConvertBenchmark-results.txt
index 05c5bf55f62..036212057d3 100644
--- a/core/benchmarks/MapStatusesConvertBenchmark-results.txt
+++ b/core/benchmarks/MapStatusesConvertBenchmark-results.txt
@@ -2,12 +2,12 @@
MapStatuses Convert Benchmark
================================================================================================
-OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
-Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
+OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1037-azure
+Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
MapStatuses Convert: Best Time(ms) Avg Time(ms)
Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
-Num Maps: 50000 Fetch partitions:500 1489 1522
30 0.0 1488665925.0 1.0X
-Num Maps: 50000 Fetch partitions:1000 2755 2812
59 0.0 2755045334.0 0.5X
-Num Maps: 50000 Fetch partitions:1500 4126 4135
14 0.0 4125938778.0 0.4X
+Num Maps: 50000 Fetch partitions:500 1105 1124
31 0.0 1104815121.0 1.0X
+Num Maps: 50000 Fetch partitions:1000 1807 1877
70 0.0 1806608518.0 0.6X
+Num Maps: 50000 Fetch partitions:1500 2894 2898
5 0.0 2893757441.0 0.4X
diff --git a/dev/deps/spark-deps-hadoop-3-hive-2.3
b/dev/deps/spark-deps-hadoop-3-hive-2.3
index 7e702e44c40..d3f3c990997 100644
--- a/dev/deps/spark-deps-hadoop-3-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-3-hive-2.3
@@ -1,7 +1,7 @@
HikariCP/2.5.1//HikariCP-2.5.1.jar
JLargeArrays/1.5//JLargeArrays-1.5.jar
JTransforms/3.1//JTransforms-3.1.jar
-RoaringBitmap/0.9.39//RoaringBitmap-0.9.39.jar
+RoaringBitmap/0.9.44//RoaringBitmap-0.9.44.jar
ST4/4.0.4//ST4-4.0.4.jar
activation/1.1.1//activation-1.1.1.jar
aircompressor/0.21//aircompressor-0.21.jar
@@ -230,7 +230,7 @@ scala-library/2.12.17//scala-library-2.12.17.jar
scala-parser-combinators_2.12/2.2.0//scala-parser-combinators_2.12-2.2.0.jar
scala-reflect/2.12.17//scala-reflect-2.12.17.jar
scala-xml_2.12/2.1.0//scala-xml_2.12-2.1.0.jar
-shims/0.9.39//shims-0.9.39.jar
+shims/0.9.44//shims-0.9.44.jar
slf4j-api/2.0.7//slf4j-api-2.0.7.jar
snakeyaml-engine/2.6//snakeyaml-engine-2.6.jar
snakeyaml/2.0//snakeyaml-2.0.jar
diff --git a/pom.xml b/pom.xml
index 457d96c3c7b..a84d16dfef7 100644
--- a/pom.xml
+++ b/pom.xml
@@ -814,7 +814,7 @@
<dependency>
<groupId>org.roaringbitmap</groupId>
<artifactId>RoaringBitmap</artifactId>
- <version>0.9.39</version>
+ <version>0.9.44</version>
</dependency>
<!-- Netty Begin -->
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
