[
https://issues.apache.org/jira/browse/SPARK-48615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao updated SPARK-48615:
-----------------------------
Parent: SPARK-48624
Issue Type: Sub-task (was: Improvement)
> Perf improvement for parsing hex string
> ---------------------------------------
>
> Key: SPARK-48615
> URL: https://issues.apache.org/jira/browse/SPARK-48615
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 4.0.0
> Reporter: Kent Yao
> Priority: Major
> Labels: pull-request-available
>
> {code:java}
> ================================================================================================
> Hex Comparison
> ================================================================================================OpenJDK
> 64-Bit Server VM 17.0.10+0 on Mac OS X 14.5
> Apple M2 Max
> Cardinality 1000000: Best Time(ms) Avg Time(ms)
> Stdev(ms) Rate(M/s) Per Row(ns) Relative
> ------------------------------------------------------------------------------------------------------------------------
> Apache 5050 5100
> 86 0.2 5050.1 1.0X
> Spark 3822 3840
> 30 0.3 3821.6 1.3X
> Java 2462 2522
> 87 0.4 2462.1 2.1XOpenJDK 64-Bit Server VM 17.0.10+0
> on Mac OS X 14.5
> Apple M2 Max
> Cardinality 2000000: Best Time(ms) Avg Time(ms)
> Stdev(ms) Rate(M/s) Per Row(ns) Relative
> ------------------------------------------------------------------------------------------------------------------------
> Apache 10020 10828
> 1154 0.2 5010.1 1.0X
> Spark 6875 6966
> 144 0.3 3437.7 1.5X
> Java 4999 5092
> 89 0.4 2499.3 2.0XOpenJDK 64-Bit Server VM 17.0.10+0
> on Mac OS X 14.5
> Apple M2 Max
> Cardinality 4000000: Best Time(ms) Avg Time(ms)
> Stdev(ms) Rate(M/s) Per Row(ns) Relative
> ------------------------------------------------------------------------------------------------------------------------
> Apache 20090 20433
> 433 0.2 5022.5 1.0X
> Spark 13389 13620
> 229 0.3 3347.2 1.5X
> Java 10023 10069
> 42 0.4 2505.6 2.0XOpenJDK 64-Bit Server VM 17.0.10+0
> on Mac OS X 14.5
> Apple M2 Max
> Cardinality 8000000: Best Time(ms) Avg Time(ms)
> Stdev(ms) Rate(M/s) Per Row(ns) Relative
> ------------------------------------------------------------------------------------------------------------------------
> Apache 40277 43453
> 2755 0.2 5034.7 1.0X
> Spark 27145 27380
> 311 0.3 3393.1 1.5X
> Java 19980 21198
> 1473 0.4 2497.5 2.0X {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
