xiaoh1024 opened a new pull request, #58748: URL: https://github.com/apache/spark/pull/58748
### What changes were proposed in this pull request? Add a small-decimal accessor for Arrow columns with source precision 1-18, with full-width fallback and existing Spark decimal conversion semantics. Add regression tests and an Arrow decimal read benchmark. ### Why are the changes needed? See [SPARK-59443](https://issues.apache.org/jira/browse/SPARK-59443). ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? - `build/sbt catalyst/compile sql/Test/compile` - `build/sbt "sql/testOnly org.apache.spark.sql.vectorized.ArrowColumnVectorSuite"` (28 tests passed, including 8 new decimal tests). - The same suite passed all 28 tests on a big-endian s390x Temurin 17 JVM under QEMU, including a native Arrow Decimal128 layout check. - Checkstyle for the changed Java file and Scalastyle for both Scala files. - Local ArrowDecimalReadBenchmark and allocation comparisons against the original accessor. - [ArrowDecimalReadBenchmark on GitHub Actions](https://github.com/xiaoh1024/spark/actions/runs/34618319523) passed with JDK 17 and Scala 2.13. - [Fork Build CI](https://github.com/xiaoh1024/spark/actions/runs/34618265811) passed. ### Was this patch authored or co-authored using generative AI tooling? AI assistance was used for implementation, tests, and local validation. Generated-by: Codex CLI 0.154.0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
