This is an automated email from the ASF dual-hosted git repository.
philo pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-gluten.git
The following commit(s) were added to refs/heads/main by this push:
new 844a1270b5 [VL] Enable `SIMDJSON_SKIPUTF8VALIDATION` for simdjson
build in setup script (#11257)
844a1270b5 is described below
commit 844a1270b5d363efad5a3f6e6f9fcbbbfe0ea6a5
Author: PHILO-HE <[email protected]>
AuthorDate: Sat Dec 6 11:27:57 2025 +0800
[VL] Enable `SIMDJSON_SKIPUTF8VALIDATION` for simdjson build in setup
script (#11257)
---
dev/build-helper-functions.sh | 2 ++
1 file changed, 2 insertions(+)
diff --git a/dev/build-helper-functions.sh b/dev/build-helper-functions.sh
index 145b8904b1..e5e5f3d60e 100644
--- a/dev/build-helper-functions.sh
+++ b/dev/build-helper-functions.sh
@@ -156,6 +156,8 @@ function setup_linux {
local LINUX_VERSION_ID=$(. /etc/os-release && echo ${VERSION_ID})
CURRENT_DIR=$(cd "$(dirname "$BASH_SOURCE")"; pwd)
GLUTEN_VELOX_SCRIPT_HOME=$CURRENT_DIR/../ep/build-velox/src
+ # Skip UTF-8 validation in JSON parsing. Required for compatibility with
Spark.
+ export SIMDJSON_SKIPUTF8VALIDATION=ON
if [[ "$LINUX_DISTRIBUTION" == "ubuntu" || "$LINUX_DISTRIBUTION" == "debian"
|| "$LINUX_DISTRIBUTION" == "pop" ]]; then
scripts/setup-ubuntu.sh
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
