This is an automated email from the ASF dual-hosted git repository.
yuanzhou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-gluten.git
The following commit(s) were added to refs/heads/main by this push:
new 4a645a3312 [GLUTEN-10660][VL] Fix passing configurations for Velox
backend for hashmap dedup (#11020)
4a645a3312 is described below
commit 4a645a33127a85f3174ac2c52eb5256e3119405b
Author: Yuan <[email protected]>
AuthorDate: Fri Nov 7 14:59:35 2025 +0000
[GLUTEN-10660][VL] Fix passing configurations for Velox backend for hashmap
dedup (#11020)
* [VL] Fix missing configurations for Velox backend
Signed-off-by: Yuan <[email protected]>
* Update
gluten-substrait/src/main/scala/org/apache/gluten/config/GlutenConfig.scala
Co-authored-by: Hongze Zhang <[email protected]>
---------
Signed-off-by: Yuan <[email protected]>
Co-authored-by: Hongze Zhang <[email protected]>
---
.../src/main/scala/org/apache/gluten/config/GlutenConfig.scala | 5 +++++
1 file changed, 5 insertions(+)
diff --git
a/gluten-substrait/src/main/scala/org/apache/gluten/config/GlutenConfig.scala
b/gluten-substrait/src/main/scala/org/apache/gluten/config/GlutenConfig.scala
index c1b378c333..beb630c0ac 100644
---
a/gluten-substrait/src/main/scala/org/apache/gluten/config/GlutenConfig.scala
+++
b/gluten-substrait/src/main/scala/org/apache/gluten/config/GlutenConfig.scala
@@ -649,6 +649,11 @@ object GlutenConfig extends ConfigRegistry {
.filter(_._1.startsWith(HADOOP_PREFIX + GCS_PREFIX))
.foreach(entry => nativeConfMap.put(entry._1, entry._2))
+ // put in all gluten velox configs
+ conf
+ .filter(_._1.startsWith(s"spark.gluten.$backendName"))
+ .foreach(entry => nativeConfMap.put(entry._1, entry._2))
+
// return
nativeConfMap
}
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
