This is an automated email from the ASF dual-hosted git repository.
yaooqinn pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/gluten.git
The following commit(s) were added to refs/heads/main by this push:
new e6e0403ba4 [MINOR][DOC] Update default of
spark.gluten.sql.columnar.tableCache to true (#12153)
e6e0403ba4 is described below
commit e6e0403ba4489f2618488824a6e45940dac35194
Author: Kent Yao <[email protected]>
AuthorDate: Thu May 28 14:37:18 2026 +0800
[MINOR][DOC] Update default of spark.gluten.sql.columnar.tableCache to true
(#12153)
Followup to #12138, which flipped the default of
`spark.gluten.sql.columnar.tableCache` from `false` to `true`. The
configuration table in docs/Configuration.md was not updated in that PR.
Sync the documented default with the code.
Generated-by: Claude claude-opus-4.7
---
docs/Configuration.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/Configuration.md b/docs/Configuration.md
index 6aaf25578b..748a200cfb 100644
--- a/docs/Configuration.md
+++ b/docs/Configuration.md
@@ -107,7 +107,7 @@ nav_order: 15
| spark.gluten.sql.columnar.smallFileThreshold | 🔄
Dynamic | 0.5 | The total size threshold of small files in
table scan.To avoid small files being placed into the same partition, Gluten
will try to distribute small files into different partitions when the total
size of small files is below this threshold.
[...]
| spark.gluten.sql.columnar.sort | 🔄
Dynamic | true | Enable or disable columnar sort.
[...]
| spark.gluten.sql.columnar.sortMergeJoin | 🔄
Dynamic | true | Enable or disable columnar sortMergeJoin. This
should be set with preferSortMergeJoin=false.
[...]
-| spark.gluten.sql.columnar.tableCache | âš“
Static | false | Enable or disable columnar table cache.
[...]
+| spark.gluten.sql.columnar.tableCache | âš“
Static | true | Enable or disable columnar table cache.
[...]
| spark.gluten.sql.columnar.tableCache.partitionStats.enabled | 🔄
Dynamic | false | When true, the Velox columnar cache serializer
computes per-partition min/max/null/row-count stats and embeds them in the
cached payload so that the Spark optimizer can prune whole partitions on
equality / range predicates. When false (default) the serializer writes the
legacy raw payload with no stats, and partition pruning is disabled. Default is
off until cross-workload benchmark [...]
| spark.gluten.sql.columnar.takeOrderedAndProject | 🔄
Dynamic | true |
| spark.gluten.sql.columnar.union | 🔄
Dynamic | true | Enable or disable columnar union.
[...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
