This is an automated email from the ASF dual-hosted git repository.
JkSelf pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/gluten.git
The following commit(s) were added to refs/heads/main by this push:
new b45c1d87da [GLUTEN-6887][VL] Daily Update Velox Version (2026_07_10)
(#12494)
b45c1d87da is described below
commit b45c1d87dafe08a6f8be39eae9a3f9f566efa058
Author: Gluten Performance Bot
<[email protected]>
AuthorDate: Mon Jul 13 04:54:24 2026 +0100
[GLUTEN-6887][VL] Daily Update Velox Version (2026_07_10) (#12494)
* [GLUTEN-6887][VL] Daily Update Velox Version (dft-2026_07_10)
Upstream Velox's New Commits:
267246d0c by Philo He, refactor: Refactor cast error handling to build
error message lazily
899cbfa91 by Ismaël Mejía, perf(parquet): Add Parquet writer benchmark
27c7f3d4a by Matt Gara, feat(cudf): Add NotFunction, IsNullFunction,
IsNotNullFunction
b3280cd37 by Muhammad Haseeb, refactor(cudf): Rework Iceberg schema
evolution
0f35c0ba6 by Pradeep Vaka, feat(exec): Fire stateChangeFuture on scan split
queue drain (#17998)
980395430 by Mariam AlMesfer, feat(sparksql): Add casts between TIMESTAMP
and TIMESTAMP_UTC
1ffe42ed4 by Jiaan Geng, fix(spark): Fix out-of-bounds write in Spark
`map()` when a key repeats 3+ times under LAST_WIN
ec17d38c7 by Krishna Pai, fix(ci): Isolate main sanitizer builds per commit
20a1e5eda by Simon Eves, feat(cudf): GPU Decimal (Part 4)
6d2cebaff by Yabin Ma, fix: Fix thread-local runtime stat writer leak in
SortBufferTest
3a542c2eb by Jimmy Lu, fix(torchwave): Correct and speed up ads-preproc on
wave (#17893)
080b050e3 by Pedro Pedreira, feat(vector): Add DecodedVector::hasNulls()
(#18054)
6987b0fe4 by Karthikeyan, refactor(exec): Rename OutputBufferManager to
DefaultOutputBufferManager
4c9a221f3 by Wechar Yu, fix(parquet): Flush row group by buffered bytes in
the writer
54978b5e2 by Hongze Zhang, build: Add ColumnReaderStatisticsTests.cpp to
cmake
974ccd669 by Suryadev Sahadevan Rajesh, fix: Handle nested leaf columns by
dotted path (#17979)
7d36cc363 by Pedro Pedreira, feat(vector): Add DecodedVector::forEachNull()
and forEachNotNull() (#18051)
7ca0a98f2 by zhichenxu-meta, fix(rpc): Degrade whole-batch RPC failures to
per-row errors instead of failing the query (#18049)
f962082ca by RindsSchei225e, feat(fuzzer): Add no-evolution mode and fix
test flatmap column consistency (#17975)
f8e59f971 by Patrick Wilson, feat(cudf): Add GPU-accelerated Window operator
a581bbda9 by Maria Basmanova, feat(cudf): Revert Optimize Velox-cudf
Iceberg schema evolution (#18055)
5cd0ef714 by zhichenxu-meta, feat(rpc): Add admission-controlled adaptive
RPC rate limiter (#18039)
ea72605c3 by Muhammad Haseeb, Fix synthetic row count override
c1f27ed9b by Muhammad Haseeb, MInor
f8302e336 by Muhammad Haseeb, More fixes
3f346d649 by Muhammad Haseeb, cleanup artifacts
bd91b86a5 by Muhammad Haseeb, Address empty column projection case.
f413d9699 by Muhammad Haseeb, Address comments from @kjmph
dafb89b3e by Muhammad Haseeb, Apply suggestions from code review
860f52594 by Muhammad Haseeb, Address comment
50c0dd364 by Muhammad Haseeb, Use default constructor for
`CudfIcebergConnectorFactory`
9fee89f67 by Muhammad Haseeb, Minor
829d4c9e8 by Muhammad Haseeb, Add a consumed counter
debc3ddb0 by Muhammad Haseeb, Minor syntax fix
6e3c5be24 by Muhammad Haseeb, Rework schema evolution in Velox-cudf
10e8b81c1 by Bikramjeet Singh Vig, fix: Prevent VectorFuzzer crash when
normalizing encoded map keys
6bacc2b52 by Apurva Kumar, feat: Iceberg V3 field-id + NIMBLE stats on the
Velox Iceberg connector (#18041)
a4b60c92a by Krishna Pai, fix(ci): Remove custom import gate workflow
d2f87f5e8 by Jiaan Geng, fix(spark): Escape supplementary-plane chars in
get_json_object object/array results
1251ff9f6 by Lukas Krenz, build: Add NVIDIA Vera compiler flags
3c20437c8 by Apurva Kumar, feat: Iceberg V3 field-id resolver + NIMBLE
reader/writer (FB-internal)[nimble] (#17895)
a9d808961 by Suryadev Sahadevan Rajesh, docs(blog): Add "Making OpenZL
available in Nimble OSS" post (#18033)
adbbe7538 by Shruti Shivakumar, fix(cudf): Handle zero-column inputs in
CudfFromVelox
c67a26a3b by Bradley Dice, fix(cudf): Update benchmark flags
6461c38b4 by Reetika Agrawal, fix(iceberg): Filter pushdown with
initial-default columns
1a733d647 by Yuxuan Chen, perf: Call vector reserve to avoid unnecessary
growth during insertion
c7c4adbfc by Philo He, fix(spark): Align timestamp to integral cast with
Spark overflow semantics under ANSI
76cc6401e by RindsSchei225e, feat(fuzzer): Add random chunking mode in
fuzzer (#17970)
c90260d94 by Jimmy Lu, feat: Add fixed point operator plan nodes (#17814)
fe7031c8e by oerling, test(torchwave): Synthetic-data end-to-end test for
the ROO preproc graph (#18025)
149468e77 by oerling, fix(torchwave): Fix ig pipelines
79c57a486 by Christian Zentgraf, feat(abfs): Allow registration of multiple
file systems (#1809)
2f33d52db by Kyle Hubert, fix(cudf): Order packed table release on
materialization stream
Signed-off-by: glutenperfbot <[email protected]>
* Fix compile issue
* fix cast validation for TimestampNTZ
* Disable failed unit tests
---------
Signed-off-by: glutenperfbot <[email protected]>
Co-authored-by: glutenperfbot <[email protected]>
Co-authored-by: Ke Jia <[email protected]>
Co-authored-by: BInwei Yang <[email protected]>
Co-authored-by: Rong Ma <[email protected]>
---
.../execution/enhanced/VeloxIcebergSuite.scala | 4 +++-
cpp/velox/substrait/SubstraitToVeloxPlan.cc | 4 +---
.../substrait/SubstraitToVeloxPlanValidator.cc | 27 ++++++++++++++++++----
ep/build-velox/src/get-velox.sh | 4 ++--
4 files changed, 28 insertions(+), 11 deletions(-)
diff --git
a/backends-velox/src-iceberg/test/scala/org/apache/gluten/execution/enhanced/VeloxIcebergSuite.scala
b/backends-velox/src-iceberg/test/scala/org/apache/gluten/execution/enhanced/VeloxIcebergSuite.scala
index de48549993..837f3917f9 100644
---
a/backends-velox/src-iceberg/test/scala/org/apache/gluten/execution/enhanced/VeloxIcebergSuite.scala
+++
b/backends-velox/src-iceberg/test/scala/org/apache/gluten/execution/enhanced/VeloxIcebergSuite.scala
@@ -653,7 +653,9 @@ class VeloxIcebergSuite extends IcebergSuite {
}
}
}
- test("iceberg parquet writer default row group size test") {
+
+ // Ignored due to velox parquet row-group flush semantics change after
velox#16998.
+ ignore("iceberg parquet writer default row group size test") {
val table = "iceberg_default_row_group_size"
val defaultRowGroupBytes = 128L * 1024 * 1024
diff --git a/cpp/velox/substrait/SubstraitToVeloxPlan.cc
b/cpp/velox/substrait/SubstraitToVeloxPlan.cc
index 2b68476abb..fedd950374 100644
--- a/cpp/velox/substrait/SubstraitToVeloxPlan.cc
+++ b/cpp/velox/substrait/SubstraitToVeloxPlan.cc
@@ -499,9 +499,7 @@ core::PlanNodePtr
SubstraitToVeloxPlanConverter::toVeloxPlan(const ::substrait::
getJoinOutputType(leftNode, rightNode, joinType),
useHashTableCache,
false,
- false,
- nullptr,
- hashTableId);
+ sJoin.hashtableid());
} else {
// Create HashJoinNode node
return std::make_shared<core::HashJoinNode>(
diff --git a/cpp/velox/substrait/SubstraitToVeloxPlanValidator.cc
b/cpp/velox/substrait/SubstraitToVeloxPlanValidator.cc
index 767af98c76..8a55d62307 100644
--- a/cpp/velox/substrait/SubstraitToVeloxPlanValidator.cc
+++ b/cpp/velox/substrait/SubstraitToVeloxPlanValidator.cc
@@ -252,8 +252,8 @@ bool SubstraitToVeloxPlanValidator::isAllowedCast(const
TypePtr& fromType, const
return false;
}
- // Limited support for Timestamp to X.
- if (fromType->isTimestamp()) {
+ // Limited support for Timestamp from/to X.
+ if (fromType->equivalent(*TIMESTAMP())) {
if (toType->isDecimal()) {
return false;
}
@@ -266,11 +266,12 @@ bool SubstraitToVeloxPlanValidator::isAllowedCast(const
TypePtr& fromType, const
return true;
}
+ if (toType->equivalent(*TIMESTAMP_UTC())) {
+ return true;
+ }
return false;
}
-
- // Limited support for X to Timestamp.
- if (toType->isTimestamp()) {
+ if (toType->equivalent(*TIMESTAMP())) {
if (fromType->isDecimal()) {
return false;
}
@@ -287,6 +288,22 @@ bool SubstraitToVeloxPlanValidator::isAllowedCast(const
TypePtr& fromType, const
fromType->isDouble() || fromType->isReal()) {
return true;
}
+ if (fromType->equivalent(*TIMESTAMP_UTC())) {
+ return true;
+ }
+ return false;
+ }
+
+ // Limited support for TimestampNTZ from/to X
+ // Casts between Timestamp and TimestampNTZ are handled in from/to timestamp.
+ if (fromType->equivalent(*TIMESTAMP_UTC())) {
+ if (toType->isVarchar() || toType->isVarbinary()) {
+ return true;
+ }
+ return false;
+ }
+ if (toType->equivalent(*TIMESTAMP_UTC())) {
+ // Only supports from Timestamp to TimestampNTZ.
return false;
}
diff --git a/ep/build-velox/src/get-velox.sh b/ep/build-velox/src/get-velox.sh
index 6443710a93..080b10b0a3 100755
--- a/ep/build-velox/src/get-velox.sh
+++ b/ep/build-velox/src/get-velox.sh
@@ -18,8 +18,8 @@ set -exu
CURRENT_DIR=$(cd "$(dirname "$BASH_SOURCE")"; pwd)
VELOX_REPO=https://github.com/IBM/velox.git
-VELOX_BRANCH=dft-2026_07_03
-VELOX_ENHANCED_BRANCH=ibm-2026_07_03
+VELOX_BRANCH=dft-2026_07_10
+VELOX_ENHANCED_BRANCH=ibm-2026_07_10
VELOX_HOME=""
RUN_SETUP_SCRIPT=ON
ENABLE_ENHANCED_FEATURES=OFF
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
