This is an automated email from the ASF dual-hosted git repository.
dependabot[bot] pushed a change to branch
dependabot/github_actions/docker/setup-buildx-action-4.2.0
in repository https://gitbox.apache.org/repos/asf/gluten.git
discard f7a554e4af Bump docker/setup-buildx-action from 4.0.0 to 4.2.0
add 9b15c7de58 [GLUTEN-12668][CORE] Add injectPre hook so rules survive
whole-stage AQE fallback (#12669)
add c1f72ca95e [GLUTEN-11524][VL] Fix ColumnarAQEShuffleReadExec (#12691)
add 13ac7e49d3 [GLUTEN-11828][VL] Add cuda device detection (#11830)
add 8b28f221a1 [VL] Include Spark 4.1 build in release script (#12695)
add cfbc08e48e [DOC] Polish wording and fix inaccuracies in docs (#12675)
add 1e30cbde4e [MINOR][VL] Re-enable the weekday test in
VeloxStringFunctionsSuite (#12688)
add 44c6048252 [GLUTEN-12676][CORE] Read MiB-declared Spark memory configs
with matching accessors (#12677)
add 198e347083 [Velox] Add S3 limitation (#12713)
add 40bd5b55d1 [VL] Support regexp_instr function (#12697)
add 34e70f5ee7 [GLUTEN-12013][VL] Register bloom-filter rewrite at
injectPre so it survives whole-stage fallback (#12151)
add d73f608391 [MINOR] Remove redundant Spark resource setup from CI
(#12715)
add cf3f904e95 [GLUTEN-12708][VL] Fix LATERAL VIEW OUTER stack not
consuming Velox marker, causing columnar shuffle field0 to become BOOLEAN and
crash (#12709)
add a5859848ed [GLUTEN-12719][VL] Fix ClassCastException in
ColumnarShuffleReader when Celeborn shuffle falls back to local
ColumnarShuffleManager (#12721)
add 5964ac0abc [GLUTEN-6887][VL] Daily Update Velox Version (2026_08_05)
(#12692)
add 6273a48a80 [VL] Support dayname and monthname functions (#12725)
add dcf526c856 [VL][Delta] Add Delta Spark UT pipeline gated against a
known-failures baseline (#12388)
add ca82b7721f [GLUTEN-12698][CORE] Add Iceberg read/write offload
switches (#12699)
add 413901f9d4 [GLUTEN-12716][CORE] Make AppendableSpillerList safe to
append during a spill (#12717)
add eb4951988a [GLUTEN-12722][CH] Support stack function (#12723)
add b58e654ae1 [VL] Run clang-tidy in the native build job and narrow its
check list (#12729)
add e0ec40a894 [VL] Fix native SIGSEGV in ~ObjectStore when release()
races with store destruction (#12740)
add 839eec4d4e [GLUTEN-12564][CORE] Exclude
DefaultAllocationManagerFactory from gluten-package shade bundle (#12565)
add 3abf4c4df5 [GLUTEN-12566][CORE] Propagate keyGroupedPartitioning in
BatchScanExecTransformer (#12567)
add 4b49b66566 [GLUTEN-12649][VL] Ban flaky tests in
GlutenSparkScriptTransformationSuite (#12758)
add 5442667a99 Bump actions/labeler from 5 to 7 (#12684)
add 5e30c857d0 Bump scacap/action-surefire-report from 1.8.0 to 1.13.0
(#12685)
add 64ff62e5d2 [HOTFIX][GHA] Fix labeler.yml YAML indentation for
actions/labeler v7 (#12763)
add 2a8bc38eff [GLUTEN-12748][CORE] Compare transition node name hash
codes instead of subtracting (#12750)
add ddca36e75a [VL] Delta: Support Delta CDF scan offload (#12218)
add 271f146164 Bump org.codehaus.mojo:exec-maven-plugin from 3.1.0 to
3.6.3 (#12682)
add 2b2b761680 Bump com.amazonaws:aws-java-sdk-dynamodb from 1.12.262 to
1.12.797 (#12681)
add 82da039b7b Bump com.google.jimfs:jimfs from 1.3.0 to 1.3.1 (#12679)
add 1e762d3a3a [MINOR][CI][DOC] Document the Delta Spark UT pipeline and
skip it for docs-only changes (#12745)
add cd22fb88f5 [GLUTEN-6887][VL] Daily Update Velox Version (2026_08_12)
(#12755)
add bd02004be1 [MINOR][VL] Avoid bundling Linux UAPI socket header (#12768)
add 5f4c326a5f [MINOR] Add missing ASF license headers (#12772)
add 3cc98da864 [INFRA] Cover XML files in license header check and fix
Dockerfile pattern (#12770)
add de3b4c40d6 [VL] Fail fast when NativeMemoryManager.hold() is called
after release() instead of a native SIGSEGV
add 65dff04b06 [GLUTEN-11524][VL] Support CPU/GPU hybrid task scheduling
(#12588)
add 97ed93f7ce [VL][CI] Add gpu image centos-9-jdk17-cuda13.1-cudf (#12690)
add 3ae572bc27 [GLUTEN-11622][VL] Support cast between TIMESTAMP and
TIMESTAMP_NTZ (#12654)
add bfd05757d7 Bump docker/setup-buildx-action from 4.0.0 to 4.2.0
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (f7a554e4af)
\
N -- N -- N
refs/heads/dependabot/github_actions/docker/setup-buildx-action-4.2.0
(bfd05757d7)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/labeler.yml | 102 ++-
.github/workflows/cpp_clang_tidy.yml | 83 --
.github/workflows/delta_spark_ut.yml | 472 ++++++++++++
.github/workflows/docker_image.yml | 38 +-
.github/workflows/pr_bot.yml | 2 +-
.github/workflows/test_report.yml | 2 +-
.github/workflows/util/delta-spark-ut/README.md | 235 ++++++
.../util/delta-spark-ut/compare-test-results.py | 841 +++++++++++++++++++++
.../util/delta-spark-ut/flaky-error-patterns.txt | 46 ++
.../workflows/util/delta-spark-ut/flaky-tests.txt | 24 +
.../util/delta-spark-ut/java-test-args.sh | 60 ++
.../util/delta-spark-ut/known-failures.txt | 769 +++++++++++++++++++
.../util/delta-spark-ut/run-delta-tests.sh | 281 +++++++
.../workflows/util/delta-spark-ut/setup-delta.sh | 241 ++++++
.github/workflows/util/license-header.py | 70 +-
.github/workflows/velox_backend_ansi.yml | 16 -
.github/workflows/velox_backend_enhanced.yml | 11 -
.github/workflows/velox_backend_x86.yml | 75 +-
README.md | 16 +-
.../org/apache/gluten/utils/CHExpressionUtil.scala | 6 +-
backends-velox/pom.xml | 2 +-
.../gluten/component/VeloxDeltaComponent.scala | 14 +-
.../apache/gluten/config/VeloxDeltaConfig.scala | 9 +
.../apache/gluten/execution/VeloxDeltaSuite.scala | 35 +-
.../gluten/extension/OffloadIcebergWrite.scala | 67 +-
.../execution/enhanced/VeloxIcebergSuite.scala | 31 +
.../gluten/backendsapi/velox/VeloxRuleApi.scala | 21 +-
.../org/apache/gluten/config/VeloxConfig.scala | 2 +-
.../gluten/execution/GenerateExecTransformer.scala | 11 +-
...AppendBatchResizeForShuffleInputAndOutput.scala | 4 +-
.../gluten/extension/CudfNodeValidationRule.scala | 8 +-
.../spark/shuffle/ColumnarShuffleReader.scala | 24 +-
.../sql/execution/AdjustStageExecutionMode.scala | 75 +-
.../HybridExecutionResourceProfileSuite.scala | 132 ++++
.../gluten/execution/MiscOperatorSuite.scala | 86 ++-
.../gluten/execution/StageExecutionModeSuite.scala | 99 ++-
.../execution/VeloxStringFunctionsSuite.scala | 2 +-
.../functions/DateFunctionsValidateSuite.scala | 46 ++
.../functions/ScalarFunctionsValidateSuite.scala | 35 +
.../sql/GlutenBloomFilterFallbackSuite.scala | 474 ++++++++++++
.../spark/shuffle/ColumnarShuffleReaderSuite.scala | 88 +++
cpp-ch/local-engine/Parser/ExpressionParser.cpp | 91 +++
cpp-ch/local-engine/Parser/ExpressionParser.h | 2 +
cpp/.clang-tidy | 24 +
cpp/core/utils/ObjectStore.cc | 7 +-
cpp/velox/CMakeLists.txt | 5 +
cpp/velox/compute/VeloxBackend.cc | 46 +-
.../substrait/SubstraitToVeloxPlanValidator.cc | 2 +-
cpp/velox/utils/ConfigExtractor.cc | 10 +-
dev/build-helper-functions.sh | 1 +
dev/builddeps-veloxbe.sh | 11 +-
...velox-buildstatic-centos-7-enhanced-features.sh | 2 +-
dev/ci-velox-buildstatic-centos-7.sh | 2 +-
dev/docker/Dockerfile.centos7-gcc13-static-build | 4 +-
dev/docker/Dockerfile.centos9-dynamic-build | 2 +
...ile => Dockerfile.centos-9-jdk17-cuda13.1-cudf} | 35 +-
dev/{package.sh => install-linux-socket-header.sh} | 29 +-
dev/intellij-codestyle.xml | 16 +
dev/release/build-release.sh | 7 +-
dev/run-clang-tidy.py | 59 +-
docs/Configuration.md | 23 +-
docs/developers/ProfileMemoryOfGlutenWithVelox.md | 6 +-
docs/developers/velox-backend-CI.md | 64 +-
docs/get-started/Velox.md | 38 +-
docs/get-started/VeloxDelta.md | 6 +
docs/get-started/VeloxIceberg.md | 8 +
docs/get-started/VeloxLocalCache.md | 25 +-
docs/get-started/VeloxS3.md | 17 +
docs/velox-backend-limitations.md | 19 +-
docs/velox-backend-scalar-function-support.md | 9 +-
docs/velox-configuration.md | 2 +-
ep/build-velox/src/get-velox.sh | 4 +-
ep/build-velox/src/socket.h | 105 ---
.../apache/gluten/memory/NativeMemoryManager.scala | 10 +-
.../apache/gluten/memory/memtarget/Spillers.java | 10 +-
.../scala/org/apache/gluten/GlutenPlugin.scala | 8 +-
.../apache/gluten/config/GlutenCoreConfig.scala | 2 -
.../columnar/heuristic/HeuristicApplier.scala | 19 +-
.../columnar/transition/TransitionGraph.scala | 9 +-
.../gluten/extension/injector/GlutenInjector.scala | 6 +
.../org/apache/spark/util/SparkResourceUtil.scala | 35 +-
.../gluten/memory/memtarget/SpillersTest.java | 178 +++++
.../gluten/GlutenDynamicOffHeapSizingSuite.scala | 55 ++
.../transition/TransitionCostModelSuite.scala | 87 +++
.../apache/spark/util/SparkResourceUtilSuite.scala | 85 +++
.../gluten/extension/DeltaCDFRelationHelper.scala | 44 ++
.../gluten/extension/DeltaCDFRelationHelper.scala | 44 ++
.../gluten/extension/DeltaCDFRelationHelper.scala | 44 ++
.../gluten/extension/DeltaCDFRelationHelper.scala | 47 ++
.../gluten/execution/DeltaScanTransformer.scala | 25 +
.../apache/gluten/extension/DeltaCDFScanRule.scala | 157 ++++
.../apache/gluten/extension/OffloadDeltaScan.scala | 8 +-
.../org/apache/gluten/execution/DeltaSuite.scala | 203 ++++-
.../apache/gluten/config/GlutenIcebergConfig.scala | 32 +-
.../gluten/extension/OffloadIcebergScan.scala | 15 +-
.../org/apache/gluten/execution/IcebergSuite.scala | 51 ++
.../org/apache/gluten/config/GlutenConfig.scala | 56 ++
.../execution/BatchScanExecTransformer.scala | 9 +-
.../gluten/execution/ScanTransformerFactory.scala | 2 +
.../TakeOrderedAndProjectExecTransformer.scala | 4 +-
.../gluten/execution/WholeStageTransformer.scala | 9 +-
.../gluten/expression/ExpressionConverter.scala | 16 +-
.../extension/columnar/validator/Validators.scala | 7 +-
.../GlutenAutoAdjustStageResourceProfile.scala | 179 +++--
.../adaptive/ColumnarAQEShuffleReadExec.scala | 76 +-
...GlutenAutoAdjustStageResourceProfileSuite.scala | 129 ++++
.../spark/sql/GlutenGeneratorFunctionSuite.scala | 31 +-
.../sql/execution/FallbackStrategiesSuite.scala | 1 +
.../spark/sql/GlutenGeneratorFunctionSuite.scala | 31 +-
.../sql/execution/FallbackStrategiesSuite.scala | 1 +
.../gluten/utils/velox/VeloxTestSettings.scala | 4 +
.../spark/sql/GlutenGeneratorFunctionSuite.scala | 29 +
.../sql/execution/FallbackStrategiesSuite.scala | 1 +
gluten-ut/spark40/pom.xml | 16 +
.../gluten/utils/velox/VeloxTestSettings.scala | 13 +-
.../spark/sql/GlutenGeneratorFunctionSuite.scala | 29 +
.../sql/gluten/GlutenFallbackStrategiesSuite.scala | 1 +
gluten-ut/spark41/pom.xml | 16 +
.../gluten/utils/velox/VeloxTestSettings.scala | 13 +-
.../spark/sql/GlutenGeneratorFunctionSuite.scala | 29 +
.../sql/gluten/GlutenFallbackStrategiesSuite.scala | 1 +
package/pom.xml | 19 +
pom.xml | 4 +-
.../apache/gluten/expression/ExpressionNames.scala | 3 +
.../gluten/sql/shims/spark34/Spark34Shims.scala | 3 +-
.../gluten/sql/shims/spark35/Spark35Shims.scala | 3 +-
.../gluten/sql/shims/spark40/Spark40Shims.scala | 5 +-
.../gluten/sql/shims/spark41/Spark41Shims.scala | 5 +-
tools/gluten-it/package/src/main/assembly.xml | 16 +
129 files changed, 6468 insertions(+), 803 deletions(-)
delete mode 100644 .github/workflows/cpp_clang_tidy.yml
create mode 100644 .github/workflows/delta_spark_ut.yml
create mode 100644 .github/workflows/util/delta-spark-ut/README.md
create mode 100644
.github/workflows/util/delta-spark-ut/compare-test-results.py
create mode 100644
.github/workflows/util/delta-spark-ut/flaky-error-patterns.txt
create mode 100644 .github/workflows/util/delta-spark-ut/flaky-tests.txt
create mode 100755 .github/workflows/util/delta-spark-ut/java-test-args.sh
create mode 100644 .github/workflows/util/delta-spark-ut/known-failures.txt
create mode 100755 .github/workflows/util/delta-spark-ut/run-delta-tests.sh
create mode 100755 .github/workflows/util/delta-spark-ut/setup-delta.sh
create mode 100644
backends-velox/src/test/scala/org/apache/gluten/execution/HybridExecutionResourceProfileSuite.scala
create mode 100644
backends-velox/src/test/scala/org/apache/gluten/sql/GlutenBloomFilterFallbackSuite.scala
create mode 100644
backends-velox/src/test/scala/org/apache/spark/shuffle/ColumnarShuffleReaderSuite.scala
copy dev/docker/cudf/{Dockerfile => Dockerfile.centos-9-jdk17-cuda13.1-cudf}
(53%)
copy dev/{package.sh => install-linux-socket-header.sh} (54%)
mode change 100755 => 100644
delete mode 100644 ep/build-velox/src/socket.h
create mode 100644
gluten-core/src/test/java/org/apache/gluten/memory/memtarget/SpillersTest.java
create mode 100644
gluten-core/src/test/scala/org/apache/gluten/GlutenDynamicOffHeapSizingSuite.scala
create mode 100644
gluten-core/src/test/scala/org/apache/gluten/extension/columnar/transition/TransitionCostModelSuite.scala
create mode 100644
gluten-delta/src-delta23/main/scala/org/apache/gluten/extension/DeltaCDFRelationHelper.scala
create mode 100644
gluten-delta/src-delta24/main/scala/org/apache/gluten/extension/DeltaCDFRelationHelper.scala
create mode 100644
gluten-delta/src-delta33/main/scala/org/apache/gluten/extension/DeltaCDFRelationHelper.scala
create mode 100644
gluten-delta/src-delta40/main/scala/org/apache/gluten/extension/DeltaCDFRelationHelper.scala
create mode 100644
gluten-delta/src/main/scala/org/apache/gluten/extension/DeltaCDFScanRule.scala
copy
backends-velox/src-delta/main/scala/org/apache/gluten/config/VeloxDeltaConfig.scala
=>
gluten-iceberg/src/main/scala/org/apache/gluten/config/GlutenIcebergConfig.scala
(50%)
create mode 100644
gluten-substrait/src/test/scala/org/apache/spark/sql/execution/GlutenAutoAdjustStageResourceProfileSuite.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
