This is an automated email from the ASF dual-hosted git repository.
zhouyuan pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/gluten.git
The following commit(s) were added to refs/heads/main by this push:
new dd0c34c521 [GLUTEN-6887][VL] Daily Update Velox Version (2026_07_24)
(#12615)
dd0c34c521 is described below
commit dd0c34c521826f85b8dc072b70bf7b9d53aea1f5
Author: Gluten Performance Bot
<[email protected]>
AuthorDate: Fri Jul 24 18:21:38 2026 +0100
[GLUTEN-6887][VL] Daily Update Velox Version (2026_07_24) (#12615)
* [GLUTEN-6887][VL] Daily Update Velox Version (dft-2026_07_24)
Upstream Velox's New Commits:
ce0173ba1 by Ping Liu, docs: Improve description of building requirement on
CPUs
ec5d52c27 by oerling, feat(torchwave): Add ATen ops, reductions, and search
(#18187)
499c96260 by Krishnakanth, feat(exec): Add kRightAnti join type (#18138)
75a5a5fae by Avinash Raj, fix(cudf): Register Presto functions in TPCH GPU
benchmark
054106586 by Maria Basmanova, fix(text): Honor serde field.delim when
writing TEXT files (#18240)
b986bd7ea by Jimmy Lu, fix: Stop reading ahead past a back-pressured
operator to prevent stale LazyVector loads (#18139)
f57780b87 by Krishna Pai, build(ci): Reject personal container images in
workflows
f7bd0add0 by Krishna Pai, fix(ci): Use official velox-dev image for
adapters jobs
2b58ad1e8 by LingBin, refactor: Refactor iotaData initialization to use IIFE
0ffc16474 by Chandrashekhar Kumar Singh, fix(exec): Surface requested
cancel as OperationCancelled (#18222)
Signed-off-by: glutenperfbot <[email protected]>
* [GLUTEN-12599][VL] Add actions/cache fallback when Stash misses
Per review: Stash has no restore-keys, so a changed ep/build-velox/src
tree misses its exact key and cold-builds. Keep the Stash restore first
on the x86/arm/enhanced consumers, and fall back to actions/cache/restore
(with restore-keys, warm from main) when stash-hit is false; the
actions/cache save is retained so both paths stay populated. Producers,
nightly and bundle keep the legacy actions/cache method unchanged. Also
add a default branch to the gh/jq arch case per review.
Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]>
---------
Signed-off-by: glutenperfbot <[email protected]>
Co-authored-by: glutenperfbot <[email protected]>
Co-authored-by: Smallfu666 <[email protected]>
Co-authored-by: Claude Opus 4.8 (1M context) <[email protected]>
---
.github/workflows/velox_backend_arm.yml | 20 ++++++++++++++++++++
.github/workflows/velox_backend_enhanced.yml | 9 +++++++++
.github/workflows/velox_backend_x86.yml | 28 ++++++++++++++++++++++++++++
ep/build-velox/src/get-velox.sh | 4 ++--
4 files changed, 59 insertions(+), 2 deletions(-)
diff --git a/.github/workflows/velox_backend_arm.yml
b/.github/workflows/velox_backend_arm.yml
index 5fbb79b5b5..2f7fa8fe03 100644
--- a/.github/workflows/velox_backend_arm.yml
+++ b/.github/workflows/velox_backend_arm.yml
@@ -61,6 +61,7 @@ jobs:
case "$(uname -m)" in
x86_64) ARCH=amd64 ;;
aarch64) ARCH=arm64 ;;
+ *) echo "unsupported arch: $(uname -m)" >&2; exit 1 ;;
esac
curl -fsSL
"https://github.com/cli/cli/releases/download/v2.63.2/gh_2.63.2_linux_${ARCH}.tar.gz";
\
| tar -xz -C /usr/local --strip-components=1
"gh_2.63.2_linux_${ARCH}/bin/gh"
@@ -68,10 +69,19 @@ jobs:
chmod +x /usr/local/bin/jq
gh --version && jq --version
- name: Get Ccache from Apache Stash
+ id: ccache-stash
uses:
apache/infrastructure-actions/stash/restore@0ba14156c9f4c3cfbe4b0c9f36339ab0f8d81e53
with:
path: '${{ env.CCACHE_DIR }}'
key: ccache-centos8-release-default-${{runner.arch}}-${{
hashFiles('ep/build-velox/src/**') }}
+ - name: Get Ccache from actions/cache (fallback on Stash miss)
+ if: steps.ccache-stash.outputs.stash-hit != 'true'
+ uses: actions/cache/restore@v4
+ with:
+ path: '${{ env.CCACHE_DIR }}'
+ key: ccache-centos8-release-default-${{runner.arch}}-${{github.sha}}
+ restore-keys: |
+ ccache-centos8-release-default-${{runner.arch}}
- name: Build Gluten native libraries
run: |
df -a
@@ -143,6 +153,7 @@ jobs:
case "$(uname -m)" in
x86_64) ARCH=amd64 ;;
aarch64) ARCH=arm64 ;;
+ *) echo "unsupported arch: $(uname -m)" >&2; exit 1 ;;
esac
curl -fsSL
"https://github.com/cli/cli/releases/download/v2.63.2/gh_2.63.2_linux_${ARCH}.tar.gz";
\
| tar -xz -C /usr/local --strip-components=1
"gh_2.63.2_linux_${ARCH}/bin/gh"
@@ -150,10 +161,19 @@ jobs:
chmod +x /usr/local/bin/jq
gh --version && jq --version
- name: Get Ccache from Apache Stash
+ id: ccache-stash
uses:
apache/infrastructure-actions/stash/restore@0ba14156c9f4c3cfbe4b0c9f36339ab0f8d81e53
with:
path: '${{ env.CCACHE_DIR }}'
key: ccache-centos9-release-shared-${{runner.arch}}-${{
hashFiles('ep/build-velox/src/**') }}
+ - name: Get Ccache from actions/cache (fallback on Stash miss)
+ if: steps.ccache-stash.outputs.stash-hit != 'true'
+ uses: actions/cache/restore@v4
+ with:
+ path: '${{ env.CCACHE_DIR }}'
+ key: ccache-centos9-release-shared-${{runner.arch}}-${{github.sha}}
+ restore-keys: |
+ ccache-centos9-release-shared-${{runner.arch}}
- name: Build Gluten native libraries
run: |
df -a
diff --git a/.github/workflows/velox_backend_enhanced.yml
b/.github/workflows/velox_backend_enhanced.yml
index 1b0d27e391..a9e31d41f5 100644
--- a/.github/workflows/velox_backend_enhanced.yml
+++ b/.github/workflows/velox_backend_enhanced.yml
@@ -57,10 +57,19 @@ jobs:
steps:
- uses: actions/checkout@v4
- name: Get Ccache from Apache Stash
+ id: ccache-stash
uses:
apache/infrastructure-actions/stash/restore@0ba14156c9f4c3cfbe4b0c9f36339ab0f8d81e53
with:
path: '${{ env.CCACHE_DIR }}'
key: ccache-enhanced-centos7-release-default-${{
hashFiles('ep/build-velox/src/**') }}
+ - name: Get Ccache from actions/cache (fallback on Stash miss)
+ if: steps.ccache-stash.outputs.stash-hit != 'true'
+ uses: actions/cache/restore@v4
+ with:
+ path: '${{ env.CCACHE_DIR }}'
+ key: ccache-enhanced-centos7-release-default-${{github.sha}}
+ restore-keys: |
+ ccache-enhanced-centos7-release-default
- name: Build Gluten native libraries
run: |
docker pull apache/gluten:vcpkg-centos-7-gcc13
diff --git a/.github/workflows/velox_backend_x86.yml
b/.github/workflows/velox_backend_x86.yml
index a48e84c2c2..9b13dbd069 100644
--- a/.github/workflows/velox_backend_x86.yml
+++ b/.github/workflows/velox_backend_x86.yml
@@ -60,10 +60,19 @@ jobs:
steps:
- uses: actions/checkout@v4
- name: Get Ccache from Apache Stash
+ id: ccache-stash
uses:
apache/infrastructure-actions/stash/restore@0ba14156c9f4c3cfbe4b0c9f36339ab0f8d81e53
with:
path: '${{ env.CCACHE_DIR }}'
key: ccache-centos7-release-default-${{
hashFiles('ep/build-velox/src/**') }}
+ - name: Get Ccache from actions/cache (fallback on Stash miss)
+ if: steps.ccache-stash.outputs.stash-hit != 'true'
+ uses: actions/cache/restore@v4
+ with:
+ path: '${{ env.CCACHE_DIR }}'
+ key: ccache-centos7-release-default-${{github.sha}}
+ restore-keys: |
+ ccache-centos7-release-default
- name: Build Gluten native libraries
run: |
docker run -v $GITHUB_WORKSPACE:/work -w /work
apache/gluten:vcpkg-centos-7-gcc13 bash -c "
@@ -985,6 +994,7 @@ jobs:
case "$(uname -m)" in
x86_64) ARCH=amd64 ;;
aarch64) ARCH=arm64 ;;
+ *) echo "unsupported arch: $(uname -m)" >&2; exit 1 ;;
esac
curl -fsSL
"https://github.com/cli/cli/releases/download/v2.63.2/gh_2.63.2_linux_${ARCH}.tar.gz";
\
| tar -xz -C /usr/local --strip-components=1
"gh_2.63.2_linux_${ARCH}/bin/gh"
@@ -992,10 +1002,19 @@ jobs:
chmod +x /usr/local/bin/jq
gh --version && jq --version
- name: Get Ccache from Apache Stash
+ id: ccache-stash
uses:
apache/infrastructure-actions/stash/restore@0ba14156c9f4c3cfbe4b0c9f36339ab0f8d81e53
with:
path: '${{ env.CCACHE_DIR }}'
key: ccache-centos9-release-shared-${{runner.arch}}-${{
hashFiles('ep/build-velox/src/**') }}
+ - name: Get Ccache from actions/cache (fallback on Stash miss)
+ if: steps.ccache-stash.outputs.stash-hit != 'true'
+ uses: actions/cache/restore@v4
+ with:
+ path: '${{ env.CCACHE_DIR }}'
+ key: ccache-centos9-release-shared-${{runner.arch}}-${{github.sha}}
+ restore-keys: |
+ ccache-centos9-release-shared-${{runner.arch}}
- name: Build Gluten native libraries
run: |
df -a
@@ -1060,10 +1079,19 @@ jobs:
- uses: actions/checkout@v4
- name: Get Ccache from Apache Stash
+ id: ccache-stash
uses:
apache/infrastructure-actions/stash/restore@0ba14156c9f4c3cfbe4b0c9f36339ab0f8d81e53
with:
path: '${{ env.CCACHE_DIR }}'
key: ccache-centos9-cudf-release-shared-${{runner.arch}}-${{
hashFiles('ep/build-velox/src/**') }}
+ - name: Get Ccache from actions/cache (fallback on Stash miss)
+ if: steps.ccache-stash.outputs.stash-hit != 'true'
+ uses: actions/cache/restore@v4
+ with:
+ path: '${{ env.CCACHE_DIR }}'
+ key:
ccache-centos9-cudf-release-shared-${{runner.arch}}-${{github.sha}}
+ restore-keys: |
+ ccache-centos9-cudf-release-shared-${{runner.arch}}
- name: Build Gluten native libraries
run: |
docker run -v $GITHUB_WORKSPACE:/work -w /work
apache/gluten:centos-9-jdk8-cudf bash -c "
diff --git a/ep/build-velox/src/get-velox.sh b/ep/build-velox/src/get-velox.sh
index 5bc514ce50..72865dc94a 100755
--- a/ep/build-velox/src/get-velox.sh
+++ b/ep/build-velox/src/get-velox.sh
@@ -18,8 +18,8 @@ set -exu
CURRENT_DIR=$(cd "$(dirname "$BASH_SOURCE")"; pwd)
VELOX_REPO=https://github.com/IBM/velox.git
-VELOX_BRANCH=dft-2026_07_22
-VELOX_ENHANCED_BRANCH=ibm-2026_07_22
+VELOX_BRANCH=dft-2026_07_24
+VELOX_ENHANCED_BRANCH=ibm-2026_07_24
VELOX_HOME=""
RUN_SETUP_SCRIPT=ON
ENABLE_ENHANCED_FEATURES=OFF
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
