[
https://issues.apache.org/jira/browse/HIVE-30137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18123682#comment-18123682
]
László Bodor edited comment on HIVE-30137 at 10/6/26 9:39 AM:
--------------------------------------------------------------
created job:
https://ci-hadoop.apache.org/job/Hive-qbt-master-snapshots
with pipeline script (sharing here as it doesn't reveal secrets, all of them
are inherited within the Jenkins instance):
{code}
#!/usr/bin/env bash
# Build and deploy Hive snapshot artifacts to the ASF snapshot repository.
set -euo pipefail
export TOOLS_HOME=${TOOLS_HOME:-/home/jenkins/tools}
export MAVEN_HOME=${MAVEN_HOME:-${TOOLS_HOME}/maven/latest}
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}
export PATH=${JAVA_HOME}/bin:${MAVEN_HOME}/bin:$PATH
BASEDIR=${BASEDIR:-${WORKSPACE}/sourcedir}
ARTIFACTS=${ARTIFACTS:-${WORKSPACE}/out}
# Persisted between runs on purpose: wiping it forces a full re-download.
LOCAL_REPO=${LOCAL_REPO:-${WORKSPACE}/.m2/repository}
rm -rf "${ARTIFACTS}"
mkdir -p "${ARTIFACTS}" "${LOCAL_REPO}"
MVN_ARGS=(
-B -ntp -e
-Dmaven.repo.local="${LOCAL_REPO}"
-Pitests
-DskipTests # tests still COMPILE: many modules
publish test-jars
-Dmaven.javadoc.skip=true
-DdeployAtEnd=true # all-or-nothing: nothing is pushed
until the reactor passes
-DretryFailedDeploymentCount=10
-Dmaven.wagon.http.retryHandler.count=3
-Dmaven.wagon.httpconnectionManager.ttlSeconds=120
)
# Credentials for server id 'apache.snapshots.https' (from the
org.apache:apache:35 parent).
if [[ -n ${MAVEN_SETTINGS:-} ]]; then
MVN_ARGS+=(--settings "${MAVEN_SETTINGS}")
fi
# The packaging module only builds the binary tarball; set SKIP_PACKAGING=1 to
drop it.
if [[ ${SKIP_PACKAGING:-0} == 1 ]]; then
MVN_ARGS+=(-pl '!packaging')
fi
cd "${BASEDIR}"
java -version
mvn --version
mvn clean deploy "${MVN_ARGS[@]}" 2>&1 | tee "${ARTIFACTS}/deploy.log"
{code}
output of the successful job is: TODO attach
was (Author: abstractdog):
created job:
https://ci-hadoop.apache.org/job/Hive-qbt-master-snapshots
with pipeline script (sharing here as it doesn't reveal secrets, all of them
are inherited within the Jenkins instance):
{code}
#!/usr/bin/env bash
# Build and deploy Hive snapshot artifacts to the ASF snapshot repository.
set -euo pipefail
export TOOLS_HOME=${TOOLS_HOME:-/home/jenkins/tools}
export MAVEN_HOME=${MAVEN_HOME:-${TOOLS_HOME}/maven/latest}
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}
export PATH=${JAVA_HOME}/bin:${MAVEN_HOME}/bin:$PATH
BASEDIR=${BASEDIR:-${WORKSPACE}/sourcedir}
ARTIFACTS=${ARTIFACTS:-${WORKSPACE}/out}
# Persisted between runs on purpose: wiping it forces a full re-download.
LOCAL_REPO=${LOCAL_REPO:-${WORKSPACE}/.m2/repository}
rm -rf "${ARTIFACTS}"
mkdir -p "${ARTIFACTS}" "${LOCAL_REPO}"
MVN_ARGS=(
-B -ntp -e
-Dmaven.repo.local="${LOCAL_REPO}"
-DskipTests # tests still COMPILE: many modules
publish test-jars
-Dmaven.javadoc.skip=true
-DdeployAtEnd=true # all-or-nothing: nothing is pushed
until the reactor passes
-DretryFailedDeploymentCount=10
-Dmaven.wagon.http.retryHandler.count=3
-Dmaven.wagon.httpconnectionManager.ttlSeconds=120
)
# Credentials for server id 'apache.snapshots.https' (from the
org.apache:apache:35 parent).
if [[ -n ${MAVEN_SETTINGS:-} ]]; then
MVN_ARGS+=(--settings "${MAVEN_SETTINGS}")
fi
# The packaging module only builds the binary tarball; set SKIP_PACKAGING=1 to
drop it.
if [[ ${SKIP_PACKAGING:-0} == 1 ]]; then
MVN_ARGS+=(-pl '!packaging')
fi
cd "${BASEDIR}"
java -version
mvn --version
mvn clean deploy "${MVN_ARGS[@]}" 2>&1 | tee "${ARTIFACTS}/deploy.log"
{code}
output of the successful job is: TODO attach
> Deploy Hive SNAPSHOT artifacts on every commit on master
> --------------------------------------------------------
>
> Key: HIVE-30137
> URL: https://issues.apache.org/jira/browse/HIVE-30137
> Project: Hive
> Issue Type: Improvement
> Reporter: László Bodor
> Assignee: László Bodor
> Priority: Major
>
> The goal is to have Hive SNAPSHOT artifacts here:
> https://repository.apache.org/content/repositories/snapshots/org/apache/hive/hive-exec/
> (last one is 1.3.0-SNAPSHOT)
> Given an official Jenkins build instance having the needed credentials:
> https://ci-hadoop.apache.org/
> Similar to Tez job: https://ci-hadoop.apache.org/job/Tez-qbt-0.10-snapshots/
> A possible challenge is that Hive doesn't utilize Yetus, hence doesn't have a
> corresponding Yetus file, so the build script should be a standalone mvn
> command and its dependencies.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
