Hi Stamatis, Thank you for the detailed checking of this release candidate.
I'll verify that rc1 has all of these issues fixed. Thanks, Dmitriy On Fri, Nov 14, 2025 at 1:26 PM Stamatis Zampetakis <[email protected]> wrote: > (Ubuntu 22.04.5 LTS, Apache Maven 3.6.3, > zulu21.42.19-ca-jdk21.0.7-linux_x64) > > ## Hive src checks > * Checked signatures and checksums OK > * Checked diff between repo and artifacts KO (diff -qr > apache-hive-4.2.0-src hive-git) > * Checked README, NOTICE, LICENSE OK > * Checked for ASF headers [3] OK > * Checked for unexpected binary files [4] OK > * Built from apache-hive-4.2.0-src.tar.gz OK (mvn clean install > -DskipTests -Pitests,dist) > > The diff between the repo and the sources in the archive shows various > differences such as: > * Only in apache-hive-4.2.0-src/iceberg/iceberg-handler: > tez-local-cache8072133766521837098 > * Only in > apache-hive-4.2.0-src/standalone-metastore/metastore-rest-catalog: > metastore_db > Such files/dirs should not be present in the release sources. > > ## Hive bin checks > * Checked signatures and checksums OK > * Checked LICENSE and NOTICE OK > * Checked licenses folder for Category-X OK > * Extracted LICENSE from every jar file [1] and manually verified > compatibility with ASF OK > * Manually installed Hive in docker container (Ubuntu 25.04) [2] > using: apache-hive-4.2.0-bin.tar.gz, hadoop 3.4.1, tez 0.10.5, > zulu21.42.19-ca-jdk21.0.7-linux_x64 > * Configured hadoop to run on pseudo-distributed mode and started all > services (datanode, namenode, secondarynamenode, resourcemanager, > nodemanager) > * schematool -dbType derby -initSchema --verbose OK > * Started HS2 with embedded derby OK > * Run simple CREATE, LOAD, EXPLAIN, SELECT queries OK > > ## Metastore src checks > * Checked signatures and checksums OK > * Checked diff between repo and artifacts KO (diff -qr > apache-hive-metastore-4.2.0-src/ hive-git/standalone-metastore/) > Only in hive-git/standalone-metastore/: metastore-client > Only in apache-hive-metastore-4.2.0-src/metastore-rest-catalog: > metastore_db) > * Checked NOTICE, LICENSE inside OK > * No README file present and no instructions to build the project KO > * Checked source files for ASF headers [3] OK > * Checked for unexpected binary files [4] OK > * Built from hive-standalone-metastore-4.2.0-src.tar.gz KO (mvn clean > install -DskipTests -Pdist) > > [INFO] Scanning for projects... > [ERROR] [ERROR] Some problems were encountered while processing the POMs: > [ERROR] Child module > > /home/zabetak/Issues/hive-4.2.0-rc0/apache-hive-metastore-4.2.0-src/metastore-client > of > /home/zabetak/Issues/hive-4.2.0-rc0/apache-hive-metastore-4.2.0-src/pom.xml > does not exist @ > @ > [ERROR] The build could not read 1 project -> [Help 1] > [ERROR] > [ERROR] The project org.apache.hive:hive-standalone-metastore:4.2.0 > > (/home/zabetak/Issues/hive-4.2.0-rc0/apache-hive-metastore-4.2.0-src/pom.xml) > has 1 error > [ERROR] Child module > > /home/zabetak/Issues/hive-4.2.0-rc0/apache-hive-metastore-4.2.0-src/metastore-client > of > /home/zabetak/Issues/hive-4.2.0-rc0/apache-hive-metastore-4.2.0-src/pom.xml > does not exist > > ## Metastore bin checks > * Checked signatures and checksums OK > * Checked LICENSE and NOTICE OK > * Checked licenses folder for Category-X OK > * Extracted LICENSE from every jar file [1] and manually verified > compatibility with ASF OK > * Manually installed Metastore in docker container (Ubuntu 25.04) [2] > using: hive-standalone-metastore-4.2.0-bin.tar.gz, hadoop 3.4.1, > zulu21.42.19-ca-jdk21.0.7-linux_x64 > * schematool -dbType derby -initSchema --verbose OK > * Executed bin/start-metastore and checked logs/stdout/stderr for > correct initialization > > -1 (binding) > Mainly due to the fact that hive-standalone-metastore-4.2.0-src.tar.gz > is broken (missing metastore-client) and cannot be built. > > Best, > Stamatis > > [1] for f in `find . -name "*jar"`; do echo $f; jar xf $f > META-INF/LICENSE; head -5 META-INF/LICENSE; done > LICENSES-CHECK > [2] https://github.com/zabetak/hive-docker-setup > [3] grep -RiL -e "Licensed to the Apache Software Foundation" -e > "Licensed under the Apache License" -e "Autogenerated by Thrift > Compiler" | grep -v "q.out$" | grep -v ".q$" | grep -v "data/files/" > [4] find . -type f -exec file {} \; | grep -v "text" | grep -v ".q.out" > > > On Fri, Nov 14, 2025 at 5:18 PM Dmitriy Fingerman > <[email protected]> wrote: > > > > Hi All, > > > > Thank you for verifying the release candidate 0. > > Given that it has issues, I'm cancelling the voting. > > Will fix and create rc1. > > > > Thanks, > > Dmitriy > > > > > > On Fri, Nov 14, 2025 at 11:14 AM Dmitriy Fingerman < > [email protected]> wrote: > >> > >> Hi Butao, > >> > >> Yes, there is an .idea folder in hive sources tarball. > >> Will fix in 4.2.0-rc1. > >> > >> Thanks, > >> Dmitriy > >> > >> On Fri, Nov 14, 2025 at 3:25 AM Butao Zhang <[email protected]> > wrote: > >>> > >>> Hi folks, > >>> > >>> If you use `mvn clean install -DskipTests -Pdist` to compile the > Hive source package, you will encounter this exception. I reviewed the > content of `apache-hive-4.2.0-src/target/rat.txt`, which shows that there > is a `.idea` directory under the `itests` directory. This directory > contains 11 unknown licenses. I believe this directory should be removed > from the source package. > >>> > >>> ***************************************************** > >>> Summary > >>> ------- > >>> Generated at: 2025-11-14T16:16:16+08:00 > >>> Notes: 4 > >>> Binaries: 1 > >>> Archives: 0 > >>> Standards: 530 > >>> Apache Licensed: 519 > >>> Generated Documents: 0 > >>> JavaDocs are generated, thus a license header is optional. > >>> Generated files do not require license headers. > >>> 11 Unknown Licenses > >>> ***************************************************** > >>> Files with unapproved licenses: > >>> itests/.idea/encodings.xml > >>> itests/.idea/jarRepositories.xml > >>> itests/.idea/modules.xml > >>> itests/.idea/vcs.xml > >>> itests/.idea/misc.xml > >>> itests/.idea/codeStyles/Project.xml > >>> itests/.idea/codeStyles/codeStyleConfig.xml > >>> itests/.idea/workspace.xml > >>> itests/.idea/compiler.xml > >>> itests/.idea/libraries/DummyUDF.xml > >>> itests/.idea/libraries/target.xml > >>> ***************************************************** > >>> > >>> ---- Replied Message ---- > >>> FromShohei Okumiya<[email protected]> > >>> Date11/14/2025 15:28 > >>> To<[email protected]> > >>> SubjectRe: [VOTE] Apache Hive 4.2.0 Release Candidate 0 > >>> Hi, > >>> > >>> Thanks for preparing the release artifact. I attempted to build Hive, > and I didn't see the RAT issue. Might it be a local issue of Butao's > environment? > >>> > >>> These are the steps I tested. > >>> > >>> 1. Download `apache-hive-4.2.0-src.tar.gz` > >>> 2. Untar it > >>> 3. Prepare a containerized environment with the following Docker > command > >>> 4. `mvn clean install -Pdist,itests -DskipTests` > >>> > >>> ``` > >>> docker run --rm -it \ > >>> -v $HOME/.m2:/root/.m2 \ > >>> -v $PWD:/root/hive \ > >>> -w /root/hive \ > >>> maven:3.9.11-eclipse-temurin-21 \ > >>> /bin/bash > >>> ``` > >>> > >>> I have not tested other points; I plan to check them after rc1 is > created. > >>> > >>> Best, > >>> Okumin > >>> > >>> > >>> On Fri, Nov 14, 2025 at 2:09 AM Dmitriy Fingerman < > [email protected]> wrote: > >>>> > >>>> Hi Butao, > >>>> > >>>> Thank you for checking the release candidate artifacts and catching > the issue with building Hive Metastore from sources. > >>>> I found that it happens because the new metastore-client module was > forgotten to be added to metastore sources assembly. > >>>> I opened HIVE-29315 to fix this issue and am working on it. > >>>> > >>>> However, I re-checked, and didn't find the RAT issue when building > Hive from sources - the build passed with this command: > >>>> "mvn clean install -Pdist,itests,iceberg -DskipTests" > >>>> > >>>> Thanks, > >>>> Dmitriy Fingerman > >>>> > >>>> On Wed, Nov 12, 2025 at 9:39 PM Butao Zhang <[email protected]> > wrote: > >>>>> > >>>>> Hi Dmitriy, > >>>>> > >>>>> Thanks for driving the release! > >>>>> I tried build the hive & standalone HMS using the source packages, > but failed. Please see the following details: > >>>>> > >>>>> ----------------------Hive binary package and src package > validations:----------------------- > >>>>> [1] Verified signatures and checksums OK > >>>>> > >>>>> [2] Failed built from hive source apache-hive-4.2.0-src.tar.gz: > >>>>> [ERROR] Failed to execute goal > org.apache.rat:apache-rat-plugin:0.16.1:check (default) on project hive: > Too many files with unapproved license: 11 See RAT report in: > /data/work/hive420rel/apache-hive-4.2.0-src/target/rat.txt -> [Help 1] > >>>>> [ERROR] > >>>>> [ERROR] To see the full stack trace of the errors, re-run Maven with > the -e switch. > >>>>> [ERROR] Re-run Maven using the -X switch to enable full debug > logging. > >>>>> [ERROR] > >>>>> [ERROR] For more information about the errors and possible > solutions, please read the following articles: > >>>>> [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException > >>>>> [ERROR] > >>>>> [ERROR] After correcting the problems, you can resume the build with > the command > >>>>> [ERROR] mvn <args> -rf :hive > >>>>> > >>>>> > >>>>> --------------------Standalone HMS binary package and src package > validations:------------------ > >>>>> [1] Verified signatures and checksums OK > >>>>> > >>>>> [2] Failed built from Standalone HMS source > hive-standalone-metastore-4.2.0-src.tar.gz: > >>>>> [INFO] Scanning for projects... > >>>>> [ERROR] [ERROR] Some problems were encountered while processing the > POMs: > >>>>> [ERROR] Child module > /data/work/hive420rel/apache-hive-metastore-4.2.0-src/metastore-client of > /data/work/hive420rel/apache-hive-metastore-4.2.0-src/pom.xml does not > exist @ > >>>>> @ > >>>>> [ERROR] The build could not read 1 project -> [Help 1] > >>>>> [ERROR] > >>>>> [ERROR] The project org.apache.hive:hive-standalone-metastore:4.2.0 > (/data/work/hive420rel/apache-hive-metastore-4.2.0-src/pom.xml) has 1 error > >>>>> [ERROR] Child module > /data/work/hive420rel/apache-hive-metastore-4.2.0-src/metastore-client of > /data/work/hive420rel/apache-hive-metastore-4.2.0-src/pom.xml does not exist > >>>>> [ERROR] > >>>>> [ERROR] To see the full stack trace of the errors, re-run Maven with > the -e switch. > >>>>> [ERROR] Re-run Maven using the -X switch to enable full debug > logging. > >>>>> [ERROR] > >>>>> [ERROR] For more information about the errors and possible > solutions, please read the following articles: > >>>>> [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException > >>>>> > >>>>> > >>>>> > >>>>> ---- Replied Message ---- > >>>>> FromDmitriy Fingerman<[email protected]> > >>>>> Date11/13/2025 08:36 > >>>>> To<[email protected]> > >>>>> Subject[VOTE] Apache Hive 4.2.0 Release Candidate 0 > >>>>> Hello Apache Hive community, > >>>>> > >>>>> This is a call for vote to release Apache Hive 4.2.0 Release > Candidate 0. > >>>>> > >>>>> > >>>>> Apache Hive 4.2.0 Release Candidate 0 is available here: > >>>>> https://dist.apache.org/repos/dist/dev/hive/hive-4.2.0/ > >>>>> > https://dist.apache.org/repos/dist/dev/hive/hive-standalone-metastore-4.2.0/ > >>>>> > >>>>> > >>>>> The checksums are these: > >>>>> 8984a57af22c40119df88235e8d909e794d9844d1adad49eb860ae8b8113a549 > apache-hive-4.2.0-bin.tar.gz > >>>>> fd8b19c679aaa53da2dca882576c5f4aa95824c70ffe1c96f73379bd418d79a3 > apache-hive-4.2.0-src.tar.gz > >>>>> db38b0b8eac65954071237b48e9c03b0e4780388ab1d99839812cc522b7c74c0 > hive-standalone-metastore-4.2.0-bin.tar.gz > >>>>> 5b757295d07fec4226ff6411047b4a3ab34a2f9e4dadf9b522f65db27d009a04 > hive-standalone-metastore-4.2.0-src.tar.gz > >>>>> > >>>>> > >>>>> You can find the KEYS file here: > >>>>> https://downloads.apache.org/hive/KEYS > >>>>> > >>>>> > >>>>> Maven artifacts are available here: > >>>>> > https://repository.apache.org/content/repositories/orgapachehive-1141/ > >>>>> > >>>>> > >>>>> The tag release-4.2.0-rc0 has been applied to the source for this > release in github, you can see it at > >>>>> https://github.com/apache/hive/tree/rel/release-4.2.0-rc0 > >>>>> > >>>>> > >>>>> The git commit hash is: > >>>>> > https://github.com/apache/hive/commit/76e72a2b1d7406a9ff0ef79ed7329e5b20403dde > >>>>> > >>>>> > >>>>> The vote is open for the next 72 hours and passes if a majority of > at least > >>>>> three +1 PMC votes are cast. > >>>>> > >>>>> > >>>>> (Only PMC members have binding votes, however, other community > members > >>>>> are encouraged to cast non-binding votes.) > >>>>> > >>>>> > >>>>> [ ] +1 Release this package as Apache Hive 4.2.0 > >>>>> [ ] +0 > >>>>> [ ] -1 Do not release this because... > >>>>> > >>>>> > >>>>> Please download, verify, and test. > >>>>> > >>>>> > >>>>> > >>>>> Thanks, > >>>>> Dmitriy Fingerman >
