Hi Zoltán, Thank you for the suggestion! Switching to the maven:3-eclipse-temurin-8-focal image resolved the compilation error. The build is now completing successfully.
Best regards, Andor On Mon, 2 Dec 2024 at 15:47, Zoltán Rátkai <[email protected]> wrote: > Hi Andor, > > I tried to build it on my machine and managed without any problems. I am > not sure what is the issue when building it with docker. > Try with JDK8, since 17 support is on it's way and not yet finished. > > Regards, > > Zoltán > > On Mon, Dec 2, 2024 at 2:26 PM Márkus Andor Rudolf <[email protected]> > wrote: > >> Hi Stamatis, >> >> Thank you for the detailed build instructions. I understand the reasoning >> behind discontinuing separate standalone builds, and I appreciate the >> guidance on building it myself. >> >> Following your instructions, I attempted to create a Dockerfile ( >> attached below ) for the build process. However, I'm encountering the >> following error during compilation: >> >> [ERROR] >> /hive/apache-hive-4.0.1-src/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/security/DelegationTokenTool.java:[74,12] >> cannot access org.apache.hadoop.shaded.org.apache.commons.cli.Options >> [ERROR] class file for >> org.apache.hadoop.shaded.org.apache.commons.cli.Options not found >> >> >> As primarily a Python developer with no Java experience, I'm finding it >> challenging to resolve this dependency issue. Any guidance on addressing >> this error would be greatly appreciated. >> >> Best regards, >> Andor >> >> On Mon, 2 Dec 2024 at 10:50, Stamatis Zampetakis <[email protected]> >> wrote: >> >>> Hi Andor, >>> >>> The Hive community is not doing separate releases for standalone >>> metastore anymore because it adds overhead to the release process. >>> Since now we never had requests to provide these individual binaries. >>> >>> The functionality is still there so you may be able to construct the >>> standalone metastore binaries by building them yourself from the >>> source code by following the steps below: >>> >>> Download an Apache Hive source code distribution from the website and >>> do the following. >>> >>> $ tar -xvf apache-hive-4.0.1-src.tar.gz >>> $ cd apache-hive-4.0.1-src/standalone-metastore/ >>> $ mvn clean install -DskipTests -Pdist >>> $ ls -lh metastore-server/target/*bin* >>> -rw-rw-r-- 1 XXX XXX 74M Dec 2 10:39 >>> >>> metastore-server/target/apache-hive-standalone-metastore-server-4.0.1-bin.tar.gz >>> >>> Note that the content of the binaries are not verified since it's been >>> a while that we haven't used this code path. >>> >>> Best, >>> Stamatis >>> >>> On Mon, Dec 2, 2024 at 9:59 AM Márkus Andor Rudolf >>> <[email protected]> wrote: >>> > >>> > Hi Zoltán, >>> > >>> > Thank you for your response. Let me provide additional context about >>> our specific use case. >>> > >>> > We're running Spark on Kubernetes where we need Hive Metastore >>> Standalone as a sidecar container in our Spark driver pod. This setup >>> enables secure communication between Spark and our MySQL metastore >>> database. We specifically require the "Hive metastore thrift service >>> through thrift:// protocol" integration, as the "Hive metastore Database >>> through JDBC" approach would expose sensitive credentials. >>> > >>> > Pod startup time is critical in our environment, and we've invested >>> significant effort in optimizing our sidecar image size to under 350MB. The >>> default Hive images at ~1GB are too large for our requirements. >>> > >>> > For this reason, we're specifically looking to build a minimal Hive >>> Metastore Standalone distribution, similar to what was available in Hive >>> 3.0.0 (hive-standalone-metastore-3.1.3-bin.tar.gz). Could you please advise >>> on how to build such a minimal distribution for Hive 4.x? >>> > >>> > Best regards, >>> > Andor >>> > >>> > On Mon, 2 Dec 2024 at 09:45, Zoltán Rátkai <[email protected]> >>> wrote: >>> >> >>> >> Hi Andor Rudolf, >>> >> >>> >> you can start metastore with >>> >> >>> >> hive --service metastore >>> >> >>> >> Since Hive 4 there is a docker image you can experience with: >>> >> >>> >> https://hub.docker.com/r/apache/hive >>> >> https://hive.apache.org/developement/quickstart/ >>> >> >>> >> It show you how you can start standalon Metastore with different DBs. >>> >> >>> >> Regards, >>> >> >>> >> Zoltán Rátkai >>> >> >>> >> On Fri, Nov 29, 2024 at 11:50 PM Márkus Andor Rudolf < >>> [email protected]> wrote: >>> >>> >>> >>> Dear Hive community, >>> >>> >>> >>> I'm trying to build standalone metastore binary (similar to >>> hive-standalone-metastore-3.1.3-bin.tar.gz) for Hive 4.0.0/4.0.1. I >>> noticed that while these binaries were published to Maven Central for Hive >>> 3.0.0-3.1.3, they are not available for the 4.x releases. >>> >>> >>> >>> Could someone please provide guidance on the correct build procedure >>> for the standalone metastore binary in Hive 4.x ? >>> >>> >>> >>> Thanks in advance for any help! >>> >>> >>> >>> Best regards, >>> >>> Andor >>> >>
