We can modify the Dockerfile to wget the necessary driver and copy it to /opt/hive/lib/ . This should make it work. The diff is attached below:
diff --git a/packaging/src/docker/Dockerfile b/packaging/src/docker/Dockerfile --- a/packaging/src/docker/Dockerfile (revision dceaf810b32fc266e3e657fdaefcd4507f2191b5) +++ b/packaging/src/docker/Dockerfile (date 1702897518609) @@ -80,6 +80,9 @@ ENV PATH=$HIVE_HOME/bin:$HADOOP_HOME/bin:$PATH +RUN wget https://repo1.maven.org/maven2/org/postgresql/postgresql/42.5.1/postgresql-42.5.1.jar +RUN cp /postgresql-42.5.1.jar /opt/hive/lib/ + COPY entrypoint.sh / COPY conf $HIVE_HOME/conf RUN chmod +x /entrypoint.sh On Mon, Dec 18, 2023, 12:59 PM Ayush Saxena <ayush...@gmail.com> wrote: > I think the similar problem is being chased as part of > https://github.com/apache/hive/pull/4948 > > On Mon, 18 Dec 2023 at 09:48, Sanjay Gupta <sanja...@gmail.com> wrote: > > > > > > > > > > Issue with Docker container using mysql RDBMS ( Failed to load driver) > > > > https://hub.docker.com/r/apache/hive > > > > According to readme > > > > Launch Standalone Metastore With External RDBMS > (Postgres/Oracle/MySql/MsSql) > > > > I want to use MySQL > > > > I tried com.mysql.jdbc.Driver or com.mysql.cj.jdbc.Driver > > > > docker run -it -d -p 9083:9083 --env SERVICE_NAME=metastore > --add-host=host.docker.internal:host-gateway \ > > --env DB_DRIVER=mysql \ > > --env > SERVICE_OPTS="-Djavax.jdo.option.ConnectionDriverName=com.mysql.jdbc.Driver > -Djavax.jdo.option.ConnectionURL=jdbc:mysql://host.docker.internal:3306/hive?createDatabaseIfNotExist=true > -Djavax.jdo.option.ConnectionUserName=hive > -Djavax.jdo.option.ConnectionPassword=password" \ > > --mount source=warehouse,target=/opt/hive/data/warehouse \ > > --name metastore-standalone apache/hive:${HIVE_VERSION} > > > > > > docker run -it -d -p 9083:9083 --env SERVICE_NAME=metastore > --add-host=host.docker.internal:host-gateway \ > > --env DB_DRIVER=mysql \ > > --env > SERVICE_OPTS="-Djavax.jdo.option.ConnectionDriverName=com.mysql.cj.jdbc.Driver > -Djavax.jdo.option.ConnectionURL=jdbc:mysql://host.docker.internal:3306/hive?createDatabaseIfNotExist=true > -Djavax.jdo.option.ConnectionUserName=hive > -Djavax.jdo.option.ConnectionPassword=password" \ > > --mount source=warehouse,target=/opt/hive/data/warehouse \ > > --name metastore-standalone apache/hive:${HIVE_VERSION} > > > > Docker logs shows this for both drivers ( same error ) > > > > docker logs f3 > > + : mysql > > + SKIP_SCHEMA_INIT=false > > + export HIVE_CONF_DIR=/opt/hive/conf > > + HIVE_CONF_DIR=/opt/hive/conf > > + '[' -d '' ']' > > + export 'HADOOP_CLIENT_OPTS= -Xmx1G > -Djavax.jdo.option.ConnectionDriverName=com.mysql.cj.jdbc.Driver > -Djavax.jdo.option.ConnectionURL=jdbc:mysql://host.docker.internal:3306/hive?createDatabaseIfNotExist=true > -Djavax.jdo.option.ConnectionUserName=hive > -Djavax.jdo.option.ConnectionPassword=hive' > > + HADOOP_CLIENT_OPTS=' -Xmx1G > -Djavax.jdo.option.ConnectionDriverName=com.mysql.cj.jdbc.Driver > -Djavax.jdo.option.ConnectionURL=jdbc:mysql://host.docker.internal:3306/hive?createDatabaseIfNotExist=true > -Djavax.jdo.option.ConnectionUserName=hive > -Djavax.jdo.option.ConnectionPassword=hive' > > + [[ false == \f\a\l\s\e ]] > > + initialize_hive > > + /opt/hive/bin/schematool -dbType mysql -initSchema > > SLF4J: Class path contains multiple SLF4J bindings. > > SLF4J: Found binding in > [jar:file:/opt/hive/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] > > SLF4J: Found binding in > [jar:file:/opt/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] > > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an > explanation. > > SLF4J: Actual binding is of type > [org.apache.logging.slf4j.Log4jLoggerFactory] > > Metastore connection URL: > jdbc:mysql://host.docker.internal:3306/hive?createDatabaseIfNotExist=true > > Metastore Connection Driver : com.mysql.cj.jdbc.Driver > > Metastore connection User: hive > > org.apache.hadoop.hive.metastore.HiveMetaException: Failed to load driver > > Underlying cause: java.lang.ClassNotFoundException : > com.mysql.cj.jdbc.Driver > > Use --verbose for detailed stacktrace. > > *** schemaTool failed *** > > + '[' 1 -eq 0 ']' > > + echo 'Schema initialization failed!' > > Schema initialization failed! > > + exit 1 > > > > Any idea, why I am getting failed to load driver for MySQL DB. > > > > Isn't docker container comes with MySQL Driver ? > > > > Docker container exits so I can't check whether driver is already > installed. > > > > Let me know, what I can do to make it work. > > > > -- > > > > > > Thanks > > Sanjay Gupta > > > > > > > > -- > > > > Thanks > > Sanjay Gupta > > > > > > > > -- > > > > Thanks > > Sanjay Gupta > > >
