This is an automated email from the ASF dual-hosted git repository.
dengzh pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git
The following commit(s) were added to refs/heads/master by this push:
new b914b6a29ba HIVE-28437: Add documentation for initializing the system
schemas for HiveServer2 for Docker Image (#5629)
b914b6a29ba is described below
commit b914b6a29ba0b1fab5e64034ee289e2deaa1a844
Author: Ling Hengqian <[email protected]>
AuthorDate: Tue Feb 11 08:55:53 2025 +0800
HIVE-28437: Add documentation for initializing the system schemas for
HiveServer2 for Docker Image (#5629)
---
packaging/src/docker/README.md | 98 ++++++++++++++++++++++++++++++++++++++
packaging/src/docker/entrypoint.sh | 4 +-
2 files changed, 100 insertions(+), 2 deletions(-)
diff --git a/packaging/src/docker/README.md b/packaging/src/docker/README.md
index 5ed8cb1e3ee..5b1b5f0debb 100644
--- a/packaging/src/docker/README.md
+++ b/packaging/src/docker/README.md
@@ -210,3 +210,101 @@ docker compose down
select count(distinct a) from hive_example;
select sum(b) from hive_example;
```
+
+#### `sys` Schema and `information_schema` Schema
+
+`Hive Schema Tool` is located in the Docker Image at
`/opt/hive/bin/schematool`.
+
+By default, system schemas such as `information_schema` for HiveServer2 are
not created.
+To create system schemas for a HiveServer2 instance,
+users need to configure the Hive Metastore Server used by HiveServer2 to use a
database other than the embedded Derby.
+The following text discusses how to configure HiveServer2 when the Hive
Metastore Server is in different locations.
+
+##### HiveServer2 with embedded Hive Metastore Server
+
+Assuming `Maven` and `Docker CE` are installed, a possible use case is as
follows.
+Create a `compose.yaml` file in the current directory,
+
+```yaml
+services:
+ some-postgres:
+ image: postgres:17.2-bookworm
+ environment:
+ POSTGRES_PASSWORD: "example"
+ hiveserver2-standalone:
+ image: apache/hive:4.0.1
+ depends_on:
+ - some-postgres
+ environment:
+ SERVICE_NAME: hiveserver2
+ DB_DRIVER: postgres
+ SERVICE_OPTS: >-
+ -Djavax.jdo.option.ConnectionDriverName=org.postgresql.Driver
+
-Djavax.jdo.option.ConnectionURL=jdbc:postgresql://some-postgres:5432/postgres
+ -Djavax.jdo.option.ConnectionUserName=postgres
+ -Djavax.jdo.option.ConnectionPassword=example
+ volumes:
+ -
~/.m2/repository/org/postgresql/postgresql/42.7.5/postgresql-42.7.5.jar:/opt/hive/lib/postgres.jar
+```
+
+Then execute the shell command as follows to initialize the system schemas in
HiveServer2.
+
+```shell
+mvn dependency:get -Dartifact=org.postgresql:postgresql:42.7.5
+docker compose up -d
+docker compose exec hiveserver2-standalone /bin/bash
+/opt/hive/bin/schematool -initSchema -dbType hive -metaDbType postgres -url
jdbc:hive2://localhost:10000/default
+exit
+```
+
+##### HiveServer2 using a remote Hive Metastore Server
+
+Assuming `Maven` and `Docker CE` are installed, a possible use case is as
follows.
+Create a `compose.yaml` file in the current directory,
+
+```yaml
+services:
+ some-postgres:
+ image: postgres:17.2-bookworm
+ environment:
+ POSTGRES_PASSWORD: "example"
+ metastore-standalone:
+ image: apache/hive:4.0.1
+ depends_on:
+ - some-postgres
+ environment:
+ SERVICE_NAME: metastore
+ DB_DRIVER: postgres
+ SERVICE_OPTS: >-
+ -Djavax.jdo.option.ConnectionDriverName=org.postgresql.Driver
+
-Djavax.jdo.option.ConnectionURL=jdbc:postgresql://some-postgres:5432/postgres
+ -Djavax.jdo.option.ConnectionUserName=postgres
+ -Djavax.jdo.option.ConnectionPassword=example
+ volumes:
+ -
~/.m2/repository/org/postgresql/postgresql/42.7.5/postgresql-42.7.5.jar:/opt/hive/lib/postgres.jar
+ hiveserver2-standalone:
+ image: apache/hive:4.0.1
+ depends_on:
+ - metastore-standalone
+ environment:
+ SERVICE_NAME: hiveserver2
+ IS_RESUME: true
+ SERVICE_OPTS: >-
+ -Djavax.jdo.option.ConnectionDriverName=org.postgresql.Driver
+
-Djavax.jdo.option.ConnectionURL=jdbc:postgresql://some-postgres:5432/postgres
+ -Djavax.jdo.option.ConnectionUserName=postgres
+ -Djavax.jdo.option.ConnectionPassword=example
+ -Dhive.metastore.uris=thrift://metastore-standalone:9083
+ volumes:
+ -
~/.m2/repository/org/postgresql/postgresql/42.7.5/postgresql-42.7.5.jar:/opt/hive/lib/postgres.jar
+```
+
+Then execute the shell command as follows to initialize the system schemas in
HiveServer2.
+
+```shell
+mvn dependency:get -Dartifact=org.postgresql:postgresql:42.7.5
+docker compose up -d
+docker compose exec hiveserver2-standalone /bin/bash
+/opt/hive/bin/schematool -initSchema -dbType hive -metaDbType postgres -url
jdbc:hive2://localhost:10000/default
+exit
+```
diff --git a/packaging/src/docker/entrypoint.sh
b/packaging/src/docker/entrypoint.sh
index f22652c2afb..5d44d563170 100644
--- a/packaging/src/docker/entrypoint.sh
+++ b/packaging/src/docker/entrypoint.sh
@@ -31,9 +31,9 @@ function initialize_hive {
fi
$HIVE_HOME/bin/schematool -dbType $DB_DRIVER $COMMAND $VERBOSE_MODE
if [ $? -eq 0 ]; then
- echo "Initialized schema successfully.."
+ echo "Initialized Hive Metastore Server schema successfully.."
else
- echo "Schema initialization failed!"
+ echo "Hive Metastore Server schema initialization failed!"
exit 1
fi
}
