alanwake created HIVE-23896:
-------------------------------
Summary: hiveserver2 not listening on any port, am i miss some
configurations?
Key: HIVE-23896
URL: https://issues.apache.org/jira/browse/HIVE-23896
Project: Hive
Issue Type: Bug
Components: HiveServer2
Affects Versions: 3.1.2
Environment: hive: 3.1.2
hadoop: 3.2.1, standalone, url: hdfs://namenode.hadoop.svc.cluster.local:9000
{quote}$ $HADOOP_HOME/bin/hadoop fs -mkdir /tmp
$ $HADOOP_HOME/bin/hadoop fs -mkdir /user/hive/warehouse
{quote}
hadoop commands are workable in the hiveserver node(POD).
Reporter: alanwake
i try deply hive 3.1.2 on k8s. it was worked on version 2.3.2.
metastore node and postgres node are ok, but hiveserver look like i miss some
important configuration properties?
{code:java}
{code}
{code:java}
[root@master hive]# ./get.sh
NAME READY STATUS RESTARTS AGE IP
NODE NOMINATED NODE READINESS GATES
hive-7bd48747d4-5zjmh 1/1 Running 0 56s 10.244.3.110
node03.51.local <none> <none>
metastore-66b58f9f76-6wsxj 1/1 Running 0 56s 10.244.3.109
node03.51.local <none> <none>
postgres-57794b99b7-pqxwm 1/1 Running 0 56s 10.244.2.241
node02.51.local <none> <none>NAME TYPE CLUSTER-IP
EXTERNAL-IP PORT(S) AGE SELECTOR
hive NodePort 10.108.40.17 <none>
10002:30626/TCP,10000:31845/TCP 56s app=hive
metastore ClusterIP 10.106.159.220 <none> 9083/TCP
56s app=metastore
postgres ClusterIP 10.108.85.47 <none> 5432/TCP
56s app=postgres
{code}
{code:java}
[root@master hive]# kubectl logs hive-7bd48747d4-5zjmh -n=hive
Configuring core
- Setting hadoop.proxyuser.hue.hosts=*
- Setting fs.defaultFS=hdfs://namenode.hadoop.svc.cluster.local:9000
- Setting hadoop.http.staticuser.user=root
- Setting hadoop.proxyuser.hue.groups=*
Configuring hdfs
- Setting dfs.namenode.datanode.registration.ip-hostname-check=false
- Setting dfs.webhdfs.enabled=true
- Setting dfs.permissions.enabled=false
Configuring yarn
- Setting yarn.timeline-service.enabled=true
- Setting yarn.resourcemanager.system-metrics-publisher.enabled=true
- Setting
yarn.resourcemanager.store.class=org.apache.hadoop.yarn.server.resourcemanager.recovery.FileSystemRMStateStore
- Setting
yarn.log.server.url=http://historyserver.hadoop.svc.cluster.local:8188/applicationhistory/logs/
- Setting yarn.resourcemanager.fs.state-store.uri=/rmstate
- Setting yarn.timeline-service.generic-application-history.enabled=true
- Setting yarn.log-aggregation-enable=true
- Setting
yarn.resourcemanager.hostname=resourcemanager.hadoop.svc.cluster.local
- Setting
yarn.resourcemanager.resource.tracker.address=resourcemanager.hadoop.svc.cluster.local:8031
- Setting yarn.timeline-service.hostname=historyserver.hadoop.svc.cluster.local
- Setting
yarn.resourcemanager.scheduler.address=resourcemanager.hadoop.svc.cluster.local:8030
- Setting
yarn.resourcemanager.address=resourcemanager.hadoop.svc.cluster.local:8032
- Setting yarn.nodemanager.remote-app-log-dir=/app-logs
- Setting yarn.resourcemanager.recovery.enabled=true
Configuring httpfs
Configuring kms
Configuring mapred
Configuring hive
- Setting datanucleus.autoCreateSchema=false
- Setting javax.jdo.option.ConnectionPassword=hive
- Setting hive.metastore.uris=thrift://metastore:9083
- Setting javax.jdo.option.ConnectionURL=jdbc:postgresql://metastore/metastore
- Setting javax.jdo.option.ConnectionUserName=hive
- Setting javax.jdo.option.ConnectionDriverName=org.postgresql.Driver
Configuring for multihomed network
[1/100] check for metastore:9083...
[1/100] metastore:9083 is not available yet
[1/100] try in 5s once again ...
[2/100] check for metastore:9083...
[2/100] metastore:9083 is not available yet
[2/100] try in 5s once again ...
[3/100] check for metastore:9083...
[3/100] metastore:9083 is not available yet
[3/100] try in 5s once again ...
[4/100] check for metastore:9083...
[4/100] metastore:9083 is not available yet
[4/100] try in 5s once again ...
[5/100] metastore:9083 is available.
mkdir: `/tmp': File exists
2020-07-22 07:15:33: Starting HiveServer2
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/opt/hadoop-3.2.1/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Hive Session ID = c86e1a7f-e18c-4c04-a8ba-1179c235fdce
Hive Session ID = 6f036ed3-5041-4479-ad99-eebc193a110a
{code}
----
{code:java}
[root@master hive]# kubectl exec -it hive-7bd48747d4-5zjmh -n=hive /bin/bash
root@hive-7bd48747d4-5zjmh:/opt# ps -ef > 1.txt
root@hive-7bd48747d4-5zjmh:/opt# cat 1.txt
UID PID PPID C STIME TTY TIME CMD
root 1 0 0 07:15 ? 00:00:00 /bin/sh -c startup.sh
root 269 1 0 07:15 ? 00:00:00 /bin/bash
/usr/local/bin/startup.sh
root 471 269 3 07:15 ? 00:00:05
/usr/lib/jvm/java-8-openjdk-amd64//bin/java -Dproc_jar -Dproc_hiveserver2
-Dlog4j.configurationFile=hive-log4j2.properties
-Djava.util.logging.config.file=/opt/hive/conf/parquet-logging.properties
-Dyarn.log.dir=/opt/hadoop-3.2.1/logs -Dyarn.log.file=hadoop.log
-Dyarn.home.dir=/opt/hadoop-3.2.1 -Dyarn.root.logger=INFO,console
-Djava.library.path=/opt/hadoop-3.2.1/lib/native -Xmx256m
-Dhadoop.log.dir=/opt/hadoop-3.2.1/logs -Dhadoop.log.file=hadoop.log
-Dhadoop.home.dir=/opt/hadoop-3.2.1 -Dhadoop.id.str=root
-Dhadoop.root.logger=INFO,console -Dhadoop.policy.file=hadoop-policy.xml
-Dhadoop.security.logger=INFO,NullAppender org.apache.hadoop.util.RunJar
/opt/hive/lib/hive-service-3.1.2.jar org.apache.hive.service.server.HiveServer2
--hiveconf hive.server2.enable.doAs=false
root 555 0 0 07:17 pts/0 00:00:00 /bin/bash
root 561 555 0 07:18 pts/0 00:00:00 ps -ef
root@hive-7bd48747d4-5zjmh:/opt# netstat -lptn
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address Foreign Address State
PID/Program name
root@hive-7bd48747d4-5zjmh:/opt#
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
