Song Jun created HIVE-19894:
-------------------------------
Summary: remote spark driver can use ip to connect Hive Client
Key: HIVE-19894
URL: https://issues.apache.org/jira/browse/HIVE-19894
Project: Hive
Issue Type: Improvement
Components: Spark
Reporter: Song Jun
There is no DNS in some real cluster network.
When we create a HiveClient in a Gateway machine, and submit a sql for
HiveonSpark, then
1. the HiveClient will spark-submit a RemoteDriver class to YARN cluster, with
args --remote-host which value is the Gateway hostname
2. the RemoteDriver which run on one slave of the YARN cluster, and it will
connect to Gateway use the value of arg(--remote-host)
3. if the slave do not resolve the Gateway hostname(no DNS),it will connect
failed
So, we can use ip of the Gateway for the --remote-host , and the slave can use
ip to connect Hive Client on the Gateway
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)