Song Jun created HIVE-19894: ------------------------------- Summary: remote spark driver can use ip to connect Hive Client Key: HIVE-19894 URL: https://issues.apache.org/jira/browse/HIVE-19894 Project: Hive Issue Type: Improvement Components: Spark Reporter: Song Jun
There is no DNS in some real cluster network. When we create a HiveClient in a Gateway machine, and submit a sql for HiveonSpark, then 1. the HiveClient will spark-submit a RemoteDriver class to YARN cluster, with args --remote-host which value is the Gateway hostname 2. the RemoteDriver which run on one slave of the YARN cluster, and it will connect to Gateway use the value of arg(--remote-host) 3. if the slave do not resolve the Gateway hostname(no DNS),it will connect failed So, we can use ip of the Gateway for the --remote-host , and the slave can use ip to connect Hive Client on the Gateway -- This message was sent by Atlassian JIRA (v7.6.3#76005)