We actually moved away from using the driver pod IP because of https://github.com/apache-spark-on-k8s/spark/issues/482. The current way this works is that the driver url is constructed based on the value of "spark.driver.host" that is set to the DNS name of the headless driver service in the submission client. So the assumption is that kube-dns exists and is working. Unfortunately, this is not configurable.
On Mon, Feb 12, 2018 at 1:21 PM, Jenna Hoole <jenna.ho...@gmail.com> wrote: > So, we've run into something interesting. In our case, we've got some > proprietary networking HW which is very feature limited in the TCP/IP > space, so using Romana, executors can't seem to find the driver using the > hostname lookup method it's attempting. Is there any way to make it use IP? > > Thanks, > Jenna >
