Re: Spark on K8s with Romana

[Yinan Li]

We actually moved away from using the driver pod IP because of
https://github.com/apache-spark-on-k8s/spark/issues/482. The current way
this works is that the driver url is constructed based on the value of
"spark.driver.host" that is set to the DNS name of the headless driver
service in the submission client. So the assumption is that kube-dns exists
and is working. Unfortunately, this is not configurable.


On Mon, Feb 12, 2018 at 1:21 PM, Jenna Hoole  wrote:

> So, we've run into something interesting. In our case, we've got some
> proprietary networking HW which is very feature limited in the TCP/IP
> space, so using Romana, executors can't seem to find the driver using the
> hostname lookup method it's attempting. Is there any way to make it use IP?
>
> Thanks,
> Jenna
>

Spark on K8s with Romana

[Jenna Hoole]

So, we've run into something interesting. In our case, we've got some
proprietary networking HW which is very feature limited in the TCP/IP
space, so using Romana, executors can't seem to find the driver using the
hostname lookup method it's attempting. Is there any way to make it use IP?

Thanks,
Jenna