Andy Grove created SPARK-29640:
----------------------------------
Summary: [K8S] Make it possible to set DNS option to use TCP
instead of UDP
Key: SPARK-29640
URL: https://issues.apache.org/jira/browse/SPARK-29640
Project: Spark
Issue Type: Improvement
Components: Kubernetes
Affects Versions: 2.4.4
Reporter: Andy Grove
Fix For: 2.4.5
We are running into intermittent DNS issues where the Spark driver fails to
resolve "kubernetes.default.svc" and this seems to be caused by
[https://github.com/kubernetes/kubernetes/issues/76790]
One suggested workaround is to specify TCP mode for DNS lookups in the pod spec
([https://github.com/kubernetes/kubernetes/issues/56903#issuecomment-424498508]).
I would like the ability to provide a flag to spark-submit to specify to use
TCP mode for DNS lookups.
I am working on a PR for this.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
