[
https://issues.apache.org/jira/browse/SPARK-29640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963059#comment-16963059
]
Andy Grove commented on SPARK-29640:
------------------------------------
Installing node local dns cache daemon might be another workaround for this
issue:
https://github.com/kubernetes/kubernetes/issues/56903#issuecomment-511750647
> [K8S] Make it possible to set DNS option to use TCP instead of UDP
> ------------------------------------------------------------------
>
> Key: SPARK-29640
> URL: https://issues.apache.org/jira/browse/SPARK-29640
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 2.4.4
> Reporter: Andy Grove
> Priority: Major
> Fix For: 2.4.5
>
>
> We are running into intermittent DNS issues where the Spark driver fails to
> resolve "kubernetes.default.svc" and this seems to be caused by
> [https://github.com/kubernetes/kubernetes/issues/76790]
> One suggested workaround is to specify TCP mode for DNS lookups in the pod
> spec
> ([https://github.com/kubernetes/kubernetes/issues/56903#issuecomment-424498508]).
> I would like the ability to provide a flag to spark-submit to specify to use
> TCP mode for DNS lookups.
> I am working on a PR for this.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
