[
https://issues.apache.org/jira/browse/SPARK-30204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
vanderliang updated SPARK-30204:
--------------------------------
Description:
Current we can not configure the pod dns nameservers and searches when submit a
job via cli for kubernetes. However, this's a common scenarios for hybricloud
where we use public cloud compute resourses while with private dns.
{code:java}
//代码占位符
apiVersion: v1
kind: Pod
metadata:
namespace: default
name: dns-example
spec:
containers:
- name: test
image: nginx
dnsConfig:
nameservers:
- 1.2.3.4
searches:
- ns1.svc.cluster-domain.example
- my.dns.search.suffix
options:
- name: ndots
value: "2"
- name: edns0
{code}
As a result, we can use the following property to specify the pod dns config.
* spark.kubernetes.dnsConfig.nameservers, Comma separated list of the
Kubernetes dns nameservers for driver and executor.
* spark.kubernetes.dnsConfig.searches, Comma separated list of the Kubernetes
dns searches for driver and executor.
* spark.kubernetes.dnsConfig.options.[OptionVariableName], Add the dns option
variable specified by OptionVariableName to the Driver And Executor process.
The user can specify multiple of these to set multiple options variables.
was:
Current we can not configure the pod dns nameservers, searches and options when
submit a job via cli for kubernetes. However, this's a common scenarios for
hybricloud where we use public cloud compute resourses while with private dns.
{code:java}
//代码占位符
apiVersion: v1
kind: Pod
metadata:
namespace: default
name: dns-example
spec:
containers:
- name: test
image: nginx
dnsConfig:
nameservers:
- 1.2.3.4
searches:
- ns1.svc.cluster-domain.example
- my.dns.search.suffix
options:
- name: ndots
value: "2"
- name: edns0
{code}
> Support for config Pod DNS for Kubernetes
> -----------------------------------------
>
> Key: SPARK-30204
> URL: https://issues.apache.org/jira/browse/SPARK-30204
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 3.1.0
> Reporter: vanderliang
> Priority: Major
>
> Current we can not configure the pod dns nameservers and searches when submit
> a job via cli for kubernetes. However, this's a common scenarios for
> hybricloud where we use public cloud compute resourses while with private
> dns.
>
> {code:java}
> //代码占位符
> apiVersion: v1
> kind: Pod
> metadata:
> namespace: default
> name: dns-example
> spec:
> containers:
> - name: test
> image: nginx
> dnsConfig:
> nameservers:
> - 1.2.3.4
> searches:
> - ns1.svc.cluster-domain.example
> - my.dns.search.suffix
> options:
> - name: ndots
> value: "2"
> - name: edns0
> {code}
> As a result, we can use the following property to specify the pod dns config.
> * spark.kubernetes.dnsConfig.nameservers, Comma separated list of the
> Kubernetes dns nameservers for driver and executor.
> * spark.kubernetes.dnsConfig.searches, Comma separated list of the
> Kubernetes dns searches for driver and executor.
> * spark.kubernetes.dnsConfig.options.[OptionVariableName], Add the dns
> option variable specified by OptionVariableName to the Driver And Executor
> process. The user can specify multiple of these to set multiple options
> variables.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
