[jira] [Comment Edited] (SPARK-45278) Make Yarn executor's bindAddress configurable
[ https://issues.apache.org/jira/browse/SPARK-45278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17767932#comment-17767932 ] Hendra Saputra edited comment on SPARK-45278 at 9/25/23 9:19 AM: - PR is up for review [https://github.com/apache/spark/pull/42870] Thanks was (Author: JIRAUSER302328): PR is up for review [https://github.com/apache/spark/pull/42870.] Thanks > Make Yarn executor's bindAddress configurable > - > > Key: SPARK-45278 > URL: https://issues.apache.org/jira/browse/SPARK-45278 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 3.5.0 >Reporter: Hendra Saputra >Assignee: Nishchal Venkataramana >Priority: Major > Labels: pull-request-available > > An improvement has been made in SPARK-24203 that executor's bind address is > configurable. Unfortunately this configuration hasn't implemented in Yarn. > When Yarn cluster is deployed in in Kubernetes, it is preferable to bind the > executor to loopback interface or all interface. This Jira is to allow Yarn > to bind the executor to either pod IP or loopbak interface or all interface > to allow mesh integration like Istio with the cluster. > Another linked Jira explained *Allowing binding to all IPs* very well > SPARK-42411 -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45278) Make Yarn executor's bindAddress configurable
[ https://issues.apache.org/jira/browse/SPARK-45278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hendra Saputra updated SPARK-45278: --- Fix Version/s: (was: 4.0.0) (was: 3.5.1) > Make Yarn executor's bindAddress configurable > - > > Key: SPARK-45278 > URL: https://issues.apache.org/jira/browse/SPARK-45278 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 3.5.0 >Reporter: Hendra Saputra >Assignee: Nishchal Venkataramana >Priority: Major > Labels: pull-request-available > > An improvement has been made in SPARK-24203 that executor's bind address is > configurable. Unfortunately this configuration hasn't implemented in Yarn. > When Yarn cluster is deployed in in Kubernetes, it is preferable to bind the > executor to loopback interface or all interface. This Jira is to allow Yarn > to bind the executor to either pod IP or loopbak interface or all interface > to allow mesh integration like Istio with the cluster. > Another linked Jira explained *Allowing binding to all IPs* very well > SPARK-42411 -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45278) Make Yarn executor's bindAddress configurable
[ https://issues.apache.org/jira/browse/SPARK-45278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hendra Saputra updated SPARK-45278: --- Fix Version/s: 4.0.0 3.5.1 (was: 3.0.0) Affects Version/s: 3.5.0 (was: 4.0.0) (was: 3.5.1) > Make Yarn executor's bindAddress configurable > - > > Key: SPARK-45278 > URL: https://issues.apache.org/jira/browse/SPARK-45278 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 3.5.0 >Reporter: Hendra Saputra >Assignee: Nishchal Venkataramana >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0, 3.5.1 > > > An improvement has been made in SPARK-24203 that executor's bind address is > configurable. Unfortunately this configuration hasn't implemented in Yarn. > When Yarn cluster is deployed in in Kubernetes, it is preferable to bind the > executor to loopback interface or all interface. This Jira is to allow Yarn > to bind the executor to either pod IP or loopbak interface or all interface > to allow mesh integration like Istio with the cluster. > Another linked Jira explained *Allowing binding to all IPs* very well > SPARK-42411 -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-45278) Make Yarn executor's bindAddress configurable
[ https://issues.apache.org/jira/browse/SPARK-45278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17767932#comment-17767932 ] Hendra Saputra commented on SPARK-45278: PR is up for review [https://github.com/apache/spark/pull/42870.] Thanks > Make Yarn executor's bindAddress configurable > - > > Key: SPARK-45278 > URL: https://issues.apache.org/jira/browse/SPARK-45278 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 4.0.0, 3.5.1 >Reporter: Hendra Saputra >Assignee: Nishchal Venkataramana >Priority: Major > Labels: pull-request-available > Fix For: 3.0.0 > > > An improvement has been made in SPARK-24203 that executor's bind address is > configurable. Unfortunately this configuration hasn't implemented in Yarn. > When Yarn cluster is deployed in in Kubernetes, it is preferable to bind the > executor to loopback interface or all interface. This Jira is to allow Yarn > to bind the executor to either pod IP or loopbak interface or all interface > to allow mesh integration like Istio with the cluster. > Another linked Jira explained *Allowing binding to all IPs* very well > SPARK-42411 -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45278) Make Yarn executor's bindAddress configurable
[ https://issues.apache.org/jira/browse/SPARK-45278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hendra Saputra updated SPARK-45278: --- Description: An improvement has been made in SPARK-24203 that executor's bind address is configurable. Unfortunately this configuration hasn't implemented in Yarn. When Yarn cluster is deployed in in Kubernetes, it is preferable to bind the executor to loopback interface or all interface. This Jira is to allow Yarn to bind the executor to either pod IP or loopbak interface or all interface to allow mesh integration like Istio with the cluster. Another linked Jira explained *Allowing binding to all IPs* very well SPARK-42411 was: An improvement has been made in SPARK-24203 that executor's bind address is configurable. Unfortunately this configuration hasn't implemented in Yarn. When Yarn cluster is deployed in in Kubernetes, it is preferable to bind the executor to loopback interface or all interface. This Jira is to allow Yarn to bind the executor to either pod IP or loopbak interface or all interface to allow mesh integration like Istio with the cluster. Another linked Jira explained this very well SPARK-42411 > Make Yarn executor's bindAddress configurable > - > > Key: SPARK-45278 > URL: https://issues.apache.org/jira/browse/SPARK-45278 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 4.0.0, 3.5.1 >Reporter: Hendra Saputra >Assignee: Nishchal Venkataramana >Priority: Major > Labels: pull-request-available > Fix For: 3.0.0 > > > An improvement has been made in SPARK-24203 that executor's bind address is > configurable. Unfortunately this configuration hasn't implemented in Yarn. > When Yarn cluster is deployed in in Kubernetes, it is preferable to bind the > executor to loopback interface or all interface. This Jira is to allow Yarn > to bind the executor to either pod IP or loopbak interface or all interface > to allow mesh integration like Istio with the cluster. > Another linked Jira explained *Allowing binding to all IPs* very well > SPARK-42411 -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45278) Make Yarn executor's bindAddress configurable
[ https://issues.apache.org/jira/browse/SPARK-45278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hendra Saputra updated SPARK-45278: --- Description: An improvement has been made in SPARK-24203 that executor's bind address is configurable. Unfortunately this configuration hasn't implemented in Yarn. When Yarn cluster is deployed in in Kubernetes, it is preferable to bind the executor to loopback interface or all interface. This Jira is to allow Yarn to bind the executor to either pod IP or loopbak interface or all interface to allow mesh integration like Istio with the cluster. Another linked Jira explained this very well SPARK-42411 was:An improvement has been made in SPARK-24203 that executor's bind address is configurable. Unfortunately this configuration hasn't implemented in Yarn. When Yarn cluster is deployed in in Kubernetes, it is preferable to bind the executor to loopback interface or all interface. This Jira is to allow Yarn to bind the executor to either pod IP or loopbak interface or all interface to allow mesh integration like Istio with the cluster > Make Yarn executor's bindAddress configurable > - > > Key: SPARK-45278 > URL: https://issues.apache.org/jira/browse/SPARK-45278 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 4.0.0, 3.5.1 >Reporter: Hendra Saputra >Assignee: Nishchal Venkataramana >Priority: Major > Labels: pull-request-available > Fix For: 3.0.0 > > > An improvement has been made in SPARK-24203 that executor's bind address is > configurable. Unfortunately this configuration hasn't implemented in Yarn. > When Yarn cluster is deployed in in Kubernetes, it is preferable to bind the > executor to loopback interface or all interface. This Jira is to allow Yarn > to bind the executor to either pod IP or loopbak interface or all interface > to allow mesh integration like Istio with the cluster. > Another linked Jira explained this very well SPARK-42411 -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45278) Make Yarn executor's bindAddress configurable
[ https://issues.apache.org/jira/browse/SPARK-45278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hendra Saputra updated SPARK-45278: --- Description: An improvement has been made in SPARK-24203 that executor's bind address is configurable. Unfortunately this configuration hasn't implemented in Yarn. When Yarn cluster is deployed in in Kubernetes, it is preferable to bind the executor to loopback interface or all interface. This Jira is to allow Yarn to bind the executor to either pod IP or loopbak interface or all interface to allow mesh integration like Istio with the cluster (was: Previous improvement is made that now Executor bind address is configurable in ) > Make Yarn executor's bindAddress configurable > - > > Key: SPARK-45278 > URL: https://issues.apache.org/jira/browse/SPARK-45278 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 4.0.0, 3.5.1 >Reporter: Hendra Saputra >Assignee: Nishchal Venkataramana >Priority: Major > Labels: pull-request-available > Fix For: 3.0.0 > > > An improvement has been made in SPARK-24203 that executor's bind address is > configurable. Unfortunately this configuration hasn't implemented in Yarn. > When Yarn cluster is deployed in in Kubernetes, it is preferable to bind the > executor to loopback interface or all interface. This Jira is to allow Yarn > to bind the executor to either pod IP or loopbak interface or all interface > to allow mesh integration like Istio with the cluster -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45278) Make Yarn executor's bindAddress configurable
[ https://issues.apache.org/jira/browse/SPARK-45278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hendra Saputra updated SPARK-45278: --- Affects Version/s: 4.0.0 3.5.1 (was: 2.1.1) > Make Yarn executor's bindAddress configurable > - > > Key: SPARK-45278 > URL: https://issues.apache.org/jira/browse/SPARK-45278 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 4.0.0, 3.5.1 >Reporter: Hendra Saputra >Assignee: Nishchal Venkataramana >Priority: Major > Labels: pull-request-available > Fix For: 3.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-45278) Make Yarn executor's bindAddress configurable
[ https://issues.apache.org/jira/browse/SPARK-45278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hendra Saputra updated SPARK-45278: --- Description: Previous improvement is made that now Executor bind address is configurable in > Make Yarn executor's bindAddress configurable > - > > Key: SPARK-45278 > URL: https://issues.apache.org/jira/browse/SPARK-45278 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 4.0.0, 3.5.1 >Reporter: Hendra Saputra >Assignee: Nishchal Venkataramana >Priority: Major > Labels: pull-request-available > Fix For: 3.0.0 > > > Previous improvement is made that now Executor bind address is configurable > in -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-45278) Make Yarn executor's bindAddress configurable
Hendra Saputra created SPARK-45278: -- Summary: Make Yarn executor's bindAddress configurable Key: SPARK-45278 URL: https://issues.apache.org/jira/browse/SPARK-45278 Project: Spark Issue Type: Improvement Components: Spark Core Affects Versions: 2.1.1 Reporter: Hendra Saputra Assignee: Nishchal Venkataramana Fix For: 3.0.0 -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
