[ https://issues.apache.org/jira/browse/SPARK-22906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16304382#comment-16304382 ]
Apache Spark commented on SPARK-22906: -------------------------------------- User 'pianista215' has created a pull request for this issue: https://github.com/apache/spark/pull/20083 > External shuffle IP different from Host ip > ------------------------------------------ > > Key: SPARK-22906 > URL: https://issues.apache.org/jira/browse/SPARK-22906 > Project: Spark > Issue Type: Improvement > Components: Block Manager > Affects Versions: 2.2.1 > Reporter: Unai Sarasola > Priority: Minor > > Now is possible to configure the spark.shuffle.service.port, but there aren't > an equivalent for host. Imagine that you are using an external shuffle > deployed in Docker. > If you aren't using Host mode for the docker, you may want to use the > internal ip address of the docker to connect to the external shuffle service. > Also you could use Calico, or just being attached the spark shuffle to a > different IP that is used in the Spark executor (example hosts with multiple > network interfaces). > So this is why I implemented the spark.shuffle.service.host configuration -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org