[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16584732#comment-16584732 ]
Chakradhar N R commented on SPARK-24432: ---------------------------------------- What are the changes related to shuffle service which is happening? I tried searching the spark developers list but could not find any references. Can you reference a few JIRA's as it will be helpful. In the K8S-SIG-BIGDATA, there is a design doc for spark shuffle 2.0 but is not yet made public. Can that also be referenced here. Thanks > Add support for dynamic resource allocation > ------------------------------------------- > > Key: SPARK-24432 > URL: https://issues.apache.org/jira/browse/SPARK-24432 > Project: Spark > Issue Type: New Feature > Components: Kubernetes > Affects Versions: 2.4.0 > Reporter: Yinan Li > Priority: Major > > This is an umbrella ticket for work on adding support for dynamic resource > allocation into the Kubernetes mode. This requires a Kubernetes-specific > external shuffle service. The feature is available in our fork at > github.com/apache-spark-on-k8s/spark. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org