Hello, I am trying to use dynamic allocation which requires the shuffle service. I am running Spark on mesos.
Whenever I set spark.shuffle.service.enabled=true, my Spark driver fails with an error like this: Caused by: java.net.ConnectException: Connection refused: devspark1/ 172.26.21.70:7337 It's not clear from the documentation if the shuffle service starts automatically just by having it enabled, or if I need to do something else. There are instructions for running the shuffle service in YARN, but not mesos. - Philip
