Github user liyinan926 commented on the issue:
https://github.com/apache/spark/pull/22538
> Shuffle Service - Attempting to establish a standalone shuffle service
via daemonset to allow for dynamic allocation when using the kubernetes master.
When I try to run the shuffle service via that script as entrypoint, the errors
above prevent that.
OK, this image is for the kubernetes scheduler backend that runs executors
natively in k8s pods. The image is not supposed to be used in the way as
described above. I assume the script your referred to is for starting the
shuffle service for a standalone cluster. Yes, you can deploy a standalone
Spark cluster on k8s. However, this is not the image you should be using for
doing that.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
