Github user BYondRAK commented on the issue:
https://github.com/apache/spark/pull/22538
Shuffle Service - Attempting to establish a standalone shuffle service via
daemonset to allow for dynamic allocation when using the kubernetes master.
When I try to run the shuffle service via that script as entrypoint, the errors
above prevent that.
Spark History Server - Attempting to collect in a common location the spark
events that will be written after passing the pod information to spark using
kubernetes master.
Trying this is what led me to the issue. I'd like to use the image
generated via spark documentation if possible.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
