Hi, Is it recommended to use Spark on K8S in production?
Spark operator for Kubernetes seems to be in beta state. https://github.com/GoogleCloudPlatform/spark-on-k8s-operator#:~:text=The%20Kubernetes%20Operator%20for%20Apache%20Spark%20aims%20to%20make%20specifying,surfacing%20status%20of%20Spark%20applications . Apparently there are open JIRA issues for spark that talk about problems on K8s with dynamic allocation etc. Are there any workarounds? Are there any other issues? What is the official recommendation? Thanks & regards, Arti Pande
