Hi Spark Community, We built an open source tool to deploy and run Spark on Kubernetes with a one click command. For example, on AWS, it could automatically create an EKS cluster, node group, NGINX ingress, and Spark Operator. Then you will be able to use curl or a CLI tool to submit Spark application. After the deployment, you could also install Uber Remote Shuffle Service to enable Dynamic Allocation on Kuberentes.
Anyone interested in using or working together on such a tool? Thanks, Bo