One option is the Spark Operator <https://github.com/GoogleCloudPlatform/spark-on-k8s-operator>. It allows specifying and running Spark applications on Kubernetes using Kubernetes custom resources objects. It takes SparkApplication CRD objects and automatically submits the applications to run on a Kubernetes cluster.
Yinan On Tue, Mar 20, 2018 at 7:47 PM, purna pradeep <purna2prad...@gmail.com> wrote: > Im using kubernetes cluster on AWS to run spark jobs ,im using spark 2.3 > ,now i want to run spark-submit from AWS lambda function to k8s > master,would like to know if there is any REST interface to run Spark > submit on k8s Master
