How about Apache Livy? the purpose is similar as SparkLauncher, but through
Restful API to launch Spark Jobs
From: mhd wrk
Sent: Monday, April 27, 2020 11:38 PM
To: user@spark.apache.org
Subject: SparkLauncher reliability and scalability
[Warning]: This email
We are using SparkLauncher and SparkAppHandle.Listener to launch spark
applications from a Java web application and listen to the state changes.
Our observation is that as the number of concurrent jobs grow sometimes
some of the state changes are not reported (e.g. some applications never
report fi
