spark ui has a great rest api set.
http://spark.apache.org/docs/latest/monitoring.html
If you know your application id the rest should be easy.
..Manas
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Obtaining-Job-Id-for-query-submitted-via-Spark-Thrift
is needed.
When a job is submitted via the Spark Thrift Server, is there a way to get
this job id?
Thanks!
--
Jagrut
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Obtaining-Job-Id-for-query-submitted-via-Spark-Thrift-Server-tp25523p25593.html
Sent from
Is there a way to get the Job Id for a query submitted via the Spark Thrift
Server? This would allow checking the status of that specific job via the
History Server.
Currently, I'm getting status of all jobs, and then filtering the results.
Looking for a more efficient approach.
Test environment
is: Spark 1.4.1, Hive 0.13.1, running on YARN
Thanks!
--
Jagrut
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Obtaining-Job-Id-for-query-submitted-via-Spark-Thrift-Server-tp25523.html
Sent from the Apache Spark User List mailing list archive at Nabble.com
Is there a way to get the Job Id for a query submitted via the Spark Thrift
Server? This would allow checking the status of that specific job via the
History Server.
Currently, I'm getting status of all jobs, and then filtering the results.
Looking for a more efficient approach.
Test environment