Is there a way to get the Job Id for a query submitted via the Spark Thrift Server? This would allow checking the status of that specific job via the History Server.
Currently, I'm getting status of all jobs, and then filtering the results. Looking for a more efficient approach. Test environment is: Spark 1.4.1, Hive 0.13.1, running on YARN Thanks! -- Jagrut