Re: Obtaining Job Id for query submitted via Spark Thrift Server

2015-12-05 Thread manasdebashiskar
spark ui has a great rest api set. http://spark.apache.org/docs/latest/monitoring.html If you know your application id the rest should be easy. ..Manas -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Obtaining-Job-Id-for-query-submitted-via-Spark-Thrift

Re: Obtaining Job Id for query submitted via Spark Thrift Server

2015-12-05 Thread Jagrut Sharma
is needed. When a job is submitted via the Spark Thrift Server, is there a way to get this job id? Thanks! -- Jagrut -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Obtaining-Job-Id-for-query-submitted-via-Spark-Thrift-Server-tp25523p25593.html Sent from

Obtaining Job Id for query submitted via Spark Thrift Server

2015-11-30 Thread Jagrut Sharma
Is there a way to get the Job Id for a query submitted via the Spark Thrift Server? This would allow checking the status of that specific job via the History Server. Currently, I'm getting status of all jobs, and then filtering the results. Looking for a more efficient approach. Test environment

Obtaining Job Id for query submitted via Spark Thrift Server

2015-11-30 Thread Jagrut Sharma
is: Spark 1.4.1, Hive 0.13.1, running on YARN Thanks! -- Jagrut -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Obtaining-Job-Id-for-query-submitted-via-Spark-Thrift-Server-tp25523.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Obtaining Job Id for query submitted via Spark Thrift Server

2015-11-25 Thread Jagrut Sharma
Is there a way to get the Job Id for a query submitted via the Spark Thrift Server? This would allow checking the status of that specific job via the History Server. Currently, I'm getting status of all jobs, and then filtering the results. Looking for a more efficient approach. Test environment