Re: How to run hive queries in async mode using spark sql

2016-05-24 Thread Mich Talebzadeh
fine give me an example where you have tried to turn on async for the query using spark sql. Your actual code. HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: How to run hive queries in async mode using spark sql

2016-05-24 Thread Raju Bairishetti
Hi Mich, Thanks for the response. yes, I do not want to block until the hive query is completed and want to know is there any way to poll the status/progress of submitted query. I can turn on asyc mode for hive queries in spark sql but how to track the status of the submitted query? On Tue,

Re: How to run hive queries in async mode using spark sql

2016-05-24 Thread Mich Talebzadeh
By Hive queries in async mode, you mean submitting sql queries to Hive and move on to the next operation and wait for return of result set from Hive? Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: How to run hive queries in async mode using spark sql

2016-05-24 Thread Raju Bairishetti
Any thoughts on this? In hive, it returns operation handle. This handle can be used for fetching the status of query. Is there any similar mechanism in spark sql? Looks like almost all the methods in the HiveContext are either protected or private. On Wed, May 18, 2016 at 9:03 AM, Raju

How to run hive queries in async mode using spark sql

2016-05-17 Thread Raju Bairishetti
I am using spark sql for running hive queries also. Is there any way to run hive queries in asyc mode using spark sql. Does it return any hive handle or if yes how to get the results from hive handle using spark sql? -- Thanks, Raju Bairishetti, www.lazada.com