Hi Russell, I went through this https://jaceklaskowski.gitbooks.io/mastering-apache-spark/spark-sql-thrift-server.html and I am still a bit confused on what hive is doing in here ? Is there any example I can look at on how to talk to Spark using Spark SQL JDBC driver alone and not hive ?
Thanks, kant On Sat, Aug 12, 2017 at 6:07 AM, Russell Spitzer <[email protected]> wrote: > You don't have to go through hive. It's just spark sql. The application is > just a forked hive thrift server. > > On Fri, Aug 11, 2017 at 8:53 PM kant kodali <[email protected]> wrote: > >> @Ryan it looks like if I enable thrift server I need to go through hive. >> I was talking more about having JDBC connector for Spark SQL itself other >> words not going through hive. >> >> On Fri, Aug 11, 2017 at 6:50 PM, kant kodali <[email protected]> wrote: >> >>> @Ryan Does it work with Spark SQL 2.1.1? >>> >>> On Fri, Aug 11, 2017 at 12:53 AM, Ryan <[email protected]> wrote: >>> >>>> the thrift server is a jdbc server, Kanth >>>> >>>> On Fri, Aug 11, 2017 at 2:51 PM, <[email protected]> wrote: >>>> >>>>> I also wonder why there isn't a jdbc connector for spark sql? >>>>> >>>>> Sent from my iPhone >>>>> >>>>> On Aug 10, 2017, at 2:45 PM, Jules Damji <[email protected]> wrote: >>>>> >>>>> Yes, it's more used in Hive than Spark >>>>> >>>>> Sent from my iPhone >>>>> Pardon the dumb thumb typos :) >>>>> >>>>> On Aug 10, 2017, at 2:24 PM, Sathish Kumaran Vairavelu < >>>>> [email protected]> wrote: >>>>> >>>>> I think it is for hive dependency. >>>>> On Thu, Aug 10, 2017 at 4:14 PM kant kodali <[email protected]> >>>>> wrote: >>>>> >>>>>> Since I see a calcite dependency in Spark I wonder where Calcite is >>>>>> being used? >>>>>> >>>>>> On Thu, Aug 10, 2017 at 1:30 PM, Sathish Kumaran Vairavelu < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> Spark SQL doesn't use Calcite >>>>>>> >>>>>>> On Thu, Aug 10, 2017 at 3:14 PM kant kodali <[email protected]> >>>>>>> wrote: >>>>>>> >>>>>>>> Hi All, >>>>>>>> >>>>>>>> Does Spark SQL uses Calcite? If so, what for? I thought the Spark >>>>>>>> SQL has catalyst which would generate its own logical plans, physical >>>>>>>> plans >>>>>>>> and other optimizations. >>>>>>>> >>>>>>>> Thanks, >>>>>>>> Kant >>>>>>>> >>>>>>> >>>>>> >>>> >>> >>
