Basic Spark SQL question
Hi, I have a question for Spark SQL. Is there a way to be able to use Spark SQL on YARN without having to submit a job? Bottom line here is I want to be able to reduce the latency of running queries as a job. I know that the spark sql default submission is like a job, but was wondering if it's possible to run queries like one would with a regular db like MySQL or Oracle. Thanks, Ron - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: Basic Spark SQL question
Well for adhoc queries you can use the CLI On Mon, Jul 13, 2015 at 5:34 PM, Ron Gonzalez wrote: > Hi, > I have a question for Spark SQL. Is there a way to be able to use Spark > SQL on YARN without having to submit a job? > Bottom line here is I want to be able to reduce the latency of running > queries as a job. I know that the spark sql default submission is like a > job, but was wondering if it's possible to run queries like one would with > a regular db like MySQL or Oracle. > > Thanks, > Ron > > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
Re: Basic Spark SQL question
I'd look at the JDBC server (a long running yarn job you can submit queries too) https://spark.apache.org/docs/latest/sql-programming-guide.html#running-the-thrift-jdbcodbc-server On Mon, Jul 13, 2015 at 6:31 PM, Jerrick Hoang wrote: > Well for adhoc queries you can use the CLI > > On Mon, Jul 13, 2015 at 5:34 PM, Ron Gonzalez < > zlgonza...@yahoo.com.invalid> wrote: > >> Hi, >> I have a question for Spark SQL. Is there a way to be able to use Spark >> SQL on YARN without having to submit a job? >> Bottom line here is I want to be able to reduce the latency of running >> queries as a job. I know that the spark sql default submission is like a >> job, but was wondering if it's possible to run queries like one would with >> a regular db like MySQL or Oracle. >> >> Thanks, >> Ron >> >> >> - >> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >> For additional commands, e-mail: user-h...@spark.apache.org >> >> >
Re: Basic Spark SQL question
Cool thanks. Will take a look... Sent from my iPhone > On Jul 13, 2015, at 6:40 PM, Michael Armbrust wrote: > > I'd look at the JDBC server (a long running yarn job you can submit queries > too) > > https://spark.apache.org/docs/latest/sql-programming-guide.html#running-the-thrift-jdbcodbc-server > >> On Mon, Jul 13, 2015 at 6:31 PM, Jerrick Hoang >> wrote: >> Well for adhoc queries you can use the CLI >> >>> On Mon, Jul 13, 2015 at 5:34 PM, Ron Gonzalez >>> wrote: >>> Hi, >>> I have a question for Spark SQL. Is there a way to be able to use Spark >>> SQL on YARN without having to submit a job? >>> Bottom line here is I want to be able to reduce the latency of running >>> queries as a job. I know that the spark sql default submission is like a >>> job, but was wondering if it's possible to run queries like one would with >>> a regular db like MySQL or Oracle. >>> >>> Thanks, >>> Ron >>> >>> >>> - >>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >>> For additional commands, e-mail: user-h...@spark.apache.org >
