Re: Shark Vs Spark SQL

2014-07-03 Thread 田毅
add "MASTER=yarn-client" then the JDBC / Thrift server will run on yarn 2014-07-02 16:57 GMT-07:00 田毅 : > hi, Matei > > > Do you know how to run the JDBC / Thrift server on Yarn? > > > I did not find any suggestion in docs. > > > 2014-07-02 16:06 GMT-07:00 Matei Zaharia : > > Spark SQL in Spark

Re: Shark Vs Spark SQL

2014-07-02 Thread 田毅
hi, Matei Do you know how to run the JDBC / Thrift server on Yarn? I did not find any suggestion in docs. 2014-07-02 16:06 GMT-07:00 Matei Zaharia : > Spark SQL in Spark 1.1 will include all the functionality in Shark; take a > look at > http://databricks.com/blog/2014/07/01/shark-spark-sql-

Re: Shark Vs Spark SQL

2014-07-02 Thread Matei Zaharia
Spark SQL in Spark 1.1 will include all the functionality in Shark; take a look at http://databricks.com/blog/2014/07/01/shark-spark-sql-hive-on-spark-and-the-future-of-sql-on-spark.html. We decided to do this because at the end of the day, the only code left in Shark was the JDBC / Thrift serv

Re: Shark Vs Spark SQL

2014-07-02 Thread Shrikar archak
As of the spark summit 2014 they mentioned that there will be no active development on shark. Thanks, Shrikar On Wed, Jul 2, 2014 at 3:53 PM, Subacini B wrote: > Hi, > > > http://mail-archives.apache.org/mod_mbox/spark-user/201403.mbox/%3cb75376b8-7a57-4161-b604-f919886cf...@gmail.com%3E > > T

Re: Shark Vs Spark SQL

2014-07-02 Thread Chester Chen
Yes, they have announced that Shark is no longer under development and be replaced with Spark SQL in Spark Summit 2014. Chester On Wed, Jul 2, 2014 at 3:53 PM, Subacini B wrote: > Hi, > > > http://mail-archives.apache.org/mod_mbox/spark-user/201403.mbox/%3cb75376b8-7a57-4161-b604-f919886cf...

Shark Vs Spark SQL

2014-07-02 Thread Subacini B
Hi, http://mail-archives.apache.org/mod_mbox/spark-user/201403.mbox/%3cb75376b8-7a57-4161-b604-f919886cf...@gmail.com%3E This talks about Shark backend will be replaced with Spark SQL engine in future. Does that mean Spark will continue to support Shark + Spark SQL for long term? OR After some p