Re: Spark HiveQL support plan

2014-09-10 Thread Michael Armbrust 
HiveQL is the default language for the JDBC server which will be available
as part of the 1.1 release (coming very soon!). Adding support for calling
MLlib and other spark libraries is on the roadmap, but not possible at this
moment.

On Tue, Sep 9, 2014 at 1:45 PM, XUE, Xiaohui xiaohui@sap.com wrote:


  Hi,

  In Spark website, there’s a plan to support HiveQL on top of Spark SQL
 and also to support JDBC/ODBC.

  I would like to know if in this “HiveQL” supported by Spark (or Spark
 SQL accessible through JDBC/ODBC), is there a plan to add extensions to
 leverage different Spark features like machine learning and stream?
 I’m asking this as we’re considering using Spark from remote machine, so
 this would be easier through JDBC/ODBC. But it’ll be good to also take
 benefice of other Spark features than the ones exist in HiveQL.

  Thanks,
 Xiaohui Xue

Spark HiveQL support plan

2014-09-09 Thread XUE, Xiaohui 

Hi,

In Spark website, there’s a plan to support HiveQL on top of Spark SQL and also 
to support JDBC/ODBC.

I would like to know if in this “HiveQL” supported by Spark (or Spark SQL 
accessible through JDBC/ODBC), is there a plan to add extensions to leverage 
different Spark features like machine learning and stream?
I’m asking this as we’re considering using Spark from remote machine, so this 
would be easier through JDBC/ODBC. But it’ll be good to also take benefice of 
other Spark features than the ones exist in HiveQL.

Thanks,
Xiaohui Xue