RE: Spark SQL Query and join different data sources.

2014-08-21 Thread alexliu68
Presto is so far good at joining different sources/databases. I tried a simple join query in Spark SQL, it fails as the followings errors val a = cql(select test.a from test JOIN test1 on test.a = test1.a) a: org.apache.spark.sql.SchemaRDD = SchemaRDD[0] at RDD at SchemaRDD.scala:104 == Query

Spark SQL Query and join different data sources.

2014-08-19 Thread alexliu68
Is there anyone make the query join different data sources work? especially Join hive table with other data sources. For example, hql uses HiveContext, and it needs first call use database_name and other datasources use SqlContext, how can SqlContext know Hive tables? I follow