Hi, Why are you trying to load data into HIVE and then access it via hiveContext? (by the way hiveContext tables are not visible in the sqlContext).
Please read the data directly into a SPARK dataframe and then register it as a temp table to run queries on it. Regards, Gourav On Thu, Mar 3, 2016 at 1:20 PM, Afshartous, Nick <nafshart...@turbine.com> wrote: > > Hi, > > > On AWS EMR 4.2 / Spark 1.5.2, I tried the example here > > > > https://spark.apache.org/docs/1.5.0/sql-programming-guide.html#hive-tables > > > to load data from a file into a Hive table. > > > scala> val sqlContext = new org.apache.spark.sql.hive.HiveContext(sc) > > scala> sqlContext.sql("CREATE TABLE IF NOT EXISTS src (key INT, value > STRING)") > > scala> sqlContext.sql("LOAD DATA LOCAL INPATH 'data.txt' INTO TABLE src") > > > > The resultant error is below. Just wondering if I'm missing any steps in > getting Hive setup on the AWS EMR Spark setup. > > > Thanks, > > -- > > Nick > > > > 16/03/02 14:14:04 INFO Hive: Renaming src: file:/home/hadoop/data.txt, > dest: > hdfs://ip-10-247-128-59.ec2.internal:8020/user/hive/warehouse/src/data_copy_2.txt, > Status:true > 16/03/02 14:14:04 WARN RetryingMetaStoreClient: MetaStoreClient lost > connection. Attempting to reconnect. > org.apache.thrift.TApplicationException: Invalid method name: > 'alter_table_with_cascade' >
