I had already tested query in Hive CLI and it works fine. Same query shows error in Spark SQL.
On May 29, 2015 4:14 AM, ayan guha <guha.a...@gmail.com> wrote: > > Probably a naive question: can you try the same in hive CLI and see if your > SQL is working? Looks like hive thing to me as spark is faithfully delegating > the query to hive. > > On 29 May 2015 03:22, "Abhishek Tripathi" <trackissue...@gmail.com> wrote: >> >> Hi , >> I'm using CDH5.4.0 quick start VM and tried to build Spark with Hive >> compatibility so that I can run Spark sql and access temp table remotely. >> >> I used below command to build Spark, it was build successful but when I >> tried to access Hive data from Spark sql, I get error. >> >> Thanks, >> Abhi >> >> --------------------------------------------------- >> mvn -Pyarn -Phadoop-2.6 -Dhadoop.version=2.6.0-cdh5.4.0 -Phive >> -Phive-thriftserver -DskipTests clean package >> >> [cloudera@quickstart spark-1.3.1]$export HADOOP_CONF_DIR=/etc/hive/conf/ >> [cloudera@quickstart spark-1.3.1]$ ./bin/spark-sql >> SET spark.sql.hive.version=0.13.1 >> spark-sql> show tables; >> sample_07 false >> t1 false >> Time taken: 3.901 seconds, Fetched 2 row(s) >> spark-sql> select * from t1; >> 15/05/19 23:48:46 ERROR SparkSQLDriver: Failed in [select * from t1] >> java.lang.VerifyError: class >> org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$SetOwnerRequestProto >> overrides final method >> getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet; >> at java.lang.ClassLoader.defineClass1(Native Method) >> at java.lang.ClassLoader.defineClass(ClassLoader.java:800) >> >> >>
