got ”org.apache.thrift.protocol.TProtocolException: Expected protocol id ffffff82 but got ffffff80“ from hive metastroe service when I use show tables command in spark-sql shell

2014-12-24 Thread Roc Chu
this is my problem. I use mysql to store hive meta data. and i can get what i want when I exec show tables in hive shell. but in the same machine. I use spark-sql to execute same command (show tables), I got errors. I look at the log of hive metastore find this errors 2014-12-24 05:04:59,874

Re: got ”org.apache.thrift.protocol.TProtocolException: Expected protocol id ffffff82 but got ffffff80“ from hive metastroe service when I use show tables command in spark-sql shell

2014-12-24 Thread Cheng Lian
Hi Roc, Spark SQL 1.2.0 can only work with Hive 0.12.0 or Hive 0.13.1 (controlled by compilation flags), versions prior 1.2.0 only works with Hive 0.12.0. So Hive 0.15.0-SNAPSHOT is not an option. Would like to add that this is due to backwards compatibility issue of Hive metastore, AFAIK