can't get smallint field from hive on spark

2014-11-26 Thread 诺铁
hi, don't know whether this question should be asked here, if not, please point me out, thanks. we are currently using hive on spark, when reading a small int field, it reports error: Cannot get field 'i16Val' because union is currently set to i32Val I googled and find only source code of

Re: can't get smallint field from hive on spark

2014-11-26 Thread Michael Armbrust
This has been fixed in Spark 1.1.1 and Spark 1.2 https://issues.apache.org/jira/browse/SPARK-3704 On Wed, Nov 26, 2014 at 7:10 PM, 诺铁 noty...@gmail.com wrote: hi, don't know whether this question should be asked here, if not, please point me out, thanks. we are currently using hive on

Re: can't get smallint field from hive on spark

2014-11-26 Thread Yin Huai
For hive on spark, did you mean the thrift server of Spark SQL or https://issues.apache.org/jira/browse/HIVE-7292? If you meant the latter one, I think Hive's mailing list will be a good place to ask (see https://hive.apache.org/mailing_lists.html). Thanks, Yin On Wed, Nov 26, 2014 at 10:49 PM,

Re: can't get smallint field from hive on spark

2014-11-26 Thread 诺铁
I mean the later... thanks On Thu, Nov 27, 2014 at 1:42 PM, Yin Huai huaiyin@gmail.com wrote: For hive on spark, did you mean the thrift server of Spark SQL or https://issues.apache.org/jira/browse/HIVE-7292? If you meant the latter one, I think Hive's mailing list will be a good place to