Re: Error reading smallin in hive table with parquet format

2015-04-02 Thread Masf
No, in my company are using cloudera distributions and 1.2.0 is the last version of spark. Thanks On Wed, Apr 1, 2015 at 8:08 PM, Michael Armbrust mich...@databricks.com wrote: Can you try with Spark 1.3? Much of this code path has been rewritten / improved in this version. On Wed, Apr

Error reading smallin in hive table with parquet format

2015-04-01 Thread Masf
Hi. In Spark SQL 1.2.0, with HiveContext, I'm executing the following statement: CREATE TABLE testTable STORED AS PARQUET AS SELECT field1 FROM table1 *field1 is SMALLINT. If table1 is in text format all it's ok, but if table1 is in parquet format, spark returns the following error*:

Re: Error reading smallin in hive table with parquet format

2015-04-01 Thread Michael Armbrust
Can you try with Spark 1.3? Much of this code path has been rewritten / improved in this version. On Wed, Apr 1, 2015 at 7:53 AM, Masf masfwo...@gmail.com wrote: Hi. In Spark SQL 1.2.0, with HiveContext, I'm executing the following statement: CREATE TABLE testTable STORED AS PARQUET AS