Re: parquet.io.ParquetEncodingException Warning when trying to save parquet file in Spark

Yes, that’s the problem. http://search.maven.org/#artifactdetails%7Ccom.twitter%7Cparquet-avro%7C1.6.0%7Cjar this depends on parquet-hadoop-1.6.0, then triggered this bug. can you change the version to 1.6.0rc7

Re: parquet.io.ParquetEncodingException Warning when trying to save parquet file in Spark

I am using the following: com.twitter parquet-avro 1.6.0 On Mon, Nov 9, 2015 at 1:00 AM, Fengdong Yu wrote: > Which Spark version used? > > It was fixed in Parquet-1.7x, so Spark-1.5.x will be work. > > > > > > On Nov 9, 2015, at 3:43 PM, swetha

Re: parquet.io.ParquetEncodingException Warning when trying to save parquet file in Spark

Which Spark version used? It was fixed in Parquet-1.7x, so Spark-1.5.x will be work. > On Nov 9, 2015, at 3:43 PM, swetha wrote: > > Hi, > > I see unwanted Warning when I try to save a Parquet file in hdfs in Spark. > Please find below the code and the Warning

Re: parquet.io.ParquetEncodingException Warning when trying to save parquet file in Spark

Please see https://issues.apache.org/jira/browse/PARQUET-124 > On Nov 8, 2015, at 11:43 PM, swetha wrote: > > Hi, > > I see unwanted Warning when I try to save a Parquet file in hdfs in Spark. > Please find below the code and the Warning message. Any idea as to how

parquet.io.ParquetEncodingException Warning when trying to save parquet file in Spark

Hi, I see unwanted Warning when I try to save a Parquet file in hdfs in Spark. Please find below the code and the Warning message. Any idea as to how to avoid the unwanted Warning message? activeSessionsToBeSaved.saveAsNewAPIHadoopFile("test", classOf[Void], classOf[ActiveSession],