Forking or upgrading Apache Parquet in Spark

2016-12-15 Thread Dongjoon Hyun
Hi, All. I made a PR to upgrade Parquet to 1.9.0 for Apache Spark 2.2 on Late March. - https://github.com/apache/spark/pull/16281 Currently, there occurs some important options about that. Here is the summary. 1. Forking Parquet 1.8.X and maintaining like Spark Hive. 2. Wait and see for Parquet

Re: Forking or upgrading Apache Parquet in Spark

2016-12-15 Thread Ryan Blue
Thanks for the heads-up Dongjoon. I just noticed that thread this morning and was planning on responding. I'll do that today. rb On Thu, Dec 15, 2016 at 9:18 AM, Dongjoon Hyun wrote: > Hi, All. > > I made a PR to upgrade Parquet to 1.9.0 for Apache Spark 2.2 on Late March. > > - https://github.