Thanks for the heads-up Dongjoon. I just noticed that thread this morning
and was planning on responding. I'll do that today.

rb

On Thu, Dec 15, 2016 at 9:18 AM, Dongjoon Hyun <dongj...@apache.org> wrote:

> Hi, All.
>
> I made a PR to upgrade Parquet to 1.9.0 for Apache Spark 2.2 on Late March.
>
> - https://github.com/apache/spark/pull/16281
>
> Currently, there occurs some important options about that. Here is the
> summary.
>
> 1. Forking Parquet 1.8.X and maintaining like Spark Hive.
> 2. Wait and see for Parquet 1.9.x adoption in the other community.
> 3. Make stronger integration tests including both feature and performance
> tests
>
> I think we had better inform all of you on dev mailing list because it has
> an option forking.
> If you have any opinion, please reply here or on the PR.
>
> BTW, the default decision is always number 2 because we will use Apache
> Parquet 1.8.1 for a while.
>
> Bests,
> Dongjoon.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>


-- 
Ryan Blue
Software Engineer
Netflix

Reply via email to