This patch caused Parquet files written with 2.0.0 to be unreadable in
3.0.0 onward

https://github.com/apache/arrow/commit/ef0feb2c9c959681d8a105cbadc1ae6580789e69

This was reported on June 14 on dev@ and I git-bisected to the root cause:

https://lists.apache.org/thread/wtbqozdhj2hwn6f0sps2j70lr07grk06

>From the look of https://issues.apache.org/jira/browse/ARROW-10353,
we're going to have to use the Parquet footer metadata to insert a
backward compatibility affordance so that files written prior to 3.0.0
are still readable.

I have a very busy couple of weeks up ahead so I wanted to raise the
issue to see if someone would like to help.

Thanks
Wes

Reply via email to