Joris Van den Bossche created ARROW-5915:
--------------------------------------------
Summary: [C++] [Python] Set up testing for backwards compatibility
of the parquet reader
Key: ARROW-5915
URL: https://issues.apache.org/jira/browse/ARROW-5915
Project: Apache Arrow
Issue Type: Test
Components: C++, Python
Reporter: Joris Van den Bossche
Given the recent parquet compat problems, we should have better testing for
this.
For easy testing of backwards compatibility, we could add some files (with
different types) written with older versions, add them to
/pyarrow/tests/data/parquet (we already have some files from 0.7 there) and
ensure they are read correctly with the current version.
Similarly as what Kartothek is doing:
https://github.com/JDASoftwareGroup/kartothek/tree/master/reference-data/arrow-compat
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
