Hello Vinoo/Team,.
I was going through pyarrow and they have started using V2 as default .
isn't it they should avoid it as it is not official.

https://arrow.apache.org/docs/python/generated/pyarrow.parquet.write_table.html#pyarrow.parquet.write_table

version{“1.0”, “2.4”, “2.6”}, default “2.6”

Determine which Parquet logical types are available for use, whether the
reduced set from the Parquet 1.x.x format or the expanded logical types
added in later format versions. Files written with version=’2.4’ or ‘2.6’
may not be readable in all Parquet implementations, so version=’1.0’ is
likely the choice that maximizes file compatibility. UINT32 and some
logical types are only available with version ‘2.4’. Nanosecond timestamps
are only available with version ‘2.6’. Other features such as compression
algorithms or the new serialized data page format must be enabled
separately (see ‘compression’ and ‘data_page_version’).

Reply via email to