Le 09/06/2026 à 18:28, Andrew Lamb a écrit :
Aren't we moving the goalposts here?
IIRC the basis for this discussion was to inform Parquet *writers* about
which features can safely be enabled. Recording the format version in a
Parquet file's metadata does not help achieve that.
In my mind they are connected -- recording the format in the metadata would
allow writers to explicltly communicate to downstream readers which
features are required for reading,
I don't understand how it's useful:
1) At this point it's too late, the Parquet file was written already, so
this is not solving the user's problem of "how do I choose a safe
feature set".
2) Let's say Parquet 2.34 introduces features A and B. Let's also say a
Parquet reader implements feature A but not feature B. What should this
reader do if you give it a file that has version 2.34 recorded in the
metadata? Should it error out (but perhaps the file only uses feature
A)? Or should it not error out (but perhaps the file uses feature B)?
Regards
Antoine.
