emkornfield commented on code in PR #564:
URL: https://github.com/apache/parquet-format/pull/564#discussion_r3126875330
##########
src/main/thrift/parquet.thrift:
##########
@@ -885,8 +885,17 @@ struct ColumnMetaData {
* whether we can decode those pages. **/
2: required list<Encoding> encodings
- /** Path in schema **/
- 3: required list<string> path_in_schema
+ /**
+ * Path in schema
+ *
+ * The writing of this field has been made optional as of June 2026.
+ * The information contained in this field is easily obtainable from
+ * the schema, and redundantly storing it here can lead to unnecessary
+ * bloat in the footer. Writers are encouraged to make the writing of
+ * this field optional, but for maximal compatibility should default to
+ * writing the field until at least Month 202X.
Review Comment:
Based on "Forward incompatible features/changes should not be turned on by
default until 2 years after the parquet-java implementation containing the
feature is released." Lets maybe fill in the date as September 2028, assuming
we get things merged by a september java release?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
