kbendick opened a new issue #4317: URL: https://github.com/apache/iceberg/issues/4317
Flink has deprecated the `TableSchema` class, which we still use in parts of the code base. There are two classes which replace it, `Schema` and `ResolvedSchema`. As I understand, `Schema` is used for declaring types etc and `ResolvedSchema` is what is used during program execution after passing through analysis etc. It has the watermark in it, so this would potentially make providing better support for watermarks easier. Java Doc for deprecated `TableSchema`: https://nightlies.apache.org/flink/flink-docs-release-1.14/api/java/org/apache/flink/table/api/TableSchema.html FLIP-164, which brought the new classes: https://cwiki.apache.org/confluence/display/FLINK/FLIP-164%3A+Improve+Schema+Handling+in+Catalogs As the new classes were released in Flink 1.13, I'm not sure how much longer we'll be able to use the older classes. There is a `toSchema` function which helps aide the transition. This also seems to give access to metadata columns etc that might be highly beneficial to us. It seems possible that we could even _possibly_ support partition transforms via the usage of `ComputedColumn`. I'm still researching this as I've been looking into Flink 1.15 (which isn't out just yet) cc @hililiwei if you have existing knowledge of this or are interested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
