peay opened a new issue, #6464: URL: https://github.com/apache/iceberg/issues/6464
### Feature Request / Improvement A common use case for streaming pipelines is to be able to write small Avro data files in micro-batch fashion, and then periodically compact those into a few Parquet data files. It'd be great if `RewriteDataFiles` had an option to rewrite data files in a different data file format from that in the table properties to support such a workflow. This would allow a table configured to write Avro by default, but running compactions actions to Parquet. ### Query engine None -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
