andrei-ionescu commented on issue #1404: URL: https://github.com/apache/arrow-datafusion/issues/1404#issuecomment-991781338
@lst-codes I understand how you put it and in deed it may be a new feature. Even so, the plan needs to be optimised from the input partition (ie: row groups from parquet) up to output partitioning (ie: files that needs to be written). All these needs support in DataFusion engine. If there would be such support in the engine, then it can be easily hooked to any kind of writer. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
