devinjdangelo opened a new issue, #7744: URL: https://github.com/apache/arrow-datafusion/issues/7744
### Is your feature request related to a problem or challenge? It is currently unsupported to run an insert into query for a listing table which is partitioned by a column. ### Describe the solution you'd like 1. ListingTable must be able to inject into FileSinkExec a distribution requirement that the incoming RecordBatchStreams are partitioned by the correct columns 2. Each FileSink must be able to identify which stream belongs to which partition and create the appropriate ObjectStore writer For 2, unless there is a slick solution FileSink could simply peak at each stream before initializing a writer. ### Describe alternatives you've considered _No response_ ### Additional context Progress on inserts to sorted tables may be relevant https://github.com/apache/arrow-datafusion/pull/7743/files -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
