sergiimk commented on issue #1384: URL: https://github.com/apache/arrow-datafusion/issues/1384#issuecomment-1601567758
There was a [recent change](https://github.com/apache/arrow-datafusion/pull/4908) that allowed passing multiple files to `SessionContext::read_parquet()` API. This allowed us to finally get rid of our custom table implementation and just do: ```rust let file_urls: Vec<String> = ...; let df = session_context .read_parquet( file_urls, ParquetReadOptions { file_extension: "", ..Default::default() }, ) .await ``` This solved the original issue I reported, so I will close this ticket. @djouallah if the API still doesn't meet some of your requirements - you can reopen or submit a new issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
