Cheappie commented on code in PR #3051:
URL: https://github.com/apache/arrow-datafusion/pull/3051#discussion_r941296913
##########
datafusion/core/src/physical_plan/file_format/parquet.rs:
##########
@@ -342,7 +379,32 @@ impl FileOpener for ParquetOpener {
});
Ok(adapted.boxed())
- })
+ }))
+ }
+}
+
+/// Factory of parquet file readers.
+///
+/// Provides means to implement custom data access interface.
+pub trait ParquetFileReaderFactory: Debug + Send + Sync + 'static {
+ /// Provides `AsyncFileReader` over parquet file specified in `FileMeta`
+ fn create_reader(
+ &self,
+ partition_index: usize,
+ file_meta: FileMeta,
Review Comment:
yes, exactly that. But afaik they will be able to achieve that only through
custom TableProvider. Because extensions are passed through PartitionedFile
into FileMeta, where higher level abstraction like `ObjectStore` produces
ObjectMeta in listing operations.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
