zhuqi-lucas opened a new pull request, #18160: URL: https://github.com/apache/datafusion/pull/18160
…default (set metadata_size_hint) ## Which issue does this PR close? - Closes [#18118](https://github.com/apache/datafusion/issues/18118) ## Rationale for this change Reduce number of object store requests when reading parquet files by default (set metadata_size_hint) ## What changes are included in this PR? ```rust /// Default setting to 512 KB, which should be sufficient for most parquet files, /// it can reduce one I/O operation per parquet file. If the metadata is larger than /// the hint, two reads will still be performed. pub metadata_size_hint: Option<usize>, default = Some(512 * 1024) ``` ## Are these changes tested? Yes ## Are there any user-facing changes? No -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
