varun-lakhyani commented on code in PR #17284:
URL: https://github.com/apache/iceberg/pull/17284#discussion_r3669451507
##########
core/src/main/java/org/apache/iceberg/CatalogProperties.java:
##########
@@ -119,6 +119,21 @@ private CatalogProperties() {}
public static final long IO_MANIFEST_CACHE_MAX_CONTENT_LENGTH_DEFAULT = 8 *
1024 * 1024;
+ /**
+ * Controls whether to eagerly buffer entire manifest files on the first
read, collapsing multiple
+ * object-store GET requests (header, data, footer) into one.
+ */
+ public static final String IO_MANIFEST_EAGER_FETCH_ENABLED =
"io.manifest.eager-fetch-enabled";
+
+ public static final boolean IO_MANIFEST_EAGER_FETCH_ENABLED_DEFAULT = false;
Review Comment:
I think we can make this default true, It would be great improvement for v4
parquet manifest.
I would love to hear thoughts on this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
