anujmodi2021 commented on code in PR #6270:
URL: https://github.com/apache/hadoop/pull/6270#discussion_r1400358992
##########
hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/constants/ConfigurationKeys.java:
##########
@@ -104,7 +104,20 @@ public final class ConfigurationKeys {
public static final String AZURE_ENABLE_SMALL_WRITE_OPTIMIZATION =
"fs.azure.write.enableappendwithflush";
public static final String AZURE_READ_BUFFER_SIZE =
"fs.azure.read.request.size";
public static final String AZURE_READ_SMALL_FILES_COMPLETELY =
"fs.azure.read.smallfilescompletely";
+ /**
+ * When parquet files are read, first few read are metadata reads before
reading the actual data.
Review Comment:
Yes, the procedure is same for ORC as well...
This optimization will impact workloads running on both parquet and ORC files
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
