yihua commented on code in PR #12984:
URL: https://github.com/apache/hudi/pull/12984#discussion_r2002025587
##########
hudi-common/src/main/java/org/apache/hudi/metadata/HoodieTableMetadataUtil.java:
##########
@@ -901,6 +919,53 @@ public static HoodieData<HoodieRecord>
convertMetadataToRecordIndexRecords(Hoodi
}
}
+ static Set<String> getValidRecordKeysForFileSlice(HoodieTableMetaClient
metaClient,
Review Comment:
Does the file group reading now add additional latency compared to before?
Should we consider optimizations for `EVENT_TIME_ORDERING` that can avoid such
merging? Also is the behavior consistent with global index, i.e., once the
record is deleted through a log file in MOR table, the record no longer belongs
to the file group even though the record exists in the base file?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
