[ https://issues.apache.org/jira/browse/HUDI-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alexey Kudinkin updated HUDI-4613: ---------------------------------- Sprint: 2022/09/05, 2022/12/12, 0.13.0 Final Sprint (was: 2022/09/05, 2022/12/12) > Avoid the use of regex expressions when call hoodieFileGroup#addLogFile > function > -------------------------------------------------------------------------------- > > Key: HUDI-4613 > URL: https://issues.apache.org/jira/browse/HUDI-4613 > Project: Apache Hudi > Issue Type: Improvement > Components: core > Reporter: lei w > Assignee: lei w > Priority: Blocker > Labels: pull-request-available > Fix For: 0.13.0 > > > When the number of logFile files exceeds a certain amount of data, the > construction of fsview will become very time-consuming. The reason is that > the LogFileComparator#compare method is frequently called when constructing a > filegroup, and regular expressions are used in this method. > {panel:title=build FileSystemView Log } > INFO view.AbstractTableFileSystemView: addFilesToView: NumFiles=60801, > NumFileGroups=200, FileGroupsCreationTime=34036, StoreTimeTaken=2 > {panel} -- This message was sent by Atlassian Jira (v8.20.10#820010)