[ https://issues.apache.org/jira/browse/HUDI-2201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423968#comment-17423968 ]
sivabalan narayanan commented on HUDI-2201: ------------------------------------------- [~danny0405]: Hey danny. Can you audit all getAllPartitionPaths() (fs.listStatus, fs.getFileStatus), and ensure its out of fast path. You can check the parent ticket for more info: https://issues.apache.org/jira/browse/HUDI-1015 > Audi all flink classes and route all FileSystem list and getStatus calls to > metadata table > ------------------------------------------------------------------------------------------ > > Key: HUDI-2201 > URL: https://issues.apache.org/jira/browse/HUDI-2201 > Project: Apache Hudi > Issue Type: Sub-task > Components: Common Core > Reporter: sivabalan narayanan > Assignee: Danny Chen > Priority: Major > > > {code:java} > grep -irl "fs.listStatus" hudi-*/* | grep -v Test > hudi-flink/src/main/java/org/apache/hudi/table/format/FilePathUtils.java > hudi-flink/src/main/java/org/apache/hudi/table/format/cow/CopyOnWriteInputFormat.java > {code} > > {code:java} > grep -irl "fs.getFileStatus" hudi-*/* | grep -v Test > hudi-client/hudi-flink-client/src/main/java/org/apache/hudi/io/FlinkMergeHandle.java > hudi-flink/src/main/java/org/apache/hudi/sink/partitioner/profile/WriteProfiles.java > hudi-flink/src/main/java/org/apache/hudi/table/format/FilePathUtils.java > hudi-flink/src/main/java/org/apache/hudi/table/format/cow/CopyOnWriteInputFormat.java > {code} > Some of them are valid ones which can't be routed. But just dumping all > matches here. -- This message was sent by Atlassian Jira (v8.3.4#803005)