[
https://issues.apache.org/jira/browse/HUDI-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258070#comment-17258070
]
Vinoth Chandar commented on HUDI-1479:
--------------------------------------
Also consider this comment
https://github.com/apache/hudi/pull/2398/files#r550709687
> Replace FSUtils.getAllPartitionPaths() with
> HoodieTableMetadata#getAllPartitionPaths()
> --------------------------------------------------------------------------------------
>
> Key: HUDI-1479
> URL: https://issues.apache.org/jira/browse/HUDI-1479
> Project: Apache Hudi
> Issue Type: Sub-task
> Components: Code Cleanup
> Reporter: Vinoth Chandar
> Assignee: Vinoth Chandar
> Priority: Blocker
> Fix For: 0.7.0
>
>
> - Can be done once rfc-15 is merged into master.
> - We will also use HoodieEngineContext and perform parallelized listing as
> needed.
> - HoodieBackedTableMetadata#getPartitionsToFilesMapping has some
> parallelized code
> - Chase down direct usages of FileSystemBackedTableMetadata and parallelize
> them as well
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
