[ https://issues.apache.org/jira/browse/HUDI-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Udit Mehrotra resolved HUDI-999. -------------------------------- Resolution: Fixed > Parallelize listing of Source dataset partitions > ------------------------------------------------- > > Key: HUDI-999 > URL: https://issues.apache.org/jira/browse/HUDI-999 > Project: Apache Hudi > Issue Type: Sub-task > Components: bootstrap > Reporter: Balaji Varadarajan > Assignee: Udit Mehrotra > Priority: Blocker > Labels: pull-request-available > Fix For: 0.6.0 > > > Currently, we are using single thread in driver to list all partitions in > Source dataset. This is a bottleneck when doing metadata bootstrap. -- This message was sent by Atlassian Jira (v8.3.4#803005)