ruifmont-te commented on issue #9751: URL: https://github.com/apache/hudi/issues/9751#issuecomment-2591387600
Also facing this issue with both metadata table enabled and disabled in my spark structured streaming job writing to a partitioned Hudi table. The `Listing all partitions with prefix` stage is currently the bottleneck of the pipeline as the data and number of partitions keep growing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
