njalan commented on issue #9751:
URL: https://github.com/apache/hudi/issues/9751#issuecomment-1728933558
@njalan I added option("hoodie.metadata.enable","true") and also added
--conf spark.hadoop.hoodie.metadata.enable=true for spark sql but list
operation is still high. I got some list metrics from one server for 40 seconds
with around 2000 list. one table with around 100-200 s3 lists with 40 seconds.
Most of them are listing hive/warehouse/xxx.db/xxx/.hoodie/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
