Jason-liujc commented on issue #11535:
URL: https://github.com/apache/hudi/issues/11535#issuecomment-2214835602
Had an offline discussion with Shiyan.
As long as the metadata table is not compacted properly, the insertion
performance will become worse and worse gradually.
Her
xushiyan commented on issue #11535:
URL: https://github.com/apache/hudi/issues/11535#issuecomment-2211178125
> run compaction of the metadata table asynchrounously
no option to do that as MT compaction is managed internally
> `hoodie.metadata.max.deltacommits.when_pending` param
danny0405 commented on issue #11535:
URL: https://github.com/apache/hudi/issues/11535#issuecomment-2208403502
Did you check that whether data table has a long pending instant there that
does not finish?
--
This is an automated message from the Apache Git Service.
To respond to the message
Jason-liujc commented on issue #11535:
URL: https://github.com/apache/hudi/issues/11535#issuecomment-2204845455
@danny0405 Ahh gotcha, we do have async cleaner that runs for our Hudi
tables.
@ad1happy2go I don't see any compaction on metadata table since a given
date (I believe tha
danny0405 commented on issue #11535:
URL: https://github.com/apache/hudi/issues/11535#issuecomment-2197789686
This is an known issue, probably because you have enabled async table
service on data table, the 0.x Hudi metadata table does not work with any async
table services, that would caus
