Re: [I] [SUPPORT]After compacting, there are a large number of logs with size 0, and they can never be cleared. [hudi]

MrAladdin closed issue #11007: [SUPPORT]After compacting, there are a large number of logs with size 0, and they can never be cleared. URL: https://github.com/apache/hudi/issues/11007 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

Re: [I] [SUPPORT]After compacting, there are a large number of logs with size 0, and they can never be cleared. [hudi]

MrAladdin commented on issue #11007: URL: https://github.com/apache/hudi/issues/11007#issuecomment-205291 > rollback the compaction I'm not sure which compact to roll back and how to locate it since it has been compacted multiple times already. If it's not addressed, will it be a

Re: [I] [SUPPORT]After compacting, there are a large number of logs with size 0, and they can never be cleared. [hudi]

danny0405 commented on issue #11007: URL: https://github.com/apache/hudi/issues/11007#issuecomment-2052724244 You can rollback the compaction with CIL, the cleaner would finally clean these logs, because before 1.0, the log cleaning is actually appending new log blocks to the corrupt files,

[I] [SUPPORT]After compacting, there are a large number of logs with size 0, and they can never be cleared. [hudi]

MrAladdin opened a new issue, #11007: URL: https://github.com/apache/hudi/issues/11007 **Describe the problem you faced** 1、spark structured streaming : upsert mor (record_index) 2、After compacting, there are a large number of logs with size 0, and they can never be cleared.