voonhous commented on issue #8892: URL: https://github.com/apache/hudi/issues/8892#issuecomment-1663258600
Spent 2 more hours looking at this issue: What happened was that I was testing this on 0.12.1 without this PR: https://github.com/apache/hudi/pull/7208 To reproduce this error: Add the snippet into `org.apache.hudi.sink.StreamWriteFunction#flushRemaining`: ```java if (taskID == 0) { // trigger a failure throw new HoodieException("Intentional failure on taskID 0 thrown to invoke partial failover?"); } ```` Prior to this enhancement, rollbacks will be created whenever a TM fails to remove all the partially written files. However, after this enhancement rollbacks will not be created unless a job is restarted or global failover happens. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
