SEZ9 commented on issue #13224: URL: https://github.com/apache/seatunnel/issues/13224#issuecomment-6820403100
Thanks for filing the agreed follow-ups from #12440. Suggest splitting this into two PRs: (1) connector-owned commit stats in HudiCommitInfo, (2) fault-injection E2E. Each can be reviewed and merged independently. For item 1, please include a test with the Hudi metadata table enabled (the configuration that tracks records) and note whether the checkpoint state format change requires a state version bump / migration for jobs restoring from a checkpoint written by the current WriteStatus-based format. For item 2, consider reusing the existing fault-injection patterns in seatunnel-e2e (e.g. a sink that throws after a configured number of checkpoints, or killing the TaskExecution via the engine API) and assert exactly-once by comparing committed record count against the source after restore, including a check that no orphaned requested/inflight instants remain on the timeline. <!-- streview-comment:2300 --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
