danny0405 opened a new issue, #20406: URL: https://github.com/apache/hudi/issues/20406
### Task Description Route CREATE STREAMING TABLE ... USING hudi append flows from a deterministic external streaming source through catalog-backed toTable and HoodieStreamingSink. Configure Hudi insert explicitly; Spark append output mode alone does not select the Hudi operation. Retain SDP checkpoint and AvailableNow ownership. Initial scope is one writer per target; reject unsupported multiple flows targeting the same table before writes. Include setup documentation for a real external connector example and use a reproducible source in CI. Reuse #20400 for query-scoped resource ownership and #20370 for failure propagation. ### Acceptance criteria - [ ] At least two micro-batches produce the expected rows in the Hudi ST with the resolved insert operation. - [ ] Retry after commit/checkpoint interruption and ordinary restart do not recommit completed batches. - [ ] Full refresh uses a new checkpoint generation and rebuilds all input without skipped batches. - [ ] AvailableNow completion, stop, and failure release sink resources without killing another query or the Connect server. - [ ] Negative tests reject unsupported fan-in and invalid table configuration. - [ ] Provide a runnable example and CLI/Connect end-to-end coverage. ### Task Type Code improvement/refactoring ### Related Issues Parent feature issue: #20401 RFC: #19997 (under review; implementation must follow the agreed contract). Dependencies for end-to-end acceptance: #20402, #20403, #20404, #20370, #20371, #20400. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
