cshuo opened a new issue, #20233: URL: https://github.com/apache/hudi/issues/20233
### Task Description Add repeatable end-to-end validation and a complete quickstart for the Helm-deployed Spark Connect endpoint and its gateway/BI clients. Turn the local experiments from [discussion #19843](https://github.com/apache/hudi/discussions/19843) into reproducible checks. ### Scope - Validate Agent/MCP → hudi-agent-gateway → ADBC → Spark Connect → Hudi, including table discovery, descriptions, query results, and rejection of writes by gateway guardrails. - Validate Superset SQL Lab queries and direct DML, dashboard refresh after writes, and Zeppelin notebook query/write result rendering. - Add direct-client checks for table creation, filtering, aggregation, date grouping, INSERT/UPDATE/DELETE, MERGE INTO, read-after-write, and visibility of commits from an independent writer. - Use isolated test data, assert results after each mutation, and provide cleanup and clear pass/fail output. - Document the complete setup, tested server/client versions, required adapters, known limitations, troubleshooting, and a small selection of query/result screenshots. ### Acceptance Criteria - [ ] A clean local Kubernetes environment can follow the quickstart from deployment through all three client paths. - [ ] Repeatable endpoint and gateway tests assert data correctness and read-only guardrails. - [ ] Superset and Zeppelin application-level checks verify results and rendered output; any manual steps are explicit. - [ ] Documentation distinguishes direct-client writes from the read-only gateway and verified behavior from untested functionality. - [ ] Test data can be cleaned up without affecting unrelated tables. Production-scale concurrency/isolation and broader JDBC compatibility are follow-up work, not claims established by these functional tests. ### Task Type Test enhancement and documentation update. ### Related Issues - #20231 — Helm-deployable Spark Connect endpoint. - #20232 — Gateway and BI client integration. Full end-to-end acceptance depends on both; endpoint tests can be developed alongside #20231. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
