cshuo opened a new pull request, #20467: URL: https://github.com/apache/hudi/pull/20467
### Describe the issue this Pull Request addresses Closes #20466. Superset and Zeppelin need a documented way to query and write Hudi tables through the Spark Connect endpoint. Superset does not provide a built-in SQLAlchemy dialect for the Foundry Spark ADBC driver. ### Summary and Changelog - Add an experimental Superset SQLAlchemy dialect and engine spec backed by Foundry Spark ADBC, with a Superset image and installation instructions. - Document Zeppelin 0.12 access through its Python interpreter, including direct writes, readback and result rendering. - Add offline dialect tests and opt-in live tests for the adapter, Superset and Zeppelin; document dashboard refresh and client limitations. ### Impact BI users can connect directly to Spark Connect using the documented dependencies. Direct BI writes are independent of the read-only Agent/MCP gateway. The adapter is experimental and rejects parameterized execution; no performance improvement is claimed. ### Risk Level Medium: this adds a new client adapter and relies on external ADBC and application versions. Pinned dependencies, isolated test resources and documented limitations reduce the risk. Validation on the master-based commit: - Eight offline dialect tests passed. - Three live adapter tests passed against a disposable Spark 4.1.3 / Hudi 1.2.0 Connect instance, including Hudi read/write, reflection, temporary views and Arrow types. - `git diff --check` passed. Superset and Zeppelin application-level MERGE update, insert and readback were verified in an earlier isolated environment; their complete UI flows were not rerun after rebasing. ### Documentation Update Add adapter installation, connection setup, Zeppelin examples, validation and operational limitations to the lakehouse documentation. ### Contributor's checklist - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [x] Enough context is provided in the sections above - [x] Adequate tests were added if applicable -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
