ReemaAlzaid opened a new pull request, #13413: URL: https://github.com/apache/gluten/pull/13413
## What changes are proposed in this pull request? Add a guide for getting started with Kafka reads in Gluten's Velox backend. It explains how to build and configure Gluten with Kafka support, run a rate-to-Kafka-to-console example, and check that the Kafka scan runs natively. The guide also covers supported reads and limitations, with a diagram showing how the Spark driver, executor, and native Kafka reader work together. Links are added to the existing Velox and build guides. This documents the Kafka work across: - #13182: Optional Kafka build dependencies. - #13270: Building librdkafka without vcpkg. - #13183: The native Kafka connector. - #13236: Kafka Substrait translation. - #13237: Kafka micro-batch scan offloading. The native read example requires the integration from #13236 and #13237. ## How was this patch tested? Checked the build instructions and scan behavior against the source code, verified the local links, and rendered the diagram to check its layout. `git diff --cached --check` passed. (I haven't run the Spark/Kafka example end to end yet) ## Was this patch authored or co-authored using generative AI tooling? Generated-by: IBM Bob -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
