geserdugarov opened a new pull request, #13609: URL: https://github.com/apache/hudi/pull/13609
### Change Logs First steps towards integrating of Spark Datasource V2 were taken in [RFC-38](https://github.com/apache/hudi/pull/3964), which is marked as completed. However, there are multiple issues with advertising Hudi table as V2 without actual implementing certain API, and with using custom relation rule to fall back to V1 API. As a result, the current implementation of `HoodieCatalog` and `Spark3DefaultSource` returns a `V1Table` instead of `HoodieInternalV2Table`, in order to [address performance regression](https://github.com/apache/hudi/pull/5737). There was [an attempt](https://github.com/apache/hudi/pull/6442) to implement Spark Datasource V2 read functionality as a regular task, but it failed due to the scope of work required. Therefore, this RFC proposes to discuss design of Spark Datasource V2 integration in advance and to continue working on it accordingly. ### Impact No impact at this stage ### Risk level (write none, low medium or high below) No ### Documentation Update No need at this stage ### Contributor's checklist - [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [x] Change Logs and Impact were stated clearly - [x] Adequate tests were added if applicable - [ ] CI passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
