Dear Hudi Community, I am proposing this RFC to support pluggable table formats extending beyond Hudi's native table format. This RFC suggests allowing alternatives, including NoSQL datastores like DynamoDB for timeline and metadata, and other lakehouse table formats to leverage Hudi's higher-level functionalities such as the Streamer and automatic table management.
This would reinforce Hudi's position as a comprehensive data lake platform, rather than solely a table format, and mitigate the impact of vendor-driven comparisons. Furthermore, this approach aligns with database standards that support multiple storage backends. I have also added some non technical motivations in the rfc. Here is the link to the RFC PR : https://github.com/apache/hudi/pull/12998 Kindly review and let me know your comments. Thanks, Balaji.V