BentsiLeviav commented on PR #36059: URL: https://github.com/apache/beam/pull/36059#issuecomment-3289386999
Hi @Suvrat1629, After discussing internally, I need to share some important context: The ClickHouse Java client V2 already includes: * Built-in schema implementation (replacing our custom one) * Native RowBinaryWithDefaults handling This means implementing the current approach would create code we'd immediately need to remove. Additionally, using the new Java client will require breaking the API. IIRC (@Abacn, please advise), this will require updating the Dataflow template (which shares a global Beam version), adding significant testing overhead and coordination complexity. Given that we plan to start the V2 migration refactor in the near future, it would be more efficient for us to address this issue as part of that comprehensive update rather than implementing a temporary solution now. I really appreciate your enthusiasm and the time you've invested in understanding this issue. Would you be interested in picking up a different issue that won't be affected by the upcoming refactor? In addition, did you implement this due to limitations you have with ClickHouse and Beam related to default values? If so, can you share more about your use case and about the issues you encounter in your pipeline? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
