marianobrc commented on issue #36340: URL: https://github.com/apache/beam/issues/36340#issuecomment-5876782425
> Hey @marianobrc! We just finished adding merge-on-read support to the Iceberg sink, so it can now apply CDC rows to Iceberg tables: https://github.com/apache/beam/issues/39979 Thanks for letting me know @ahmedabu98. We have pivoted away from beam/dataflow, to a spark/dataproc job running on a schedule and doing merge-on-write to optimize reads, since it works better for our use case. But I'm sure this feature will be useful for someone else. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
