danielhumanmod commented on issue #40: URL: https://github.com/apache/incubator-xtable/issues/40#issuecomment-2410625924
And I have a question after doing some initial investigation about how to handle source table. Based on my understanding, our sync() process is externally controlled (like time-based or event-driven), so each sync might capture multiple operations on the table. For formats like Iceberg (via snapshot ID) and Delta (via log version), detecting a rollback is straightforward. However, Hudi uses a time-based model, which can include several operations (commits, rollbacks, cleans) between syncs, making rollback detection more difficult if other actions have occurred. In such cases, we might treat it as simple add/delete changes, as we do now. I would appreciate any suggestions or input you might have! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
