RussellSpitzer commented on issue #13974: URL: https://github.com/apache/iceberg/issues/13974#issuecomment-3245754707
Iceberg supports concurrent modifications that do not potentially conflict. This is primarily determined using the conflict detection filters. There is also an issue if you are using copy on write, with copy on write whole files are modified so in this case any file matches would also invalidate the concurrent merge. Ie if both operations are trying to change File A to File A' and File A'' respectively, only one can succeed. So TLDR, Does Iceberg support concurrent merges? Yes. If they touch the same rows, almost never with thec current logic. Same partition? Sometimes if the queries touch independent files or they have disjoint conflict detection. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
