[GitHub] [hudi] fengjian428 commented on issue #7570: [SUPPORT]Sync hive lost some partitions when submit multiple commits at the same time
fengjian428 commented on issue #7570: URL: https://github.com/apache/hudi/issues/7570#issuecomment-1367231286 > > > Thanks for your reply. And could you explain the specific reason? Is it because some commits are archived so cannot be synced to hive. > > > > > > the sync logic is: check last_update_time in hive table properties, get all commits from that time, then update last_update_time，this is not working for multiple writers > > Is that means, when 20221227042855832.commit goes to sync hive, if the last_update_time in hive table properties is 20221227042906103, then the commit of 20221227042855832 will not be synced to hive. yes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] fengjian428 commented on issue #7570: [SUPPORT]Sync hive lost some partitions when submit multiple commits at the same time
fengjian428 commented on issue #7570: URL: https://github.com/apache/hudi/issues/7570#issuecomment-1367219936 > Thanks for your reply. And could you explain the specific reason? Is it because some commits are archived so cannot be synced to hive. the sync logic is: check last_update_time in hive table properties, get all commits from that time, then update last_update_time，this is not working for multiple writers -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] fengjian428 commented on issue #7570: [SUPPORT]Sync hive lost some partitions when submit multiple commits at the same time
fengjian428 commented on issue #7570: URL: https://github.com/apache/hudi/issues/7570#issuecomment-1367152442 https://github.com/apache/hudi/pull/6662 this should be fixed by this pr -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
