[GitHub] [hudi] perfectcw commented on issue #7570: [SUPPORT]Sync hive lost some partitions when submit multiple commits at the same time
perfectcw commented on issue #7570: URL: https://github.com/apache/hudi/issues/7570#issuecomment-1367235107 > Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] perfectcw commented on issue #7570: [SUPPORT]Sync hive lost some partitions when submit multiple commits at the same time
perfectcw commented on issue #7570: URL: https://github.com/apache/hudi/issues/7570#issuecomment-1367226321 > > Thanks for your reply. And could you explain the specific reason? Is it because some commits are archived so cannot be synced to hive. > > the sync logic is: check last_update_time in hive table properties, get all commits from that time, then update last_update_time,this is not working for multiple writers Is that means, when 20221227042855832.commit goes to sync hive, if the last_update_time in hive table properties is 20221227042906103, then the commit of 20221227042855832 will not be synced to hive. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] perfectcw commented on issue #7570: [SUPPORT]Sync hive lost some partitions when submit multiple commits at the same time
perfectcw commented on issue #7570: URL: https://github.com/apache/hudi/issues/7570#issuecomment-1367212134 Thanks for your reply. And could you explain the specific reason? Is it because some commits are archived so cannot be synced to hive. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org