[GitHub] [hudi] perfectcw commented on issue #7570: [SUPPORT]Sync hive lost some partitions when submit multiple commits at the same time

2022-12-29 Thread GitBox 


perfectcw commented on issue #7570:
URL: https://github.com/apache/hudi/issues/7570#issuecomment-1367235107

   > 
   
   Thanks！


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [hudi] perfectcw commented on issue #7570: [SUPPORT]Sync hive lost some partitions when submit multiple commits at the same time

2022-12-29 Thread GitBox 


perfectcw commented on issue #7570:
URL: https://github.com/apache/hudi/issues/7570#issuecomment-1367226321

   > > Thanks for your reply. And could you explain the specific reason? Is it 
because some commits are archived so cannot be synced to hive.
   > 
   > the sync logic is: check last_update_time in hive table properties, get 
all commits from that time, then update last_update_time，this is not working 
for multiple writers
   
   Is that means, when 20221227042855832.commit goes to sync hive, if the 
last_update_time in hive table properties is 20221227042906103, then the commit 
of 20221227042855832 will not be synced to hive.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [hudi] perfectcw commented on issue #7570: [SUPPORT]Sync hive lost some partitions when submit multiple commits at the same time

2022-12-29 Thread GitBox 


perfectcw commented on issue #7570:
URL: https://github.com/apache/hudi/issues/7570#issuecomment-1367212134

   Thanks for your reply. And could you explain the specific reason? Is it 
because some commits are archived so cannot be synced to hive.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org