zherenyu831 commented on issue #2707:
URL: https://github.com/apache/hudi/issues/2707#issuecomment-814540364
@satishkotha
Thank you for the explaining.
Totally understood.
Since insert_overwrite_table every time creating version of files, in this
case,
instead of using KEEP_LA
zherenyu831 commented on issue #2707:
URL: https://github.com/apache/hudi/issues/2707#issuecomment-814157136
@satishkotha cc @bvaradar
I found the problem why cleaner only keep one file version
https://github.com/apache/hudi/blob/master/hudi-client/hudi-client-common/src/main/java/o
zherenyu831 commented on issue #2707:
URL: https://github.com/apache/hudi/issues/2707#issuecomment-811565897
@jsbali
For make everything clear:
On archiving:
Since the first replacecommit have 0 partitionToReplaceFileIds, and it
failed at
https://github.com/apache/hudi/blob/ma
zherenyu831 commented on issue #2707:
URL: https://github.com/apache/hudi/issues/2707#issuecomment-805372384
@satishkotha
Sorry I parste wrong log, I updated the log, please check again.
When archiving finished, seems metaclient didn't reload, so it's trying to
read the archived
zherenyu831 commented on issue #2707:
URL: https://github.com/apache/hudi/issues/2707#issuecomment-804849028
Also saw some comment and find below link
https://issues.apache.org/jira/browse/HUDI-1518
Seems you are going to use cleaner to delete the file group,
but currently, if I use
zherenyu831 commented on issue #2707:
URL: https://github.com/apache/hudi/issues/2707#issuecomment-804831651
But got new error
```
User class threw exception: org.apache.hudi.exception.HoodieIOException:
Could not read commit details from s3://xxx/.hoodie/20210317155538.replacecom
zherenyu831 commented on issue #2707:
URL: https://github.com/apache/hudi/issues/2707#issuecomment-804762627
simple workaround is delete first commit file
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
