zlzhang0122 opened a new issue, #4422:
URL: https://github.com/apache/paimon/issues/4422

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/paimon/issues) 
and found nothing similar.
   
   
   ### Motivation
   
   In some special cases, there maybe exists a situation that the CommitMessage 
is not empty but all the table files in it are empty, and if the job failover 
because of conflict, the job will be unrecoverable since the value of 
numCommitted will be greater than 1, so the job will failover infinite and 
can't be restore. 
   
   The exception is "This exception is intentionally thrown after committing 
the restored checkpoints. By restarting the job we hope that writers can start 
writing based on these new commits". 
   
   ### Solution
   
   We can add an core options such as 'commit.ignore-empty-commit' to support 
commit an empty snapshot, and then we can restore the job normally.
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to