bvaradar commented on issue #2020: URL: https://github.com/apache/hudi/issues/2020#issuecomment-683236267
@dm-tran : This is likely due to 2 different compactions running on the same instant. From your stderr_01.log, the compaction job failed but we do see s3://my-bucket/my-table/.hoodie/20200827155539.commit . Also, from both the logs, it is clear that FileNotFoundException happened right after the compaction failed (from the date timestamps in the logs). This is not possible unless you have another concurrent compaction running which rolled back this compaction run. Failure during finalizeWrite (in stderr_01.log) will not result in the compaction succeeding. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
