zncleon commented on issue #15292:
URL: https://github.com/apache/iceberg/issues/15292#issuecomment-3958806571
@Guosmilesmile thx for rsp.
my configuration is
```
.add(RewriteDataFiles.builder()
.scheduleOnCommitCount(1)
.targetFileSizeBytes(512L * 1024 * 1024)
.deleteFileThreshold(1)
.partialProgressEnabled(true)
.partialProgressMaxCommits(20)
.maxFileGroupSizeBytes(1L * 1024 * 1024 * 1024)
.maxRewriteBytes(16L * 1024 * 1024 * 1024))
```
it is a separate maintenance job
I check the DataFileRewritePlanner logs. Found only one or not
RewriteFileGroups are begin generated. That is not expected.
I set `deleteFileThreshold(1)` , and the num of delete file > the num of
data file. I think it reach the threshold `deleteFileThreshold(1)`, but I get
not one RewriteFileGroups. It make the delete file keep increasing.
what is the reason for it？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
