hameizi commented on pull request #2916: URL: https://github.com/apache/iceberg/pull/2916#issuecomment-891572481
> I have another question. why `DEFAULT_RECORDS_NUM_THRESHOLD` is set to `100_000L`. Is there any experience about how to set this value? This value depend on the scene that whether your flink job will update one primary key frequently in one checkpoint and whether you have enough memory in flink job because these pos-delete is cached in memory before they are flush in pos-delete file. If in your sence you found there is too much pos-delete in one checkpoint inteval you can try config this configuration and add you flink job memory. At most sence 100_000 is enough. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
