[ https://issues.apache.org/jira/browse/FLINK-25261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17463664#comment-17463664 ]
Yuan Mei edited comment on FLINK-25261 at 12/22/21, 9:06 AM: ------------------------------------------------------------- 1. What does "truncation" mean? It means from seq # x, data is safe to delete. 2. Materialization up to seq # y means *new* checkpoints will not depend on log changes before seq # y. But it does not necessarily mean all data before y can be deleted (*old* checkpoints may also depend on some parts before y). 3. what exactly are the `in-memory` data here? Those are not flushed to DFS? Then what about those already flushed to DFS, but not within any checkpoint yet (not within any state)? was (Author: ym): 1. What does "truncation" mean? It means from seq # x, data is safe to delete. 2. Materialization up to seq # y means new checkpoints will not depend on log changes before seq # y. But it does not necessarily mean all data before y can be deleted (old checkpoints may also depend on some parts before y). 3. what exactly are the `in-memory` data here? Those are not flushed to DFS? Then what about those already flushed to DFS, but not within any checkpoint yet (not within any state)? > Changelog not truncated on materialization > ------------------------------------------ > > Key: FLINK-25261 > URL: https://issues.apache.org/jira/browse/FLINK-25261 > Project: Flink > Issue Type: Bug > Components: Runtime / State Backends > Affects Versions: 1.15.0 > Reporter: Roman Khachatryan > Assignee: Roman Khachatryan > Priority: Major > Labels: pull-request-available > Fix For: 1.15.0 > > > [https://github.com/apache/flink/blob/dcc4d43e413b20f70036e73c61d52e2e1c5afee7/flink-state-backends/flink-statebackend-changelog/src/main/java/org/apache/flink/state/changelog/ChangelogKeyedStateBackend.java#L640] -- This message was sent by Atlassian Jira (v8.20.1#820001)