klion26 edited a comment on pull request #8751: URL: https://github.com/apache/flink/pull/8751#issuecomment-814131133
@StephanEwen sorry for the late reply. IIUC, maybe we still need this feature after FLIP-158 has been implemented(even if we cloud handle not to generate small sst files -- 64MB). -- before we always set the file threshold in this pr to 128(or 256MB) in production, the job which has a large checkpoint may not generate too much small sst files(sure, it will generate some small sst files also) -- the checkpoint interval will set to ~ 10 min. In the other word, seems FLIP-158 only touches keyed state, operator state may generate too much small files, this pr can be used both in keyed state and operator state. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
