checkpoint file deletion
Hi all, I performed a stateful structure streaming job, and configured spark.cleaner.referenceTracking.cleanCheckpoints to true spark.cleaner.periodicGC.interval to 1min in the config. But the checkpoint files are not deleted and the number of them keeps growing. Did I miss something?
Unsubscribe
Unsubscribe | | 李杰 | | leedd1...@163.com |