checkpoint file deletion

2023-06-29 Thread Lingzhe Sun
Hi all, I performed a stateful structure streaming job, and configured spark.cleaner.referenceTracking.cleanCheckpoints to true spark.cleaner.periodicGC.interval to 1min in the config. But the checkpoint files are not deleted and the number of them keeps growing. Did I miss something?

Unsubscribe

2023-06-29 Thread lee
Unsubscribe | | 李杰 | | leedd1...@163.com |