Un-needed checkpoints are not getting automatically deleted in my application.
I.e. the lineage looks something like this and checkpoints simply accumulate in a temporary directory (every lineage point, however, does zip with a globally permanent): PermanentRDD: Global zips with all the intermediate ones Intermediate RDDs: A--->B--->C---->D---->E---->F---->----->G | | | checkpoint checkpoint checkpoint Older intermediate RDDs never get used.