Default value is infinite, so you need to enable it. Personally I’ve setup a
couple of cron jobs to clean up /tmp and /var/run/spark.
On 06.11.2014, at 08:15, Romi Kuntsman wrote:
> Hello,
>
> Spark has an internal cleanup mechanism
> (defined by spark.cleaner.ttl, see
> http://spark.apache.org/docs/latest/configuration.html)
> which cleans up tasks and stages.
>
> However, in our installation, we noticed that Snappy temporary files and
> never cleaned up.
>
> Is it a misconfiguration? Missing feature? How do you deal with build-up of
> temp files?
>
> Thanks,
>
> Romi Kuntsman, Big Data Engineer
> http://www.totango.com
