Hi,
Using spark 1.4.0 in standalone mode, with following configuration:

SPARK_WORKER_OPTS="-Dspark.worker.cleanup.enabled=true
-Dspark.worker.cleanup.appDataTtl=86400"

cleanup interval is set to default.

Application files are not deleted.

Using JavaSparkContext, and when the application ends it stops the context.

Maybe I should also call context.close()?

>From what I understand, stop should be enough (
http://apache-spark-user-list.1001560.n3.nabble.com/SparkContext-stop-td17826.html#a17847
)

Thanks,

Lior

Reply via email to