Andrew Or created SPARK-2435: -------------------------------- Summary: Add shutdown hook to bin/pyspark Key: SPARK-2435 URL: https://issues.apache.org/jira/browse/SPARK-2435 Project: Spark Issue Type: Bug Components: PySpark Affects Versions: 1.1.0 Reporter: Andrew Or Fix For: 1.1.0
We currently never stop the SparkContext cleanly in bin/pyspark unless the user explicitly runs sc.stop(). This behavior is not consistent with bin/spark-shell, in which case Ctrl+D stops the SparkContext before quitting the shell. -- This message was sent by Atlassian JIRA (v6.2#6252)