Re: Spark job finishes then command shell is blocked/hangs?
Oops, I completely forgot sc.stop(). Thanks! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-finishes-then-command-shell-is-blocked-hangs-tp11095p11098.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
Re: Spark job finishes then command shell is blocked/hangs?
which version of spark are you running? have you tried sc.stop as as last line of your program? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-finishes-then-command-shell-is-blocked-hangs-tp11095p11097.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
Spark job finishes then command shell is blocked/hangs?
Hi, My spark job finishes with this output: 14/07/31 16:33:25 INFO SparkContext: Job finished: count at RetrieveData.scala:18, took 0.013189 s However, the command line doesn't go back to normal and instead just hangs. This is my first time running a spark job - is this normal? If not, how do I fix/debug this? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-finishes-then-command-shell-is-blocked-hangs-tp11095.html Sent from the Apache Spark User List mailing list archive at Nabble.com.