Hi all, I have a streaming job which reads messages from kafka via directStream, transforms it and writes it out to Cassandra. Also I use a large broadcast variable (~300MB)
I tried to implement a stopping mechanism for this job , something like this : When I test it in local mode, the job doesn't finish. All I see in the log is this : Can someone point me , to what I'm doing wrong ? Thanks, Mike -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/streamingContext-stop-true-true-doesn-t-end-the-job-tp24064.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
