I dont think your screenshots came through in the email. None the less, queueStream will not work with getOrCreate. Its mainly for testing (by generating your own RDDs) and not really useful for production usage (where you really need to checkpoint-based recovery).
TD On Thu, Feb 5, 2015 at 4:12 PM, pnpritchard <nicholas.pritch...@falkonry.com > wrote: > I am trying to use the StreamingContext "getOrCreate" method in my app. > > I started by running the example ( RecoverableNetworkWordCount > < > https://github.com/apache/spark/blob/master/examples/src/main/scala/org/apache/spark/examples/streaming/RecoverableNetworkWordCount.scala > > > ), which worked as expected. However, when I modified that example to use > /queueStream/ rather than /socketTextStream/ for it's input, then things > broke down. I first ran it with an empty checkpoint directory, then > restarted the app and got a NPE (copied below). > > Is this a known limitation of using queueStream? Am I assuming something by > using it? Thanks in advance, for any advice! > > > > FYI, I changed line 73 in the example to be: > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/StreamingContext-getOrCreate-with-queueStream-tp21528.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
