I don't think that's the same issue I was seeing, but you can have a look at https://issues.apache.org/jira/browse/SPARK-4545 for more detail on my issue.
On Thu, Mar 12, 2015 at 12:51 AM, Tobias Pfeiffer <t...@preferred.jp> wrote: > Sean, > > On Wed, Mar 11, 2015 at 7:43 PM, Tobias Pfeiffer <t...@preferred.jp> wrote: >> >> it seems like I am unable to shut down my StreamingContext properly, both >> in local[n] and yarn-cluster mode. In addition, (only) in yarn-cluster mode, >> subsequent use of a new StreamingContext will raise an >> InvalidActorNameException. > > > I was wondering if this is related to your question on spark-dev > http://tinyurl.com/q5cd5px > Did you get any additional insight into this issue? > > In my case the processing of the first batch completes, but I don't know if > there is anything wrong with the checkpoints? When I look to the > corresponding checkpoint directory in HDFS, it doesn't seem like all state > RDDs are persisted there, just a subset. Any ideas? > > Thanks > Tobias > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
