You can make a new StreamingContext on an existing SparkContext, I believe?
On Mon, Mar 2, 2015 at 3:01 PM, Tamas Jambor <jambo...@gmail.com> wrote: > thanks for the reply. > > Actually, our main problem is not really about sparkcontext, the problem is > that spark does not allow to create streaming context dynamically, and once > a stream is shut down, a new one cannot be created in the same sparkcontext. > So we cannot create a service that would create and manage multiple streams > - the same way that is possible with batch jobs. > > On Mon, Mar 2, 2015 at 2:52 PM, Sean Owen <so...@cloudera.com> wrote: >> >> I think everything there is to know about it is on JIRA; I don't think >> that's being worked on. >> >> On Mon, Mar 2, 2015 at 2:50 PM, Tamas Jambor <jambo...@gmail.com> wrote: >> > I have seen there is a card (SPARK-2243) to enable that. Is that still >> > going >> > ahead? >> > >> > On Mon, Mar 2, 2015 at 2:46 PM, Sean Owen <so...@cloudera.com> wrote: >> >> >> >> It is still not something you're supposed to do; in fact there is a >> >> setting (disabled by default) that throws an exception if you try to >> >> make multiple contexts. >> >> >> >> On Mon, Mar 2, 2015 at 2:43 PM, jamborta <jambo...@gmail.com> wrote: >> >> > hi all, >> >> > >> >> > what is the current status and direction on enabling multiple >> >> > sparkcontexts >> >> > and streamingcontext? I have seen a few issues open on JIRA, which >> >> > seem >> >> > to >> >> > be there for quite a while. >> >> > >> >> > thanks, >> >> > >> >> > >> >> > >> >> > -- >> >> > View this message in context: >> >> > >> >> > http://apache-spark-user-list.1001560.n3.nabble.com/multiple-sparkcontexts-and-streamingcontexts-tp21876.html >> >> > Sent from the Apache Spark User List mailing list archive at >> >> > Nabble.com. >> >> > >> >> > --------------------------------------------------------------------- >> >> > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >> >> > For additional commands, e-mail: user-h...@spark.apache.org >> >> > >> > >> > > > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
