Re: Spark Streaming program questions

2015-04-04 Thread Sean Owen
The DAG can't change. You can create many DStreams, but they have to belong to one StreamingContext. You can try these things to see. On Sun, Apr 5, 2015 at 2:13 AM, nickos168 wrote: > I have two questions: > > 1) In a Spark Streaming program, after the various DStream transformations > have bein

Re: Spark Streaming program questions

2015-04-04 Thread Aj K
UNSUBSCRIBE On Sun, Apr 5, 2015 at 6:43 AM, nickos168 wrote: > I have two questions: > > 1) In a Spark Streaming program, after the various DStream transformations > have being setup, > the ssc.start() method is called to start the computation. > > Can the underlying DAG change (ie. add another

Spark Streaming program questions

2015-04-04 Thread nickos168
I have two questions: 1) In a Spark Streaming program, after the various DStream transformations have being setup, the ssc.start() method is called to start the computation. Can the underlying DAG change (ie. add another map or maybe a join) after ssc.start() has been called (and maybe messag