The union function simply returns a DStream with the elements from both. This is the same behavior as when we call union on RDDs :) (You can think of union as similar to the union operator on sets except without the unique element restrictions).
On Wed, Oct 29, 2014 at 3:15 PM, spr <s...@yarcdata.com> wrote: > The documentation at > > https://spark.apache.org/docs/1.0.0/api/scala/index.html#org.apache.spark.streaming.dstream.DStream > describes the union() method as > > "Return a new DStream by unifying data of another DStream with this > DStream." > > Can somebody provide a clear definition of what "unifying" means in this > context? Does it append corresponding elements together? Inside a wider > tuple if need be? > > I'm hoping for something clear enough that it could just be added to the > doc > page if the developers so chose. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/what-does-DStream-union-do-tp17673.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > > -- Cell : 425-233-8271