The documentation at
https://spark.apache.org/docs/1.0.0/api/scala/index.html#org.apache.spark.streaming.dstream.DStream
describes the union() method as
Return a new DStream by unifying data of another DStream with this
DStream.
Can somebody provide a clear definition of what unifying means in
The union function simply returns a DStream with the elements from both.
This is the same behavior as when we call union on RDDs :) (You can think
of union as similar to the union operator on sets except without the unique
element restrictions).
On Wed, Oct 29, 2014 at 3:15 PM, spr
I need more precision to understand. If the elements of one DStream/RDD are
(String) and the elements of the other are (Time, Int), what does union
mean? I'm hoping for (String, Time, Int) but that appears optimistic. :)
Do the elements have to be of homogeneous type?
Holden Karau wrote
On Wed, Oct 29, 2014 at 3:39 PM, spr s...@yarcdata.com wrote:
I need more precision to understand. If the elements of one DStream/RDD
are
(String) and the elements of the other are (Time, Int), what does union
mean? I'm hoping for (String, Time, Int) but that appears optimistic. :)
It
