Thanks for that ,
One more doubt is that How to perform different logic/operations over a
Dstreams with two types of Streamid in it .
*Its like using stream-id in storm and Fork type of think (diff logic for
both edges at same type without using 2 separate filters .).*
On Tue, Jun 30, 2015
Hi,
not sure what the context is but I think you can do something similar with
mapPartitions:
rdd.mapPartitions { iterator =
iterator.grouped(5).map { tupleGroup = emitOneRddForGroup(tupleGroup) }
}
The edge case is when the final grouping doesn't have exactly 5 items, if
that matters.
On
I want to apply some logic on the basis of a FIX count of number of
tuples in each RDD . *suppose emit one rdd for every 5 tuple of previous
RDD . *
--
Thanks Regards,
Anshu Shukla
