Yep,
But RDD/DStream would hardly fit the Monad contract (discussed several
time, and still under discussions here and there ;))
For instance, look at the signature of flatMap in both traits.
Albeit, an RDD that can generates other RDD (flatMap) is rather somethi.g
like a DStream or 'CRDD
On Mon, Jul 28, 2014 at 12:53 PM, Nathan Kronenfeld <
nkronenf...@oculusinfo.com> wrote:
> But when done processing, one would still have to pull out the wrapped
> object, knowing what it was, and I don't see how to do that.
It's pretty tricky to get the level of type safety you're looking for.
So after months and months, I finally started to try and tackle this, but
my scala ability isn't up to it.
The problem is that, of course, even with the common interface, we don't
want inter-operability between RDDs and DStreams.
I looked into Monads, as per Ashish's suggestion, and I think I und
