Re: Substract two DStreams

2016-06-28 Thread Marius Soutier
Sure, no problem. > On 28.06.2016, at 08:57, Matthias Niehoff > wrote: > > ah, didn't know about this. That might actually work. I solved it by > implementing the leftJoinWithCassandraTable by myself which is nearly as fast > as the normal join. This should

Re: Substract two DStreams

2016-06-27 Thread Marius Soutier
Can't you use `transform` instead of `foreachRDD`? > On 15.06.2016, at 15:18, Matthias Niehoff > wrote: > > Hi, > > i want to subtract 2 DStreams (based on the same Input Stream) to get all > elements that exist in the original stream, but not in the

Substract two DStreams

2016-06-15 Thread Matthias Niehoff
Hi, i want to subtract 2 DStreams (based on the same Input Stream) to get all elements that exist in the original stream, but not in the modified stream (the modified Stream is changed using joinWithCassandraTable which does an inner join and because of this might remove entries). Subtract is