Re: Not per-key state in spark streaming

Thank you very much for your reply , Daniel On Thu, Dec 8, 2016 at 7:07 PM, Daniel Haviv < daniel.ha...@veracity-group.com> wrote: > There's no need to extend Spark's API, look at mapWithState for examples. > > On Thu, Dec 8, 2016 at 4:49 AM, Anty Rao <ant@gmail.com> wro

Re: Not per-key state in spark streaming

On Wed, Dec 7, 2016 at 7:42 PM, Anty Rao <ant@gmail.com> wrote: > Hi > I'm new to Spark. I'm doing some research to see if spark streaming can > solve my problem. I don't want to keep per-key state,b/c my data set is > very huge and keep a little longer time, it not viable t

Re: Not per-key state in spark streaming

e HDFS or HBASE. > > Daniel > > On Wed, Dec 7, 2016 at 1:42 PM, Anty Rao <ant@gmail.com> wrote: > >> Hi >> I'm new to Spark. I'm doing some research to see if spark streaming can >> solve my problem. I don't want to keep per-key state,b/c my data set is >

Not per-key state in spark streaming

it possible to achieve this in Spark streaming. -- Anty Rao

Not per-key state

this in Spark streaming. -- Thanks Anty Rao