Re: Not per-key state in spark streaming

te: > >> >> >> On Wed, Dec 7, 2016 at 7:42 PM, Anty Rao <ant@gmail.com> wrote: >> >>> Hi >>> I'm new to Spark. I'm doing some research to see if spark streaming can >>> solve my problem. I don't want to keep per-key state,b/c my data

Re: Not per-key state in spark streaming

e research to see if spark streaming can >> solve my problem. I don't want to keep per-key state,b/c my data set is >> very huge and keep a little longer time, it not viable to keep all per key >> state in memory.Instead, i want to have a bloom filter based state.

Re: Not per-key state in spark streaming

On Wed, Dec 7, 2016 at 7:42 PM, Anty Rao <ant@gmail.com> wrote: > Hi > I'm new to Spark. I'm doing some research to see if spark streaming can > solve my problem. I don't want to keep per-key state,b/c my data set is > very huge and keep a little longer time, it not viable t

Re: Not per-key state in spark streaming

e HDFS or HBASE. > > Daniel > > On Wed, Dec 7, 2016 at 1:42 PM, Anty Rao <ant@gmail.com> wrote: > >> Hi >> I'm new to Spark. I'm doing some research to see if spark streaming can >> solve my problem. I don't want to keep per-key state,b/c my data set is >

Re: Not per-key state in spark streaming

see if spark streaming can > solve my problem. I don't want to keep per-key state,b/c my data set is > very huge and keep a little longer time, it not viable to keep all per key > state in memory.Instead, i want to have a bloom filter based state. Does it > possible to achieve this in Spark

Not per-key state in spark streaming

Hi I'm new to Spark. I'm doing some research to see if spark streaming can solve my problem. I don't want to keep per-key state,b/c my data set is very huge and keep a little longer time, it not viable to keep all per key state in memory.Instead, i want to have a bloom filter based state. Does

Not per-key state

Hi ALL I'm new to Spark. I'm doing some research to see if spark streaming can solve my problem. I don't want to keep per-key state,b/c my data set is very huge, it not viable to keep all per key state in memory.Instead, i want to have a bloom filter based state. Does it possible to achieve

Accessing the per-key state maintained by updateStateByKey for transformation of JavaPairDStream

.1001560.n3.nabble.com/Accessing-the-per-key-state-maintained-by-updateStateByKey-for-transformation-of-JavaPairDStream-tp7680.html Sent from the Apache Spark User List mailing list archive at Nabble.com.