Re: Shared variable in Spark Streaming

ted after every batch. >>> >>> TD >>> >>> >>> On Thu, Aug 7, 2014 at 10:16 PM, Soumitra Kumar < >>> kumar.soumi...@gmail.com> wrote: >>> >>>> Hello, >>>> >>>> I want to count the number of elements in the DStream, like RDD.count() >>>> . Since there is no such method in DStream, I thought of using >>>> DStream.count and use the accumulator. >>>> >>>> How do I do DStream.count() to count the number of elements in a >>>> DStream? >>>> >>>> How do I create a shared variable in Spark Streaming? >>>> >>>> -Soumitra. >>>> >>> >>> >> >

Re: Shared variable in Spark Streaming

is no such method in DStream, I thought of using >>> DStream.count and use the accumulator. >>> >>> How do I do DStream.count() to count the number of elements in a DStream? >>> >>> How do I create a shared variable in Spark Streaming? >>> >>> -Soumitra. >>> >> >> >

Re: Shared variable in Spark Streaming

the DStream, like RDD.count() . >> Since there is no such method in DStream, I thought of using DStream.count >> and use the accumulator. >> >> How do I do DStream.count() to count the number of elements in a DStream? >> >> How do I create a shared variable in Spark Streaming? >> >> -Soumitra. >> > >

Re: Shared variable in Spark Streaming

o I do DStream.count() to count the number of elements in a DStream? > > How do I create a shared variable in Spark Streaming? > > -Soumitra. >

Re: Shared variable in Spark Streaming

such method in DStream, I thought of using DStream.count > and use the accumulator. > > How do I do DStream.count() to count the number of elements in a DStream? > > How do I create a shared variable in Spark Streaming? > > -Soumitra. >

Shared variable in Spark Streaming

Hello, I want to count the number of elements in the DStream, like RDD.count() . Since there is no such method in DStream, I thought of using DStream.count and use the accumulator. How do I do DStream.count() to count the number of elements in a DStream? How do I create a shared variable in