Hi,
On Wed, Jan 21, 2015 at 9:13 PM, Bob Tiernay btier...@hotmail.com wrote:
Maybe I'm misunderstanding something here, but couldn't this be done with
broadcast variables? I there is the following caveat from the docs:
In addition, the object v should not be modified after it is broadcast
Maybe I'm misunderstanding something here, but couldn't this be done with
broadcast variables? I there is the following caveat from the docs:
In addition, the object v should not be modified after it is broadcast in
order to ensure that all nodes get the same value of the broadcast variable
How about using accumulators
http://spark.apache.org/docs/1.2.0/programming-guide.html#accumulators?
Thanks
Best Regards
On Wed, Jan 21, 2015 at 12:53 PM, Tobias Pfeiffer t...@preferred.jp wrote:
Hi,
I am developing a Spark Streaming application where I want every item in
my stream to be
Hi,
On Wed, Jan 21, 2015 at 4:46 PM, Akhil Das ak...@sigmoidanalytics.com
wrote:
How about using accumulators
http://spark.apache.org/docs/1.2.0/programming-guide.html#accumulators?
As far as I understand, they solve the part of the problem that I am not
worried about, namely increasing the
