Re: How to have Single refernce of a class in Spark Streaming?

Swetha Look at http://spark.apache.org/docs/latest/programming-guide.html#shared-variables Normally, when a function passed to a Spark operation (such as map or reduce) is executed on a remote cluster node, it works

How to have Single refernce of a class in Spark Streaming?

Hi, How to have a single reference of a class across all the executors in Spark Streaming? The contents of the class will be updated at all the executors. Would using it as a variable inside updateStateByKey guarantee that reference is updated across all the executors and no