Re: [Spark Streaming] Dynamic Broadcast Variable Update

2017-09-04 Thread takkarharsh
Hi, I have the same use-case, can you please let me know the implementation for the same. -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [Spark Streaming] Dynamic Broadcast Variable Update

2017-05-05 Thread Reynold Xin
Thanks for the email. The process is to create a JIRA ticket and then post a design doc for discussion. You will of course need to update your code to work with the latest master branch, but you should wait oj that until the community has a chance to comment on the design. Cheers. On Fri, May

[Spark Streaming] Dynamic Broadcast Variable Update

2017-05-05 Thread Nipun Arora
Hi All, To support our Spark Streaming based anomaly detection tool, we have made a patch in Spark 1.6.2 to dynamically update broadcast variables. I'll first explain our use-case, which I believe should be common to several people using Spark Streaming applications. Broadcast variables are

[Spark Streaming] Dynamic Broadcast Variable Update

2017-05-02 Thread Nipun Arora
Hi All, To support our Spark Streaming based anomaly detection tool, we have made a patch in Spark 1.6.2 to dynamically update broadcast variables. I'll first explain our use-case, which I believe should be common to several people using Spark Streaming applications. Broadcast variables are