R: Broadcast variables: when should I use them?

2015-01-26 Thread Paolo Platter
:34 A: user@spark.apache.org<mailto:user@spark.apache.org> Oggetto: Broadcast variables: when should I use them? Hello. I have a number of "static" Arrays and Maps in my Spark Streaming driver program. They are simple collections, initialized with integer values and strings directly in the co

Broadcast variables: when should I use them?

2015-01-26 Thread frodo777
each. They are used in several subsequent parallel operations. The question is: Should I convert them into broadcast variables? Thanks and regards. -Bob -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Broadcast-variables-when-should-I-use-them-tp21366.html