Hi, Yes, if they are not big, it's a good practice to broadcast them to avoid serializing them each time you use clojure.
Paolo Inviata dal mio Windows Phone ________________________________ Da: frodo777<mailto:roberto.vaquer...@bitmonlab.com> Inviato: 26/01/2015 14:34 A: user@spark.apache.org<mailto:user@spark.apache.org> Oggetto: Broadcast variables: when should I use them? Hello. I have a number of "static" Arrays and Maps in my Spark Streaming driver program. They are simple collections, initialized with integer values and strings directly in the code. There is no RDD/DStream involvement here..... I do not expect them to contain more than 100 entries, each. They are used in several subsequent parallel operations. The question is: Should I convert them into broadcast variables? Thanks and regards. -Bob -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Broadcast-variables-when-should-I-use-them-tp21366.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
