Thank you for the answer and sorry for the double question, but now it works! I have one additional question, is it possible to use a broadcast variable in this object, at the moment I try it in the way below, but the broadcast object is still null.
object lookupObject { private var treeFile : org.apache.spark.broadcast.Broadcast[String] = _ def main(args: Array[String]): Unit = { … val treeFile = sc.broadcast(args(0)) … } object treeContainer { val tree : S2Lookup = loadTree def dolookup(id : Long) : Boolean = { return tree.lookupSimple(new S2CellId(id)) } def loadTree() : S2Lookup = { val path = new Path(treeFile.value); // treeFile is everytime null val fileSystem = FileSystem.get(new Configuration()) new S2Lookup(ConversionUtils.deserializeCovering(new InputStreamReader(fileSystem.open(path)))) } } } -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Setup-an-huge-Unserializable-Object-in-a-mapper-tp14817p14899.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org