Re: Got NotSerializableException when access broadcast variable

2014-08-21 Thread tianyi
that is called on an RDD? That will definitely create a problem. -Vida On Wed, Aug 20, 2014 at 1:20 AM, tianyi tia...@asiainfo.com wrote: Thanks for help. I run this script again with bin/spark-shell --conf spark.serializer=org.apache.spark.serializer.KryoSerializer” in the console, I

Re: Got NotSerializableException when access broadcast variable

2014-08-20 Thread tianyi
Thanks for help. I run this script again with bin/spark-shell --conf spark.serializer=org.apache.spark.serializer.KryoSerializer” in the console, I can see: scala sc.getConf.getAll.foreach(println) (spark.tachyonStore.folderName,spark-eaabe986-03cb-41bd-bde5-993c7db3f048)