Spark stream test throw org.apache.spark.SparkException: Task not serializable when execute in spark shell

hi ,all there two examples one is throw Task not serializable when execute in spark shell,the other one is ok,i am very puzzled,can anyone give what's different about this two code and why the other is ok 1.The one which throw Task not serializable : import org.apache.spark._ import SparkConte

Re: Spark stream test throw org.apache.spark.SparkException: Task not serializable when execute in spark shell

I can't tell immediately, but you might be able to get more info with the hint provided here: http://stackoverflow.com/questions/27980781/spark-task-not-serializable-with-simple-accumulator (short version, set -Dsun.io.serialization.extendedDebugInfo=true) Also, unless you're simplifying your exam