How big is your data? Did you see other error messages from executors? It seems to me like a shuffle communication error. This thread may be relevant:
http://mail-archives.apache.org/mod_mbox/spark-user/201402.mbox/%3ccalrnvjuvtgae_ag1rqey_cod1nmrlfpesxgsb7g8r21h0bm...@mail.gmail.com%3E -Xiangrui On Fri, Jan 9, 2015 at 3:19 AM, jatinpreet <jatinpr...@gmail.com> wrote: > Hi, > > I am using Spark Version 1.1 in standalone mode in the cluster. Sometimes, > during Naive Baye's training, I get OptionalDataException at line, > > map at NaiveBayes.scala:109 > > I am getting following exception on the console, > > java.io.OptionalDataException: > java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1371) > java.io.ObjectInputStream.readObject(ObjectInputStream.java:371) > java.util.HashMap.readObject(HashMap.java:1394) > sun.reflect.GeneratedMethodAccessor626.invoke(Unknown Source) > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > java.lang.reflect.Method.invoke(Method.java:483) > > java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017) > > java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1896) > > java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801) > > What could be the reason behind this? > > Thanks > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/OptionalDataException-during-Naive-Bayes-Training-tp21059.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
