RE: Not Serializable exception when integrating SQL and Spark Streaming

2014-12-25 Thread Tarun Garg
00:06:45 -0500 Subject: Re: Not Serializable exception when integrating SQL and Spark Streaming To: bigdat...@live.com CC: lian.cs@gmail.com; user@spark.apache.org The various spark contexts generally aren't serializable because you can't use them on the executors anyway. We made SQLContext

Re: Not Serializable exception when integrating SQL and Spark Streaming

2014-12-24 Thread Cheng Lian
.nabble.com/Not-Serializable-exception-when-integrating-SQL-and-Spark-Streaming-tp20845.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional

RE: Not Serializable exception when integrating SQL and Spark Streaming

2014-12-24 Thread Tarun Garg
@spark.apache.org Subject: Re: Not Serializable exception when integrating SQL and Spark Streaming Generally you can use -Dsun.io.serialization.extendedDebugInfo=true to enable serialization debugging information when serialization exceptions are raised

RE: Not Serializable exception when integrating SQL and Spark Streaming

2014-12-24 Thread Tarun Garg
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Not-Serializable-exception-when-integrating-SQL-and-Spark-Streaming-tp20845.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Re: Not Serializable exception when integrating SQL and Spark Streaming

2014-12-24 Thread Michael Armbrust
: Wed, 24 Dec 2014 16:23:30 +0800 From: lian.cs@gmail.com To: bigdat...@live.com; user@spark.apache.org Subject: Re: Not Serializable exception when integrating SQL and Spark Streaming Generally you can use -Dsun.io.serialization.extendedDebugInfo=true to enable serialization debugging

Not Serializable exception when integrating SQL and Spark Streaming

2014-12-23 Thread bigdata4u
in context: http://apache-spark-user-list.1001560.n3.nabble.com/Not-Serializable-exception-when-integrating-SQL-and-Spark-Streaming-tp20845.html Sent from the Apache Spark User List mailing list archive at Nabble.com