Re: ClassCastException in driver program

2015-09-08 Thread Jeff Jones
jars list. Unfortunately the actual error got masked by the one I sent below. Jeff From: Shixiong Zhu Date: Sunday, September 6, 2015 at 9:02 AM To: Jeff Jones Cc: "user@spark.apache.org<mailto:user@spark.apache.org>" Subject: Re: ClassCastException in driver program Looks there a

Re: ClassCastException in driver program

2015-09-06 Thread Shixiong Zhu
Looks there are some circular references in SQL making the immutable List serialization fail in 2.11. In 2.11, Scala immutable List uses writeReplace()/readResolve() which don't play nicely with circular references. Here is an example to reproduce this issue in 2.11.6: class Foo extends

ClassCastException in driver program

2015-09-04 Thread Jeff Jones
We are using Scala 2.11 for a driver program that is running Spark SQL queries in a standalone cluster. I’ve rebuilt Spark for Scala 2.11 using the instructions at http://spark.apache.org/docs/latest/building-spark.html. I’ve had to work through a few dependency conflict but all-in-all it