For those curious I was using KryoRegistrator it was causing some null pointer exception. I removed the code and problem went away.
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/collect-on-small-list-causes-NullPointerException-tp10400p10402.html Sent from the Apache Spark User List mailing list archive at Nabble.com.