I got 'NoSuchFieldError' which is of the same type. its definitely a dependency jar conflict. spark driver will load jars of itself which in recent version get many dependencies that are 1-2 years old. And if your newer version dependency is in the same package it will be shaded (Java's first come first serve principle) and the new method won't be found. Try using:
mvn dependency:tree to find duplicate artifacts and use maven-shade-plugin to rename the package of your newer library. (IntelliJ doesn't officially support this plug-in so it may become quirky, if that happens try re-importing the project) -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Upgrading-to-Spark-1-0-0-causes-NoSuchMethodError-tp8207p8220.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
