Re: jar conflict with Spark default packaging

2015-03-16 Thread Shawn Zheng
Thanks a lot. I will give a try! On Monday, March 16, 2015, Adam Lewandowski adam.lewandow...@gmail.com wrote: Prior to 1.3.0, Spark has 'spark.files.userClassPathFirst' for non-yarn apps. For 1.3.0, use 'spark.executor.userClassPathFirst'. See

jar conflict with Spark default packaging

2015-03-13 Thread Shuai Zheng
Hi All, I am running spark to deal with AWS. And aws sdk latest version is working with httpclient 3.4+. Then but spark-assembly-*-.jar file has packaged an old httpclient version which cause me: ClassNotFoundException for org/apache/http/client/methods/HttpPatch Even when I put the