RE: classpath conflict with spark internal libraries and the spark shell.

You can try shading the jar. Look at maven shade plugin From: Benyi Wang [mailto:bewang.t...@gmail.com] Sent: Saturday, September 10, 2016 1:35 AM To: Colin Kincaid Williams Cc: user@spark.apache.org<mailto:user@spark.apache.org> Subject: Re: classpath conflict with spark internal lib

Re: classpath conflict with spark internal libraries and the spark shell.

I had a problem when I used "spark.executor.userClassPathFirst" before. I don't remember what the problem is. Alternatively, you can use --driver-class-path and "--conf spark.executor.extraClassPath". Unfortunately you may feel frustrated like me when trying to make it work. Depends on how you

Re: classpath conflict with spark internal libraries and the spark shell.

My bad, gothos on IRC pointed me to the docs: http://jhz.name/2016/01/10/spark-classpath.html Thanks Gothos! On Fri, Sep 9, 2016 at 9:23 PM, Colin Kincaid Williams wrote: > I'm using the spark shell v1.61 . I have a classpath conflict, where I > have an external library ( not