By the way, for anyone using elasticsearch-hadoop, there is a fix for this
here: https://github.com/elasticsearch/elasticsearch-hadoop/issues/239
Ryan - using the nightly snapshot build of 2.1.0.BUILD-SNAPSHOT fixed this
for me.
On Thu, Aug 7, 2014 at 3:58 PM, Nick Pentreath nick.pentre...@gmail.com
wrote:
I'm also getting this - Ryan we both seem to be running into this issue
with elasticsearch-hadoop :)
I tried spark.files.userClassPathFirst true on command line and that
doesn;t work
If I put it that line in spark/conf/spark-defaults it works but now I'm
getting:
java.lang.NoClassDefFoundError: org/apache/hadoop/mapred/InputFormat
think I may need to add hadoop-client to my assembly, but any other ideas
welcome.
Ryan, will let you know how I get on
On Mon, Aug 4, 2014 at 10:28 AM, Sean Owen so...@cloudera.com wrote:
I'm guessing you have the Jackson classes in your assembly but so does
Spark. Its classloader wins, and does not contain the class present in
your app's version of Jackson. Try spark.files.userClassPathFirst ?
On Mon, Aug 4, 2014 at 6:28 AM, Ryan Braley r...@traintracks.io wrote:
Hi Folks,
I have an assembly jar that I am submitting using spark-submit script
on a
cluster I created with the spark-ec2 script. I keep running into the
java.lang.NoClassDefFoundError: org/codehaus/jackson/annotate/JsonClass
error on my workers even though jar tf clearly shows that class being a
part
of my assembly jar. I have the spark program working locally.
Here is the error log:
https://gist.github.com/rbraley/cf5cd3457a89b1c0ac88
Anybody have any suggestions of things I can try? It seems
http://mail-archives.apache.org/mod_mbox/incubator-spark-user/201406.mbox/%3c1403899110.65393.yahoomail...@web160503.mail.bf1.yahoo.com%3E
that this is a similar error. I am open to recompiling spark to fix
this,
but I would like to run my job on my cluster rather than just locally.
Thanks,
Ryan
Ryan Braley | Founder
http://traintracks.io/
US: +1 (206) 866 5661
CN: +86 156 1153 7598
Coding the future. Decoding the game.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
