Re: exception with json4s render
Any ideas on how to figure out what is going on when using json4s 3.2.11. I have a need to use 3.2.11 and just to see if things work I had downgraded to 3.2.10 and things started working. On Wed, Feb 11, 2015 at 11:45 AM, Charles Feduke charles.fed...@gmail.com wrote: I was having a similar problem to this trying to use the Scala Jackson module yesterday. I tried setting `spark.files.userClassPathFirst` to true but I was still having problems due to the older version of Jackson that Spark has a dependency on. (I think its an old org.codehaus version.) I ended up solving my problem by using Spray JSON ( https://github.com/spray/spray-json) which has no dependency on Jackson and has great control over the JSON rendering process. http://engineering.ooyala.com/blog/comparing-scala-json-libraries - based on that I looked for something that didn't rely on Jackson. Now that I see that there is some success with json4s on Spark 1.2.x I'll have to give that a try. On Wed Feb 11 2015 at 2:32:59 PM Jonathan Haddad j...@jonhaddad.com wrote: Actually, yes, I was using 3.2.11. I thought I would need the UUID encoder that seems to have been added in that version, but I'm not using it. I've downgraded to 3.2.10 and it seems to work. I searched through the spark repo and it looks like it's got 3.2.10 in a pom. I don't know the first thing about how dependencies are resolved but I'm guessing it's related? On Wed Feb 11 2015 at 11:20:42 AM Mohnish Kodnani mohnish.kodn...@gmail.com wrote: I was getting similar error after I upgraded to spark 1.2.1 from 1.1.1 Are you by any chance using json4s 3.2.11. I downgraded to 3.2.10 and that seemed to have worked. But I didnt try to spend much time debugging the issue than that. On Wed, Feb 11, 2015 at 11:13 AM, Jonathan Haddad j...@jonhaddad.com wrote: I'm trying to use the json4s library in a spark job to push data back into kafka. Everything was working fine when I was hard coding a string, but now that I'm trying to render a string from a simple map it's failing. The code works in sbt console. working console code: https://gist.github.com/rustyrazorblade/daa50bf05ff0d48ac6af failing spark job line: https://github.com/rustyrazorblade/killranalytics/blob/master/spark/src/main/scala/RawEventProcessing.scala#L114 exception: https://gist.github.com/rustyrazorblade/1e220d87d41cfcad2bb9 I've seen examples of using render / compact when I searched the ML archives, so I'm kind of at a loss here. Thanks in advance for any help. Jon
Re: exception with json4s render
Same here.. I am a newbie to all this as well. But this is just what I found and I lack the expertise to figure out why things dont work in 3.2.11 json4s. May be some one in the group with more expertise can take a crack at it. But this is what unblocked me from moving forward. On Wed, Feb 11, 2015 at 11:31 AM, Jonathan Haddad j...@jonhaddad.com wrote: Actually, yes, I was using 3.2.11. I thought I would need the UUID encoder that seems to have been added in that version, but I'm not using it. I've downgraded to 3.2.10 and it seems to work. I searched through the spark repo and it looks like it's got 3.2.10 in a pom. I don't know the first thing about how dependencies are resolved but I'm guessing it's related? On Wed Feb 11 2015 at 11:20:42 AM Mohnish Kodnani mohnish.kodn...@gmail.com wrote: I was getting similar error after I upgraded to spark 1.2.1 from 1.1.1 Are you by any chance using json4s 3.2.11. I downgraded to 3.2.10 and that seemed to have worked. But I didnt try to spend much time debugging the issue than that. On Wed, Feb 11, 2015 at 11:13 AM, Jonathan Haddad j...@jonhaddad.com wrote: I'm trying to use the json4s library in a spark job to push data back into kafka. Everything was working fine when I was hard coding a string, but now that I'm trying to render a string from a simple map it's failing. The code works in sbt console. working console code: https://gist.github.com/rustyrazorblade/daa50bf05ff0d48ac6af failing spark job line: https://github.com/rustyrazorblade/killranalytics/blob/master/spark/src/main/scala/RawEventProcessing.scala#L114 exception: https://gist.github.com/rustyrazorblade/1e220d87d41cfcad2bb9 I've seen examples of using render / compact when I searched the ML archives, so I'm kind of at a loss here. Thanks in advance for any help. Jon
exception with json4s render
I'm trying to use the json4s library in a spark job to push data back into kafka. Everything was working fine when I was hard coding a string, but now that I'm trying to render a string from a simple map it's failing. The code works in sbt console. working console code: https://gist.github.com/rustyrazorblade/daa50bf05ff0d48ac6af failing spark job line: https://github.com/rustyrazorblade/killranalytics/blob/master/spark/src/main/scala/RawEventProcessing.scala#L114 exception: https://gist.github.com/rustyrazorblade/1e220d87d41cfcad2bb9 I've seen examples of using render / compact when I searched the ML archives, so I'm kind of at a loss here. Thanks in advance for any help. Jon
Re: exception with json4s render
I was getting similar error after I upgraded to spark 1.2.1 from 1.1.1 Are you by any chance using json4s 3.2.11. I downgraded to 3.2.10 and that seemed to have worked. But I didnt try to spend much time debugging the issue than that. On Wed, Feb 11, 2015 at 11:13 AM, Jonathan Haddad j...@jonhaddad.com wrote: I'm trying to use the json4s library in a spark job to push data back into kafka. Everything was working fine when I was hard coding a string, but now that I'm trying to render a string from a simple map it's failing. The code works in sbt console. working console code: https://gist.github.com/rustyrazorblade/daa50bf05ff0d48ac6af failing spark job line: https://github.com/rustyrazorblade/killranalytics/blob/master/spark/src/main/scala/RawEventProcessing.scala#L114 exception: https://gist.github.com/rustyrazorblade/1e220d87d41cfcad2bb9 I've seen examples of using render / compact when I searched the ML archives, so I'm kind of at a loss here. Thanks in advance for any help. Jon
