Maybe but any time the work around is to use "spark-submit --conf spark.executor.extraClassPath=/guava.jar blah” that means that standalone apps must have hard coded paths that are honored on every worker. And as you know a lib is pretty much blocked from use of this version of Spark—hence the blocker severity.
I could easily be wrong but userClassPathFirst doesn’t seem to be the issue. There is no class conflict. On Feb 27, 2015, at 7:13 PM, Sean Owen <so...@cloudera.com> wrote: This seems like a job for userClassPathFirst. Or could be. It's definitely an issue of visibility between where the serializer is and where the user class is. At the top you said Pat that you didn't try this, but why not? On Fri, Feb 27, 2015 at 10:11 PM, Pat Ferrel <p...@occamsmachete.com> wrote: > I’ll try to find a Jira for it. I hope a fix is in 1.3 > > > On Feb 27, 2015, at 1:59 PM, Pat Ferrel <p...@occamsmachete.com> wrote: > > Thanks! that worked. > > On Feb 27, 2015, at 1:50 PM, Pat Ferrel <p...@occamsmachete.com> wrote: > > I don’t use spark-submit I have a standalone app. > > So I guess you want me to add that key/value to the conf in my code and make > sure it exists on workers. > > > On Feb 27, 2015, at 1:47 PM, Marcelo Vanzin <van...@cloudera.com> wrote: > > On Fri, Feb 27, 2015 at 1:42 PM, Pat Ferrel <p...@occamsmachete.com> wrote: >> I changed in the spark master conf, which is also the only worker. I added a >> path to the jar that has guava in it. Still can’t find the class. > > Sorry, I'm still confused about what config you're changing. I'm > suggesting using: > > spark-submit --conf spark.executor.extraClassPath=/guava.jar blah > > > -- > Marcelo > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
