Re: spark with breeze error of NoClassDefFoundError

2015-11-19 Thread Ted Yu
*To:* Ted Yu > *Cc:* Jack Yang; Fengdong Yu; user@spark.apache.org > > *Subject:* Re: spark with breeze error of NoClassDefFoundError > > > > Dear Ted, > > I just looked at the link you provided, it is great! > > > > For my understanding, I could also dire

Re: spark with breeze error of NoClassDefFoundError

2015-11-18 Thread Fengdong Yu
> > > From: Ted Yu [mailto:yuzhih...@gmail.com] > Sent: Wednesday, 18 November 2015 4:01 PM > To: Jack Yang > Cc: user@spark.apache.org > Subject: Re: spark with breeze error of NoClassDefFoundError > > Looking in local maven repo, breeze_2.10-0.7.jar contains De

Re: spark with breeze error of NoClassDefFoundError

2015-11-18 Thread 金国栋
LClassLoader.findClass(URLClassLoader.java:354) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > > ... 10 more > > 15/11/18 17:15:15 INFO util.Utils: Shutdown hook called > &

RE: spark with breeze error of NoClassDefFoundError

2015-11-18 Thread Jack Yang
ubject: Re: spark with breeze error of NoClassDefFoundError The simplest way is remove all “provided” in your pom. then ‘sbt assembly” to build your final package. then get rid of ‘—jars’ because assembly already includes all dependencies. On Nov 18, 2015, at 2:15 PM, Jack Yang <j...@uow.ed

Re: spark with breeze error of NoClassDefFoundError

2015-11-18 Thread Zhiliang Zhu
ser@spark.apache.org Subject: Re: spark with breeze error of NoClassDefFoundError   The simplest way is remove all “provided” in your pom.   then ‘sbt assembly” to build your final package. then get rid of ‘—jars’ because assembly already includes all dependencies.             On Nov 18,

Re: spark with breeze error of NoClassDefFoundError

2015-11-18 Thread Zhiliang Zhu
fer to use maven to compile the jar file rather than sbt, although it is indeed another option.   Best regards, Jack       From: Fengdong Yu [mailto:fengdo...@everstring.com] Sent: Wednesday, 18 November 2015 7:30 PM To: Jack Yang Cc: Ted Yu; user@spark.apache.org Subject: Re: spark w

Re: spark with breeze error of NoClassDefFoundError

2015-11-18 Thread Ted Yu
/11/19 10:28:29 INFO util.Utils: Shutdown hook called > > Meanwhile, I will prefer to use maven to compile the jar file rather than > sbt, although it is indeed another option. > > Best regards, > Jack > > > > From: Fengdong Yu [mailto:fengdo...@everstring.com

RE: spark with breeze error of NoClassDefFoundError

2015-11-18 Thread Jack Yang
Yu; user@spark.apache.org Subject: Re: spark with breeze error of NoClassDefFoundError Dear Ted, I just looked at the link you provided, it is great! For my understanding, I could also directly use other Breeze part (except spark mllib package linalg ) in spark (scala or java ) program after

Re: spark with breeze error of NoClassDefFoundError

2015-11-17 Thread Ted Yu
Looking in local maven repo, breeze_2.10-0.7.jar contains DefaultArrayValue : jar tvf /Users/tyu/.m2/repository//org/scalanlp/breeze_2.10/0.7/breeze_2.10-0.7.jar | grep !$ jar tvf /Users/tyu/.m2/repository//org/scalanlp/breeze_2.10/0.7/breeze_2.10-0.7.jar | grep DefaultArrayValue 369 Wed Mar

RE: spark with breeze error of NoClassDefFoundError

2015-11-17 Thread Jack Yang
Re: spark with breeze error of NoClassDefFoundError Looking in local maven repo, breeze_2.10-0.7.jar contains DefaultArrayValue : jar tvf /Users/tyu/.m2/repository//org/scalanlp/breeze_2.10/0.7/breeze_2.10-0.7.jar | grep !$ jar tvf /Users/tyu/.m2/repository//org/scalanlp/breeze_2.10/0.7/breeze_2.