breeze_2.10-0.7.jar
almost all the jars about breeze i can find, but still
NoSuchMethodError:
breeze.linalg.DenseMatrix
from the executor stderr, you can see the executor successsully fetches
these jars, what's wrong
about my method? thank you!
14/05/14 20:36:02 INFO Executor: Fetching
finally i fixed it. previous failure is caused by lack of some jars.
i pasted the classpath in local mode to workers by using show
compile:dependencyClasspath
and it works!
--
View this message in context:
jars to workers using sc.addJar()
breeze jars include :
breeze-natives_2.10-0.7.jar
breeze-macros_2.10-0.3.jar
breeze-macros_2.10-0.3.1.jar
breeze_2.10-0.8-SNAPSHOT.jar
breeze_2.10-0.7.jar
almost all the jars about breeze i can find, but still NoSuchMethodError
NoSuchMethodError:
breeze.linalg.DenseMatrix
from the executor stderr, you can see the executor successsully fetches
these jars, what's wrong
about my method? thank you!
14/05/14 20:36:02 INFO Executor: Fetching
http://192.168.0.106:42883/jars/breeze-natives_2.10-0.7.jar with timestamp
1400070957376
14/05
Since the breeze jar is brought into spark by mllib package, you may want
to add mllib as your dependency in spark 1.0. For bring it from your
application yourself, you can either use sbt assembly in ur build project
to generate a flat myApp-assembly.jar which contains breeze jar, or use
spark add
Hi,
i'am trying to use breeze linalg library for matrix operation in my spark
code. i already add dependency
on breeze in my build.sbt, and package my code sucessfully.
when i run on local mode, sbt run local..., everything is ok
but when turn to standalone mode, sbt run
If you add the breeze dependency in your build.sbt project, it will not be
available to all the workers.
There are couple options, 1) use sbt assembly to package breeze into your
application jar. 2) manually copy breeze jar into all the nodes, and have
them in the classpath. 3) spark 1.0 has
An additional option 4) Use SparkContext.addJar() and have the
application ship your jar to all the nodes.
Yadid
On 5/4/14, 4:07 PM, DB Tsai wrote:
If you add the breeze dependency in your build.sbt project, it will
not be available to all the workers.
There are couple options, 1) use sbt
Hi, DB, i think it's something related to sbt publishLocal
if i remove the breeze dependency in my sbt file, breeze can not be found
[error] /home/wxhsdp/spark/example/test/src/main/scala/test.scala:5: not
found: object breeze
[error] import breeze.linalg._
[error]^
here's my sbt file:
