I'm a newbee in Spark. I know that what the work should do is written in RDD.
But I want to make the worker load a native lib and I can do something to
change the content of the lib in memory.
So how can I do. I can do it on driver, but not worker. I always get a fatal
error. The jvm report A
Ok. I don't put it in the path. Because this is not a lib I want to use
permanently.
here is my code in RDD.
val fileaddr = SparkFiles.get(segment.so);
System.load(fileaddr);
val config = SparkFiles.get(qsegconf.ini)
val segment = new Segment//this
You just need to add --driver-library-path the directory in you submit
command. And in your worker node, add the lib in the right work directory
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/how-to-use-JNI-in-spark-tp530p18551.html
Sent from the Apache
