On Wednesday 02 March 2016 09:39 PM,
Matthias Niehoff wrote:
Why exactly does adding jars to driver/executor extraClassPath not work? Classpath of master/worker is setup by AbstractCommandBuilder that explicitly adds the following: jars named "datanucleus-*", environment variables: _SPARK_ASSEMBLY (for assembly jar), SPARK_DIST_CLASSPATH, HADOOP_CONF_DIR, YARN_CONF_DIR So you can set SPARK_DIST_CLASSPATH in conf/spark-env.sh to add the required jars (separated by platform's File.pathSeparator). thanks -- Sumedh Wale SnappyData (http://www.snappydata.io)
--------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org |
- Add Jars to Master/Worker classpath Matthias Niehoff
- Re: Add Jars to Master/Worker classpath Igor Berman
- Re: Add Jars to Master/Worker classpath Matthias Niehoff
- Re: Add Jars to Master/Worker classpath Prabhu Joseph
- Re: Add Jars to Master/Worker classpath Sumedh Wale
- Re: Add Jars to Master/Worker classpath Matthias Niehoff