[ https://issues.apache.org/jira/browse/SPARK-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14643248#comment-14643248 ]
Mark Grover edited comment on SPARK-9384 at 7/27/15 7:26 PM: ------------------------------------------------------------- Thanks Sean. {{-- jars}} does something similar but not quite. {{extraClassPath}} properties modify the system classpath of both the driver and executor while {{--jars}} only modifies the class loader running the driver/executor code. This change would allow users to override libraries shipped with Spark, or add jars like some JDBC driver, that don't work unless they are adding to the system classpath. was (Author: mgrover): Thanks Sean. {{--jars}} does something similar but not quite. {{*.*.extraClassPath}} properties modifies the system classpath of both the executors and drivers while {{--jars}} only modifies the class loader running the driver/executor code. This change would allow advanced users to override libraries shipped with Spark, or add jars like some JDBC driver, that don't work unless they are adding to the system classpath. > Easier setting of executor and driver classpath > ----------------------------------------------- > > Key: SPARK-9384 > URL: https://issues.apache.org/jira/browse/SPARK-9384 > Project: Spark > Issue Type: Improvement > Components: Spark Submit > Affects Versions: 1.4.1 > Reporter: Mark Grover > Priority: Minor > > Currently one can set extra jars in the driver classpath using > {{spark.driver.extraClassPath}} property. Similarly, the executor's extra > classpath can be set using {{spark.executor.extraClassPath}} property. > However, many users (myself) included have often suffered from the dogma of > setting one and missing the other. Causing a lot of wasted time. And, this > JIRA is an effort to see if the status quo can be made better. > More details in comments. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org