RE: Extra libs in executor classpath

Could you publish it as a library (to an internal repo) then you can simply use the “--packages" option? Also will help with versioning as you make changes, that way you’re not having to manually ship JARs around to your machines and users. From: Леонид Поляков

Re: Extra libs in executor classpath

For your last point, spark-submit has: if [ -z "${SPARK_HOME}" ]; then export SPARK_HOME="$(cd "`dirname "$0"`"/..; pwd)" fi Meaning the script would determine the proper SPARK_HOME variable. FYI On Wed, Mar 16, 2016 at 4:22 AM, Леонид Поляков wrote: > Hello, guys! > > >

Re: Extra libs in executor classpath

No, sadly, it's not an option. End users are not my team members, it's for customers, so I have to bundle the framework and ship it. There is more to my project than just libs, so end users will have to use bundle anyway. On Wed, Mar 16, 2016 at 6:41 PM, Silvio Fiorito <