Re: Path of jars added to a Spark Job - spark-submit // // Override jars in spark submit

2020-11-12 Thread Dominique De Vito
not use a jar specified by --jars to be in driver-class-path, since the >> driver is already started and it's classpath is already set before any jars >> are moved. >> >> Some distributions may change this behavior though, but this is the jist >> of it. >> >> On Thu, No

Re: Path of jars added to a Spark Job - spark-submit // // Override jars in spark submit

2020-11-12 Thread Dominique De Vito
nce the > driver is already started and it's classpath is already set before any jars > are moved. > > Some distributions may change this behavior though, but this is the jist > of it. > > On Thu, Nov 12, 2020 at 10:02 AM Dominique De Vito > wrote: > >> Hi, &g

Path of jars added to a Spark Job - spark-submit // // Override jars in spark submit

2020-11-12 Thread Dominique De Vito
Hi, I am using Spark 2.1 (BTW) on YARN. I am trying to upload JAR on YARN cluster, and to use them to replace on-site (alreading in-place) JAR. I am trying to do so through spark-submit. One helpful answer