Re: Using jar bundled log4j.xml on worker nodes

2016-02-05 Thread Matthias Niehoff
mh, that seems to be the problem we are facing. but with —files you can just pass local files, no files in the class path. so we would need a file outside of our jar.. 2016-02-04 18:20 GMT+01:00 Ted Yu : > Have you taken a look at SPARK-11105 ? > > Cheers > > On Thu, Feb 4,

Using jar bundled log4j.xml on worker nodes

2016-02-04 Thread Matthias Niehoff
Hello everybody, we’ve bundle our log4j.xml into our jar (in the classpath root). I’ve added the log4j.xml to the spark-defaults.conf with spark.{driver,executor}.extraJavaOptions=-Dlog4j.configuration=log4j.xml There is no log4j.properties or log4j.xml in one of the conf folders on any

Re: Using jar bundled log4j.xml on worker nodes

2016-02-04 Thread Ted Yu
Have you taken a look at SPARK-11105 ? Cheers On Thu, Feb 4, 2016 at 9:06 AM, Matthias Niehoff < matthias.nieh...@codecentric.de> wrote: > Hello everybody, > > we’ve bundle our log4j.xml into our jar (in the classpath root). > > I’ve added the log4j.xml to the spark-defaults.conf with > >