Re: How do i get a spark instance to use my log4j properties

2016-04-15 Thread Demi Ben-Ari
Hi Steve, I wrote a blog post on the configuration of Spark that we've used, including the log4j.properties: http://progexc.blogspot.co.il/2014/12/spark-configuration-mess-solved.html (What we did was to distribute the relevant *log4j.properties* file to all of the slaves to the same location)

How do i get a spark instance to use my log4j properties

2016-04-12 Thread Steve Lewis
Ok I am stymied. I have tried everything I can think of to get spark to use my own version of log4j.properties In the launcher code - I launch a local instance from a Java application I say -Dlog4j.configuration=conf/log4j.properties where conf/log4j.properties is user.dir - no luck Spark