Ok I am stymied. I have tried everything I can think of to get spark to use my own version of
log4j.properties In the launcher code - I launch a local instance from a Java application I say -Dlog4j.configuration=conf/log4j.properties where conf/log4j.properties is user.dir - no luck Spark always starts saying Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties I have a directory conf with my log4j.properties there but it seems to be ignored I use maven and an VERY RELUCTANT to edit the spark jars I know this point has been discussed here before but I do not see a clean answer
