Hi, I'm using spark 1.5.2 and running on a yarn cluster and trying to use a custom log4j appender
in my setup there are 3 jars: the uber jar: spark.yarn.jar=uber-jar.jar the jar that contains the main class: main.jar additional jar with dependencies: dep.jar (passed with the --jars flag to spark submit) I've tried defining my appender in each one of the jars: in uber-jar: the appender is found and created successfully in main.jar or dep.jar: throws ClassNotFoundException I guess log4j tries to load the class before the assemblies were loaded it's related to this ticket: https://issues.apache.org/jira/browse/SPARK-9826 but not the same, as the ticket talk about the appender being defined in the uber-jar, and that case works for me any ideas on how to solve this? thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/log4j-custom-appender-ClassNotFoundException-with-spark-1-5-2-tp25487.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
