I've tried to set the log4j logger to warn only via log4j properties file in
cat src/test/resources/log4j.properties
log4j.logger.org.apache.spark=WARN
or in sbt via
javaOptions += -Dlog4j.logger.org.apache.spark=WARN
But the logger still gives me INFO messages to stdout when I run my tests
How about adding the following in your $SPARK_HOME/conf/log4j.properties
file?
# Set WARN to be logged to the console
*log4j.rootCategory=WARN, console*
log4j.appender.console=org.apache.log4j.ConsoleAppender
log4j.appender.console.target=System.err
