Hello,
I've created a spark cluster on ec2 using the spark-ec2 script. I would
like to be able to modify the logging level of the spark-shell when it is
running on the master. I've copied the log4j.properties template file and
changed the root logger level to WARN and that doesn't seem to have any
effect. I still see tons of INFO messages in the shell.
I can import the log4j classes at the shell prompt and call
Logger.getLogger("org").setLevel(Level.WARN)
to set the level and that does work but I'd prefer to not have to do that
every time I run the shell.
Any suggestions?
Thanks.
