Hi,
I have initialised the logging in my spark App
/*Initialize Logging */
val log = Logger.getLogger(getClass.getName)
Logger.getLogger("org").setLevel(Level.OFF)
Logger.getLogger("akka").setLevel(Level.OFF)
log.warn("Some text"+Somemap.size)
When I run my spark job in using spark-submit like as below
spark-submit \
--master yarn-client \
--driver-memory 1G \
--executor-memory 1G \
--executor-cores 1 \
--num-executors 2 \
--class MainClass /home/hadoop/Spark-assembly-1.0.jar
I could see the log in terminal itself
16/09/22 03:45:31 WARN MainClass$: SomeText : 10
When I set up this job in scheduler
where I can see these logs?
Thanks,
Divya
