Hi,
I tried configuring logs to write it to file for Spark Driver and
Executors .
I have two separate log4j properties files for Spark driver and executor
respectively.
Its wrtiting log for Spark driver but for executor logs I am getting below
error :
java.io.FileNotFoundException: /home/hdfs/spark_executor.log (Permission
> denied)
> at java.io.FileOutputStream.open(Native Method)
> at java.io.FileOutputStream.(FileOutputStream.java:221)
Why its giving permission denied for executor log whereas Its writing
driver logs .
I am missing any settings ?
Would really appreciate the help.
Thanks,
Divya