Hi,

How can I specify Worker and Master LOG folders? If I set "SPARK_WORKER_DIR" in 
spark-env, it only affects Executor logs and shuffling folder. But Worker and 
Master logs still goes to something default:
starting org.apache.spark.deploy.master.Master, logging to 
/usr/local/spark/sbin/../logs/spark-user-org.apache.spark.deploy.master.Master-1-machine-6.out
machine-7.hpl.hp.com: starting org.apache.spark.deploy.worker.Worker, logging 
to 
/usr/local/spark/sbin/../logs/spark-user-org.apache.spark.deploy.worker.Worker-1-machine-7.out

Best regards, Alexander

Reply via email to