Hi there, I have been getting a strange error in spark-1.6.1 The job submitted uses only the executor launched on the Master node while the other workers are idle. When I check the errors from the web ui to investigate on the killed executors I see the error: Error: invalid log directory /disk/spark-1.6.1-bin-hadoop2.6/work/app-20160622195714-0001/2/
I made sure I gave the correct permissions on the directory, plus the Worker logs are clean. Any hints on that? Thanks a lot!
