This could be the result of you not setting the location of eventLog properly. By default, it's/TMP/Spark-Events, and since the files in the/TMP directory are cleaned up regularly, you could have this problem.
------------------ Original ------------------ From: "Xin Jinhan"<18183124...@163.com>; Date: Thu, Jul 2, 2020 08:39 PM To: "user"<user@spark.apache.org>; Subject: Re: File Not Found: /tmp/spark-events in Spark 3.0 Hi, First, the /tmp/spark-events is the default storage location of spark eventLog, but the log is stored only when you set the 'spark.eventLog.enabled=true', which maybe your spark 2.4.6 set to false. So you can just set it to false and the error will disappear. Second, I suggest to open the eventLog and you can specify the log location with 'spark.eventLog.dir' either a filesystem or local one, because you maybe to check the log later.(can simplely use spark-history-server) Regards Jinhan -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org