Hello all, I've been trying to spark-submit a job to the Google Kubernetes Engine but I keep encountering a "Exception in thread "main" java.lang.IllegalArgumentException: Server properties file given at /opt/spark/work-dir/driver does not exist or is not a file." error. I'm unsure of how to even begin debugging this so any help would be greatly appreciated. I've attached the logs and the full spark-submit command I'm running here: https://gist.github.com/erkkel/ c04a0b5ca60ad755cf62e9ad18e5b7ed
For reference, I've been following this guide: https://apache-spark-on-k8s.github.io/userdocs/running-on-kubernetes.html Thanks, Eric