Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21267 Hm .. @jerryshao, seems it's a bit difficult to do so. The simplest way should be just to copy files into the directories in `SparkFiles.getRootDirectory`; however, `SparkEnv` is inaccessible at this stage in `SparkSubmit` .. Another way might be to find if there's a way by setting `spark.files` so that they are added via `addFile` later which put the file in `SparkFiles.getRootDirectory` at driver side too but .. I wonder if it makes sense to set this which Yarn doesn't use.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org