Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21267
Hm .. @jerryshao, seems it's a bit difficult to do so. The simplest way
should be just to copy files into the directories in
`SparkFiles.getRootDirectory`; however, `SparkEnv` is inaccessible at this
stage in `SparkSubmit` ..
Another way might be to find if there's a way by setting `spark.files` so
that they are added via `addFile` later which put the file in
`SparkFiles.getRootDirectory` at driver side too but .. I wonder if it makes
sense to set this which Yarn doesn't use.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
