Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/21533 I think maybe we could: 1) either ignore the files with "local" scheme, and let user to decide how to fetch the files, like what current fix. 2) or copy the 'local' scheme files to the `SparkFiles#getRootDirectory` both in driver and executor. The change would be in `Utils#fetchFile`. @jiangxb1987 @vanzin what's your option?
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org