Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19466#discussion_r143890640
--- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala ---
@@ -366,6 +366,16 @@ object SparkSubmit extends CommandLineUtils with
Logging {
localPyFiles = Option(args.pyFiles).map {
downloadFileList(_, targetDir, sparkConf, hadoopConf, secMgr)
}.orNull
+
+ if (clusterManager == STANDALONE || clusterManager == LOCAL) {
+ // Use local files for standalone client mode.
+ args.primaryResource = localPrimaryResource
--- End diff --
Can you explain what breaks without this line?
The code in L522 is adding the local copy of the primary resource to the
user's classpath, which should be all that's needed, right?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
