Repository: spark Updated Branches: refs/heads/master d3dcb63b9 -> 7045b8b35
[CORE][DOCS] Update a help message for --files in spark-submit ## What changes were proposed in this pull request? This pr is to update a help message for `--files` in spark-submit because it seems users get confused about how to get full paths of the files that one adds via the option. Author: Takeshi YAMAMURO <linguin....@gmail.com> Closes #16698 from maropu/SparkFilesDoc. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7045b8b3 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/7045b8b3 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/7045b8b3 Branch: refs/heads/master Commit: 7045b8b3554459fe61c4b32868560e66444a2876 Parents: d3dcb63 Author: Takeshi YAMAMURO <linguin....@gmail.com> Authored: Thu Jan 26 10:15:58 2017 +0000 Committer: Sean Owen <so...@cloudera.com> Committed: Thu Jan 26 10:15:58 2017 +0000 ---------------------------------------------------------------------- .../main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/7045b8b3/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala ---------------------------------------------------------------------- diff --git a/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala b/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala index b1d36e1..dee7734 100644 --- a/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala +++ b/core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala @@ -506,7 +506,8 @@ private[deploy] class SparkSubmitArguments(args: Seq[String], env: Map[String, S | --py-files PY_FILES Comma-separated list of .zip, .egg, or .py files to place | on the PYTHONPATH for Python apps. | --files FILES Comma-separated list of files to be placed in the working - | directory of each executor. + | directory of each executor. File paths of these files + | in executors can be accessed via SparkFiles.get(fileName). | | --conf PROP=VALUE Arbitrary Spark configuration property. | --properties-file FILE Path to a file from which to load extra properties. If not --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
