[ https://issues.apache.org/jira/browse/SPARK-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yanbo Liang updated SPARK-17577: -------------------------------- Description: Scala/Python users can add files to Spark job by submit options {{--files}} or {{SparkContext.addFile()}}. Meanwhile, users can get the added file by {{SparkFiles.get(filename)}}. We should also support this function for SparkR users, since SparkR users should can use shared files for each executors. For examples, SparkR users can download third party R packages to driver firstly, add these files to the Spark job by this API and then each executor can install these packages by {{install.packages}}. was: Scala/Python users can add files to Spark job by submit options {{--files}} or {{SparkContext.addFile()}}. Meanwhile, users can get the added file by {{SparkFiles.get(filename)}}. We should also support this function for SparkR users, since SparkR users may install third party R packages on each executors. For examples, SparkR users can download third party R packages to driver firstly, add these files to the Spark job by this API and each executor can install these packages by {{install.packages}}. > SparkR support add files to Spark job and get by executors > ---------------------------------------------------------- > > Key: SPARK-17577 > URL: https://issues.apache.org/jira/browse/SPARK-17577 > Project: Spark > Issue Type: Improvement > Components: SparkR > Reporter: Yanbo Liang > > Scala/Python users can add files to Spark job by submit options {{--files}} > or {{SparkContext.addFile()}}. Meanwhile, users can get the added file by > {{SparkFiles.get(filename)}}. > We should also support this function for SparkR users, since SparkR users > should can use shared files for each executors. For examples, SparkR users > can download third party R packages to driver firstly, add these files to the > Spark job by this API and then each executor can install these packages by > {{install.packages}}. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org