[
https://issues.apache.org/jira/browse/SPARK-11525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sun Rui updated SPARK-11525:
----------------------------
Description:
function(x, col1, col2, method) {Currently SparkR supports spark packages
containing R source code in YARN modes. However, this does not work in
Standalone modes.
To support this feature in Standalone modes, something needs to be done:
1. Distribute an archive of the additional R packages built from R source code
contained in spark packages or jars specified via spark-submit command line
options to cluster nodes;
2. On cluster nodes, decompress the archive to a writable directory and pass
the path to R processes.
was:
Currently SparkR supports spark packages containing R source code in YARN
modes. However, this does not work in Standalone modes.
To support this feature in Standalone modes, something needs to be done:
1. Distribute an archive of the additional R packages built from R source code
contained in spark packages or jars specified via spark-submit command line
options to cluster nodes;
2. On cluster nodes, decompress the archive to a writable directory and pass
the path to R processes.
> Support spark packages containing R source code in Standalone mode
> ------------------------------------------------------------------
>
> Key: SPARK-11525
> URL: https://issues.apache.org/jira/browse/SPARK-11525
> Project: Spark
> Issue Type: New Feature
> Components: SparkR
> Affects Versions: 1.5.1
> Reporter: Sun Rui
>
> function(x, col1, col2, method) {Currently SparkR supports spark packages
> containing R source code in YARN modes. However, this does not work in
> Standalone modes.
> To support this feature in Standalone modes, something needs to be done:
> 1. Distribute an archive of the additional R packages built from R source
> code contained in spark packages or jars specified via spark-submit command
> line options to cluster nodes;
> 2. On cluster nodes, decompress the archive to a writable directory and pass
> the path to R processes.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
