[ 
https://issues.apache.org/jira/browse/SPARK-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Or resolved SPARK-1318.
------------------------------

       Resolution: Fixed
    Fix Version/s: 1.0.0

Fixed in https://github.com/apache/spark/pull/116

> Alignment of the Spark Shell with Spark Submit.
> -----------------------------------------------
>
>                 Key: SPARK-1318
>                 URL: https://issues.apache.org/jira/browse/SPARK-1318
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>            Reporter: Bernardo Gomez Palacio
>              Labels: spark-shell, spark-submit
>             Fix For: 1.0.0
>
>
> Align the Spark-Shell with Spark-App/Spark-Submit so that the Spark-Shell 
> offers either the same or a subset of configuration options as the Spark-App 
> does. Ideally this should be implemented in such a way that the Spark-Shell 
> wraps Spark-App therefore minimizing duplication.
> As of now SPARK-1126 is not yet finished and there is an open question 
> regarding how much Bash vs Scala should be leveraged. For a CLI user Bash 
> will provide faster feedback, ergo you don't need to wait for a JVM to start. 
> That said, from a development perspective, Scala might be a better option 
> since we can minimize the code for scripts that target specific operating 
> systems, mainly *NIX vs Windows.
> Additional References:
> * Discussion over [Spark-1186 Github Pull 
> 116|https://github.com/apache/spark/pull/116].
> * [SPARK-1126:Spark-App|https://spark-project.atlassian.net/browse/SPARK-1126]
> * [SPARK-1186:Enrich 
> Spark-Shell|https://spark-project.atlassian.net/browse/SPARK-1186]



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to