[
https://issues.apache.org/jira/browse/SPARK-17313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449684#comment-15449684
]
Sean Owen commented on SPARK-17313:
-----------------------------------
The problem is: how are you going to interact with a shell on your local
machine when the driver is somewhere else? It's not impossible but not clear
it's worthwhile. The driver is in general not doing much work, or shouldn't be;
the shell is more for exploration that production.
> Support spark-shell on cluster mode
> -----------------------------------
>
> Key: SPARK-17313
> URL: https://issues.apache.org/jira/browse/SPARK-17313
> Project: Spark
> Issue Type: New Feature
> Reporter: Mahmoud Elgamal
>
> The main issue with the current spark shell is that the driver is running on
> the user machine. If the driver resource requirement is beyond user machine
> capacity, then spark shell will be useless. If we are to add the cluster
> mode(Yarn or Mesos ) for spark shell via some sort of proxy where user
> machine only hosts a rest client to the running driver at the cluster, the
> shell will be more powerful
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
