[ 
https://issues.apache.org/jira/browse/SPARK-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036316#comment-14036316
 ] 

Kay Ousterhout commented on SPARK-1466:
---------------------------------------

[~pwendell] I didn't merge this into the 1.0 branch since it's pretty minor and 
I don't know if anyone besides the students in the course where we used iPython 
notebook have noticed this. I know it was marked as a blocker but I think that 
was an inflated priority -- anyway let me know if you think it should go in for 
1.0.1.

> Pyspark doesn't check if gateway process launches correctly
> -----------------------------------------------------------
>
>                 Key: SPARK-1466
>                 URL: https://issues.apache.org/jira/browse/SPARK-1466
>             Project: Spark
>          Issue Type: Bug
>          Components: PySpark
>    Affects Versions: 0.9.0, 0.9.1
>            Reporter: Kay Ousterhout
>            Assignee: Kay Ousterhout
>            Priority: Blocker
>             Fix For: 1.1.0
>
>
> If the gateway process fails to start correctly (e.g., because JAVA_HOME 
> isn't set correctly, there's no Spark jar, etc.), right now pyspark fails 
> because of a very difficult-to-understand error, where we try to parse stdout 
> to get the port where Spark started and there's nothing there.  We should 
> properly catch the error, print it to the user, and exit.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to