[ https://issues.apache.org/jira/browse/SPARK-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14036316#comment-14036316 ]
Kay Ousterhout commented on SPARK-1466: --------------------------------------- [~pwendell] I didn't merge this into the 1.0 branch since it's pretty minor and I don't know if anyone besides the students in the course where we used iPython notebook have noticed this. I know it was marked as a blocker but I think that was an inflated priority -- anyway let me know if you think it should go in for 1.0.1. > Pyspark doesn't check if gateway process launches correctly > ----------------------------------------------------------- > > Key: SPARK-1466 > URL: https://issues.apache.org/jira/browse/SPARK-1466 > Project: Spark > Issue Type: Bug > Components: PySpark > Affects Versions: 0.9.0, 0.9.1 > Reporter: Kay Ousterhout > Assignee: Kay Ousterhout > Priority: Blocker > Fix For: 1.1.0 > > > If the gateway process fails to start correctly (e.g., because JAVA_HOME > isn't set correctly, there's no Spark jar, etc.), right now pyspark fails > because of a very difficult-to-understand error, where we try to parse stdout > to get the port where Spark started and there's nothing there. We should > properly catch the error, print it to the user, and exit. -- This message was sent by Atlassian JIRA (v6.2#6252)