[jira] [Commented] (SPARK-5810) Maven Coordinate Inclusion failing in pySpark
[ https://issues.apache.org/jira/browse/SPARK-5810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14323474#comment-14323474 ] Burak Yavuz commented on SPARK-5810: Makes sense to add a regression test. I'll add it with the documentation PR which I'll submit today. I'll ping you on that one so that you can take a look. > Maven Coordinate Inclusion failing in pySpark > - > > Key: SPARK-5810 > URL: https://issues.apache.org/jira/browse/SPARK-5810 > Project: Spark > Issue Type: Bug > Components: Deploy, PySpark >Affects Versions: 1.3.0 >Reporter: Burak Yavuz >Assignee: Josh Rosen >Priority: Blocker > Fix For: 1.3.0 > > > When including maven coordinates to download dependencies in pyspark, pyspark > returns a GatewayError, because it cannot read the proper port to communicate > with the JVM. This is because pyspark relies on STDIN to read the port number > and in the meantime Ivy prints out a whole lot of logs. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5810) Maven Coordinate Inclusion failing in pySpark
[ https://issues.apache.org/jira/browse/SPARK-5810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14323465#comment-14323465 ] Josh Rosen commented on SPARK-5810: --- I think that this should be fixed now that my patch for SPARK-2313 has been merged. [~brkyvz], do you think we should add a regression test for this bug? Do you have tests for Maven coordinate inclusion? > Maven Coordinate Inclusion failing in pySpark > - > > Key: SPARK-5810 > URL: https://issues.apache.org/jira/browse/SPARK-5810 > Project: Spark > Issue Type: Bug > Components: Deploy, PySpark >Affects Versions: 1.3.0 >Reporter: Burak Yavuz >Assignee: Josh Rosen >Priority: Blocker > Fix For: 1.3.0 > > > When including maven coordinates to download dependencies in pyspark, pyspark > returns a GatewayError, because it cannot read the proper port to communicate > with the JVM. This is because pyspark relies on STDIN to read the port number > and in the meantime Ivy prints out a whole lot of logs. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
