[
https://issues.apache.org/jira/browse/SPARK-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223583#comment-14223583
]
Davies Liu commented on SPARK-2313:
-----------------------------------
[~farrellee] Thew new approach could be:
1) bind to random socket in python,
2) pass the port into JVM, connect to it
3) Java Gateway binds to random port
4) pass the port back via socket (created in 1)
5) read the port from socket (created in 1), close it
The logic will similar as current, the cost is create a temporary socket.
> PySpark should accept port via a command line argument rather than STDIN
> ------------------------------------------------------------------------
>
> Key: SPARK-2313
> URL: https://issues.apache.org/jira/browse/SPARK-2313
> Project: Spark
> Issue Type: Bug
> Components: PySpark
> Reporter: Patrick Wendell
>
> Relying on stdin is a brittle mechanism and has broken several times in the
> past. From what I can tell this is used only to bootstrap worker.py one time.
> It would be strictly simpler to just pass it is a command line.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
