[GitHub] spark issue #18885: [SPARK-21668][CORE] Ability to run driver programs withi...
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/18885 Great, I closed the bug. Please close the PR too. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #18885: [SPARK-21668][CORE] Ability to run driver programs withi...
Github user tashoyan commented on the issue: https://github.com/apache/spark/pull/18885 So the working configuration is: * set `spark.driver.host` to the IP address of the host machine * set `spark.driver.bindAddress` to the IP address of the container I tried this configuration with Spark 2.1.1 and 2.2.0. Works fine! @vanzin thank you for pointing me to the right issue. I think we can close this PR and mark [SPARK-21668](https://issues.apache.org/jira/browse/SPARK-21668) as a duplicate of [SPARK-4563](https://issues.apache.org/jira/browse/SPARK-4563). The working Docker image is here: [docker-spark-submit](https://github.com/tashoyan/docker-spark-submit). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #18885: [SPARK-21668][CORE] Ability to run driver programs withi...
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/18885 Have you tried using `spark.driver.host` / `spark.driver.bindAddress` for this (SPARK-4563)? I'm pretty sure I tested exactly the scenario you mention when working on that. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #18885: [SPARK-21668][CORE] Ability to run driver programs withi...
Github user tashoyan commented on the issue: https://github.com/apache/spark/pull/18885 @vanzin @srowen @jerryshao would you you review please? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #18885: [SPARK-21668][CORE] Ability to run driver programs withi...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18885 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
