[GitHub] spark issue #15137: [SPARK-17512][Core] Avoid formatting to python path for ...

2016-10-03 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15137 From the commits, it's in 2.0.1 and 2.1.0. Looks like the JIRA just wasn't resolved (I'll do that). --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #15137: [SPARK-17512][Core] Avoid formatting to python path for ...

2016-10-03 Thread steveloughran
Github user steveloughran commented on the issue: https://github.com/apache/spark/pull/15137 I see this in master; but the JIRA associated with the PR is still opened & unversioned. Which version did it make it into? --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #15137: [SPARK-17512][Core] Avoid formatting to python path for ...

2016-09-22 Thread andrewor14
Github user andrewor14 commented on the issue: https://github.com/apache/spark/pull/15137 Got it. I think back then when I wrote that comment we still haven't supported cluster mode with python yet. It's just a little confusing if we're reading that comment in isolation. --- If

[GitHub] spark issue #15137: [SPARK-17512][Core] Avoid formatting to python path for ...

2016-09-21 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/15137 Try to think in another way from `PythonRunner`'s point, this comment looks correct. For yarn and mesos cluster mode, it is because we leverage distributed cache or other to download python files

[GitHub] spark issue #15137: [SPARK-17512][Core] Avoid formatting to python path for ...

2016-09-21 Thread andrewor14
Github user andrewor14 commented on the issue: https://github.com/apache/spark/pull/15137 I've merged it. One more thing, would you mind correcting the comment in `PythonRunner#formatPath`? Right now it says "we currently only support local python files", which is apparently not

[GitHub] spark issue #15137: [SPARK-17512][Core] Avoid formatting to python path for ...

2016-09-21 Thread andrewor14
Github user andrewor14 commented on the issue: https://github.com/apache/spark/pull/15137 Good catch. I'm merging this into master, 2.0 and 1.6. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #15137: [SPARK-17512][Core] Avoid formatting to python path for ...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15137 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65557/ Test PASSed. ---

[GitHub] spark issue #15137: [SPARK-17512][Core] Avoid formatting to python path for ...

2016-09-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15137 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15137: [SPARK-17512][Core] Avoid formatting to python path for ...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15137 **[Test build #65557 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65557/consoleFull)** for PR 15137 at commit

[GitHub] spark issue #15137: [SPARK-17512][Core] Avoid formatting to python path for ...

2016-09-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15137 **[Test build #65557 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65557/consoleFull)** for PR 15137 at commit