Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
Install Spark I mentioned above.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user jamal119 commented on the issue:
https://github.com/apache/spark/pull/16429
How did you end up solving that problemï¼reinstall the spark ï¼ Which
version did you installï¼Can you offer a final solutionï¼thanks
---
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
This is fixed from Spark 1.6.4, 2.0.3, 2.1.1 and 2.2.0.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user jamal119 commented on the issue:
https://github.com/apache/spark/pull/16429
hi,HyukjinKwon,have you solved your problemï¼my error is exactly the same
as yoursï¼looking forward to your reply.
---
-
To
Github user davies commented on the issue:
https://github.com/apache/spark/pull/16429
lgtm, merging into master and 2.1 branch.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
@davies, Could this be merged by any change maybe?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16429
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16429
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71397/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16429
**[Test build #71397 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71397/testReport)**
for PR 16429 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16429
**[Test build #71397 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71397/testReport)**
for PR 16429 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16429
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71396/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16429
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16429
**[Test build #71396 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71396/testReport)**
for PR 16429 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
(I re-ran `./run-tests --python-executables=python3.6` for sure)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
The only added comments are as blow:
```python
# __kwdefaults__ contains the default values of keyword-only arguments
which are
# introduced from Python 3. The possible cases
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16429
**[Test build #71396 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71396/testReport)**
for PR 16429 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
gentle ping
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
gentle ping @joshrosen and @davies
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
@joshrosen and @davies, could you review this if you have some time please?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/16429
Yah I think the third party library is definitly a follow up type task, but
something we should consider after this since we are back porting fixes from
another repo into our own code :)
---
If
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
BTW, this at least makes Spark on working state in Python 3.6.0 with a
minimised changes.
---
If your project is set up for it, you can reply to this email and have your
reply appear on
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
@holdenk, Yup. (actually, it is cloudpipe/cloudpickle@cbd3f34 because there
were more minor fixes). It seems there are several customized codes such as
injecting `numpy` as below:
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/16429
(We might want to consider using cloudpickle as a library since others are
working on maintaining it and they had a fix for 3.6 support back in early
November, but that would involve adding another
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/16429
Am I correct in assuming this is based on
https://github.com/cloudpipe/cloudpickle/commit/4945361c2db92095f934b92a6c00316243caf3cc
?
---
If your project is set up for it, you can reply to this
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
ping @joshrosen and @davies
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user azmras commented on the issue:
https://github.com/apache/spark/pull/16429
@cxww107
Try to update both patched files in the following locations
/usr/local/Cellar/apache-spark/2.1.0/libexec/python/pyspark
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
Could you maybe check if this patch is applied properly? That error is
exactly what this PR fixes and it seems the line number in the errors is not
matched to the one in this PR.
---
If your
Github user cxww107 commented on the issue:
https://github.com/apache/spark/pull/16429
After I applied your patch I get this error:
```
Traceback (most recent call last):
File
"/usr/local/Cellar/apache-spark/2.1.0/libexec/python/pyspark/cloudpickle.py",
line 107,
Github user azmras commented on the issue:
https://github.com/apache/spark/pull/16429
just checked other things, ml, sql etc... everything is looking fine... I
can safely say goodbye to python 3.5 now...
Thank you.
---
If your project is set up for it, you can reply to
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
@azmras Thank you for confirming this.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user azmras commented on the issue:
https://github.com/apache/spark/pull/16429
Python 3.6.0 (default, Dec 24 2016, 08:01:42)
[GCC 4.2.1 Compatible Apple LLVM 8.0.0 (clang-800.0.42.1)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
@azmras Could you maybe double check? It works okay in my local as below:
```
Welcome to
__
/ __/__ ___ _/ /__
_\ \/ _ \/ _ `/ __/
Github user azmras commented on the issue:
https://github.com/apache/spark/pull/16429
Thanks.. it worked...
while you are at it...
sc.parallelize(range(1000), 20).take(5)
is problemetic..
Will be thankful if you can look into it..
---
If your project is set up
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16429
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70812/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16429
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16429
**[Test build #70812 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70812/testReport)**
for PR 16429 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16429
**[Test build #70812 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70812/testReport)**
for PR 16429 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
Hi @azmras, now it should work fine for your case as well.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
Hi @joshrosen and @davies, do you think that should be ported in this PR? I
am worried of making this PR harder by porting it here.
---
If your project is set up for it, you can reply to this
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
Thanks for your interests @azmras. I just checked it as below:
```python
sc.parallelize(range(100), 8)
```
```
Traceback (most recent call last):
File
Github user azmras commented on the issue:
https://github.com/apache/spark/pull/16429
after applying patch can you try to run
sc.parallelize(range(100), 8)
and confirm that it is working, because for me it is not...
and serialisation of objects goes crazy..
had
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
gentle ping..
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16429
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70705/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16429
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
45 matches
Mail list logo
