[ 
https://issues.apache.org/jira/browse/SPARK-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695273#comment-14695273
 ] 

Piotr Migdał commented on SPARK-9705:
-------------------------------------

I added it as I am having problems with running it on Python 3.4 (and it runs 
smoothly on 2.7). So I was not sure whether it's a problem with my 
installation/configuration or it isn't supported. 

("Exception: Python in worker has different version 2.7 than that in driver 
3.4, PySpark cannot run with different minor versions")

I was told by Josh Rosen that 3.4 is supported. However, it makes to sense for 
me to write docs if I cannot run it on mine computer (maybe there are some 
options needed?). The error is the same no matter if I run it from command line 
(specifying paths to Python 3 libraries) or through a preferred option for me - 
findspark in IPython Notebook.

> outdated Python 3 and IPython information
> -----------------------------------------
>
>                 Key: SPARK-9705
>                 URL: https://issues.apache.org/jira/browse/SPARK-9705
>             Project: Spark
>          Issue Type: Documentation
>          Components: Documentation, PySpark
>    Affects Versions: 1.4.0, 1.4.1, 1.5.0
>            Reporter: Piotr Migdał
>            Priority: Blocker
>              Labels: documentation
>   Original Estimate: 0.25h
>  Remaining Estimate: 0.25h
>
> https://issues.apache.org/jira/browse/SPARK-4897 adds Python 3.4 support to 
> 1.4.0 and above, but the official docs (1.4.1, but the same is for 1.4.0) 
> says explicitly:
> "Spark 1.4.1 works with Python 2.6 or higher (but not Python 3)."
> Affected:
> https://spark.apache.org/docs/1.4.0/programming-guide.html
> https://spark.apache.org/docs/1.4.1/programming-guide.html
> There are some other Python-related things, which are outdated, e.g. this 
> line:
> "For example, to launch the IPython Notebook with PyLab plot support:"
> (At least since IPython 3.0 PyLab/Matplotlib support happens inside a 
> notebook; and the line "--pylab inline" is already removed.)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to