[ https://issues.apache.org/jira/browse/SPARK-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695273#comment-14695273 ]
Piotr Migdał commented on SPARK-9705: ------------------------------------- I added it as I am having problems with running it on Python 3.4 (and it runs smoothly on 2.7). So I was not sure whether it's a problem with my installation/configuration or it isn't supported. ("Exception: Python in worker has different version 2.7 than that in driver 3.4, PySpark cannot run with different minor versions") I was told by Josh Rosen that 3.4 is supported. However, it makes to sense for me to write docs if I cannot run it on mine computer (maybe there are some options needed?). The error is the same no matter if I run it from command line (specifying paths to Python 3 libraries) or through a preferred option for me - findspark in IPython Notebook. > outdated Python 3 and IPython information > ----------------------------------------- > > Key: SPARK-9705 > URL: https://issues.apache.org/jira/browse/SPARK-9705 > Project: Spark > Issue Type: Documentation > Components: Documentation, PySpark > Affects Versions: 1.4.0, 1.4.1, 1.5.0 > Reporter: Piotr Migdał > Priority: Blocker > Labels: documentation > Original Estimate: 0.25h > Remaining Estimate: 0.25h > > https://issues.apache.org/jira/browse/SPARK-4897 adds Python 3.4 support to > 1.4.0 and above, but the official docs (1.4.1, but the same is for 1.4.0) > says explicitly: > "Spark 1.4.1 works with Python 2.6 or higher (but not Python 3)." > Affected: > https://spark.apache.org/docs/1.4.0/programming-guide.html > https://spark.apache.org/docs/1.4.1/programming-guide.html > There are some other Python-related things, which are outdated, e.g. this > line: > "For example, to launch the IPython Notebook with PyLab plot support:" > (At least since IPython 3.0 PyLab/Matplotlib support happens inside a > notebook; and the line "--pylab inline" is already removed.) -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org