[ https://issues.apache.org/jira/browse/PIO-116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156537#comment-16156537 ]
ASF GitHub Bot commented on PIO-116: ------------------------------------ Github user dszeto commented on the issue: https://github.com/apache/incubator-predictionio/pull/427 @marevol Looks like Python 3 is also a hard requirement? This does not work when I run `pyspark` with Python 2. > PySpark Support > --------------- > > Key: PIO-116 > URL: https://issues.apache.org/jira/browse/PIO-116 > Project: PredictionIO > Issue Type: New Feature > Components: Core > Reporter: Shinsuke Sugaya > Assignee: Shinsuke Sugaya > > This provides PySpark support with minimum PIO changes. > 1. Support pyspark on pio-shell > 2. Add python files to use pyspark > 3. Add --main-py-file option to "pio train" to submit .py file to spark > Note that this provides only fixes for Spark 2.x. > (because this fixes expect to use SparkML) > Sample project is: > https://github.com/jpioug/predictionio-template-iris > (For prediction API, Scala code is used.) -- This message was sent by Atlassian JIRA (v6.4.14#64029)