GitHub user shimamoto opened a pull request: https://github.com/apache/incubator-predictionio/pull/364
[PIO-30] Spark 2 support on sbt way The goal of this PR is: - Define the versions of Scala to build against in the crossScalaVersions setting - Scala 2.10 and 2.11 - At the project, run `make-distribution.sh`. Then, create all versions gzs - PredictionIO_2.10-0.11.0-$VERSION.tar.gz <- This is intended for Spark 1 users - PredictionIO_2.11-0.11.0-$VERSION.tar.gz <- This is intended for Spark 2 users - SQLContext maintain the status quo - I wish support for Scala 2.10 is deprecated as of next release - Versions of Hadoop are 2.6+, which has something to do with storage hdfs - 2.6 is in lib/spark(default) - 2.7 is in lib/extra @chanlee514 @dszeto I did #345. ## TODO Currently, only the traditional version of the test works. It needs to be added new version (Spark 2) tests. You can merge this pull request into a Git repository by running: $ git pull https://github.com/shimamoto/incubator-predictionio scala211 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-predictionio/pull/364.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #364 ---- commit 432e0b85001bf4cd6f4d09e3a84dc95b2b5c7464 Author: shimamoto <chiboch...@gmail.com> Date: 2017-03-09T12:07:14Z Build against Scala 2.10 and 2.11. commit 8d74bb8cc40619979b7af984ff4918759b6edba1 Author: shimamoto <chiboch...@gmail.com> Date: 2017-03-17T05:50:43Z Merge remote-tracking branch 'upstreamjp/develop' into scala211 commit 6a2dbdf865b271b1db0abf5dcebcdfe372d52b44 Author: shimamoto <chiboch...@gmail.com> Date: 2017-03-17T07:56:03Z fixup ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---