[35/50] [abbrv] incubator-livy git commit: LIVY-323. Fixed livy-repl doesn't start with a lot of spark packages. (#312)

2017-06-27 Thread jshao
LIVY-323. Fixed livy-repl doesn't start with a lot of spark packages. (#312) Some Spark packages are depending on scala-reflect 2.11.0 and it conflicts with Spark's scala version 2.11.8. This's not Livy's fault actually but doesn't hurt to make Livy more fault tolerant. Since the scala-reflect

[33/50] [abbrv] incubator-livy git commit: LIVY-313. Fixed SparkRInterpreter always returning success. (#307)

2017-06-27 Thread jshao
LIVY-313. Fixed SparkRInterpreter always returning success. (#307) * LIVY-313. Fixed SparkRInterpreter always returning success. - Stopped redirecting stderr to stdout. - Continue to read ErrorStream (it was only being read once). - Checking for any errors returned by stderr before returning

[11/50] [abbrv] incubator-livy git commit: LIVY-308. Avoid enabling Hive by default in Spark2. (#287)

2017-06-27 Thread jshao
LIVY-308. Avoid enabling Hive by default in Spark2. (#287) Fixed broken integration test on Spark 2.1. Project: http://git-wip-us.apache.org/repos/asf/incubator-livy/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-livy/commit/663c6130 Tree:

[12/50] [abbrv] incubator-livy git commit: LIVY-274. Add travis CI status in README (#288)

2017-06-27 Thread jshao
LIVY-274. Add travis CI status in README (#288) Project: http://git-wip-us.apache.org/repos/asf/incubator-livy/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-livy/commit/a36e44f4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-livy/tree/a36e44f4 Diff:

[02/50] [abbrv] incubator-livy git commit: Update the docs related Livy build and Spark 2 support

2017-06-27 Thread jshao
Update the docs related Livy build and Spark 2 support Change-Id: Id59c628e73da46a124f718b192fc92336ac8eace Project: http://git-wip-us.apache.org/repos/asf/incubator-livy/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-livy/commit/97251bdc Tree:

[09/50] [abbrv] incubator-livy git commit: Bump the version of branch-0.3 to 0.3.1-SNAPSHOT. (#281)

2017-06-27 Thread jshao
Bump the version of branch-0.3 to 0.3.1-SNAPSHOT. (#281) Project: http://git-wip-us.apache.org/repos/asf/incubator-livy/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-livy/commit/0afee230 Tree: http://git-wip-us.apache.org/repos/asf/incubator-livy/tree/0afee230 Diff:

MLLib Sparse Input

2014-01-31 Thread jshao
Hi, Spark is absolutely amazing for machine learning as its iterative process is super fast. However one big issue that I realized was that the MLLib API isn't suitable for sparse inputs at all because it requires the feature vector to be a dense array. For example, I currently want to run a

<    1   2   3   4   5