spark git commit: [SPARK-11895][ML] rename and refactor DatasetExample under mllib/examples

2015-11-22 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.6 fc4b88f3b -> a36d9bc75 [SPARK-11895][ML] rename and refactor DatasetExample under mllib/examples We used the name `Dataset` to refer to `SchemaRDD` in 1.2 in ML pipelines and created this example file. Since `Dataset` has a new

spark git commit: [SPARK-11902][ML] Unhandled case in VectorAssembler#transform

2015-11-22 Thread meng
Repository: spark Updated Branches: refs/heads/master d9cf9c21f -> 4be360d4e [SPARK-11902][ML] Unhandled case in VectorAssembler#transform There is an unhandled case in the transform method of VectorAssembler if one of the input columns doesn't have one of the supported type DoubleType,

spark git commit: [SPARK-11835] Adds a sidebar menu to MLlib's documentation

2015-11-22 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.6 835b5488f -> 7f9d3358a [SPARK-11835] Adds a sidebar menu to MLlib's documentation This PR adds a sidebar menu when browsing the user guide of MLlib. It uses a YAML file to describe the structure of the documentation. It should be

spark git commit: [SPARK-11835] Adds a sidebar menu to MLlib's documentation

2015-11-22 Thread meng
Repository: spark Updated Branches: refs/heads/master a6fda0bfc -> fc4b792d2 [SPARK-11835] Adds a sidebar menu to MLlib's documentation This PR adds a sidebar menu when browsing the user guide of MLlib. It uses a YAML file to describe the structure of the documentation. It should be trivial

spark git commit: [SPARK-11912][ML] ml.feature.PCA minor refactor

2015-11-22 Thread meng
Repository: spark Updated Branches: refs/heads/master fc4b792d2 -> d9cf9c21f [SPARK-11912][ML] ml.feature.PCA minor refactor Like [SPARK-11852](https://issues.apache.org/jira/browse/SPARK-11852), ```k``` is params and we should save it under ```metadata/``` rather than both under

spark git commit: [SPARK-11912][ML] ml.feature.PCA minor refactor

2015-11-22 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.6 7f9d3358a -> d482dced3 [SPARK-11912][ML] ml.feature.PCA minor refactor Like [SPARK-11852](https://issues.apache.org/jira/browse/SPARK-11852), ```k``` is params and we should save it under ```metadata/``` rather than both under

spark git commit: [SPARK-6791][ML] Add read/write for CrossValidator and Evaluators

2015-11-22 Thread meng
Repository: spark Updated Branches: refs/heads/master fe89c1817 -> a6fda0bfc [SPARK-6791][ML] Add read/write for CrossValidator and Evaluators I believe this works for general estimators within CrossValidator, including compound estimators. (See the complex unit test.) Added read/write for

Git Push Summary

2015-11-22 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.6.0-preview2 [created] 308381420 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 1.6.0-SNAPSHOT

2015-11-22 Thread pwendell
Preparing development version 1.6.0-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/fc4b88f3 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/fc4b88f3 Diff:

[1/2] spark git commit: Preparing Spark release v1.6.0-preview2

2015-11-22 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.6 9d10ba76f -> fc4b88f3b Preparing Spark release v1.6.0-preview2 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/30838142 Tree:

spark git commit: [SPARK-11908][SQL] Add NullType support to RowEncoder

2015-11-22 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.6 8c718a577 -> b004a104f [SPARK-11908][SQL] Add NullType support to RowEncoder JIRA: https://issues.apache.org/jira/browse/SPARK-11908 We should add NullType support to RowEncoder. Author: Liang-Chi Hsieh Closes

[1/2] spark git commit: Preparing Spark release v1.6.0-preview1

2015-11-22 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.6 b004a104f -> 9d10ba76f Preparing Spark release v1.6.0-preview1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f8369412 Tree:

[2/2] spark git commit: Preparing development version 1.6.0-SNAPSHOT

2015-11-22 Thread pwendell
Preparing development version 1.6.0-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/9d10ba76 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/9d10ba76 Diff: