spark git commit: [SPARK-21108][ML] convert LinearSVC to aggregator framework

2017-08-24 Thread yliang
Repository: spark Updated Branches: refs/heads/master 05af2de0f -> f3676d639 [SPARK-21108][ML] convert LinearSVC to aggregator framework ## What changes were proposed in this pull request? convert LinearSVC to new aggregator framework ## How was this patch tested? existing unit test.

spark git commit: [SPARK-21830][SQL] Bump ANTLR version and fix a few issues.

2017-08-24 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 763b83ee8 -> 05af2de0f [SPARK-21830][SQL] Bump ANTLR version and fix a few issues. ## What changes were proposed in this pull request? This PR bumps the ANTLR version to 4.7, and fixes a number of small parser related issues uncovered by

spark git commit: [SPARK-21701][CORE] Enable RPC client to use ` SO_RCVBUF` and ` SO_SNDBUF` in SparkConf.

2017-08-24 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master d3abb3699 -> 763b83ee8 [SPARK-21701][CORE] Enable RPC client to use ` SO_RCVBUF` and ` SO_SNDBUF` in SparkConf. ## What changes were proposed in this pull request? TCP parameters like SO_RCVBUF and SO_SNDBUF can be set in SparkConf, and

spark git commit: [SPARK-21826][SQL][2.1][2.0] outer broadcast hash join should not throw NPE

2017-08-24 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.0 9f670ce5d -> bf1f30d7d [SPARK-21826][SQL][2.1][2.0] outer broadcast hash join should not throw NPE backport https://github.com/apache/spark/pull/19036 to branch 2.1 and 2.0 Author: Wenchen Fan Closes #19040

spark git commit: [SPARK-21826][SQL][2.1][2.0] outer broadcast hash join should not throw NPE

2017-08-24 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.1 3d3be4dca -> 576975356 [SPARK-21826][SQL][2.1][2.0] outer broadcast hash join should not throw NPE backport https://github.com/apache/spark/pull/19036 to branch 2.1 and 2.0 Author: Wenchen Fan Closes #19040

spark git commit: [SPARK-21788][SS] Handle more exceptions when stopping a streaming query

2017-08-24 Thread tdas
Repository: spark Updated Branches: refs/heads/master 2dd37d827 -> d3abb3699 [SPARK-21788][SS] Handle more exceptions when stopping a streaming query ## What changes were proposed in this pull request? Add more cases we should view as a normal query stop rather than a failure. ## How was

spark git commit: [SPARK-21681][ML] fix bug of MLOR do not work correctly when featureStd contains zero (backport PR for 2.2)

2017-08-24 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-2.2 a58536741 -> 2b4bd7910 [SPARK-21681][ML] fix bug of MLOR do not work correctly when featureStd contains zero (backport PR for 2.2) ## What changes were proposed in this pull request? This is backport PR of

spark-website git commit: Remove old sentence about 4-month minor releases

2017-08-24 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 1a2e57670 -> cca972e7f Remove old sentence about 4-month minor releases Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/cca972e7 Tree:

spark git commit: [SPARK-21826][SQL] outer broadcast hash join should not throw NPE

2017-08-24 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.2 236b2f4d5 -> a58536741 [SPARK-21826][SQL] outer broadcast hash join should not throw NPE This is a bug introduced by https://github.com/apache/spark/pull/11274/files#diff-7adb688cbfa583b5711801f196a074bbL274 . Non-equal join

spark git commit: [SPARK-21826][SQL] outer broadcast hash join should not throw NPE

2017-08-24 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 183d4cb71 -> 2dd37d827 [SPARK-21826][SQL] outer broadcast hash join should not throw NPE ## What changes were proposed in this pull request? This is a bug introduced by

spark git commit: [SPARK-21759][SQL] In.checkInputDataTypes should not wrongly report unresolved plans for IN correlated subquery

2017-08-24 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 9e33954dd -> 183d4cb71 [SPARK-21759][SQL] In.checkInputDataTypes should not wrongly report unresolved plans for IN correlated subquery ## What changes were proposed in this pull request? With the check for structural integrity proposed

[1/2] spark git commit: [SPARK-21745][SQL] Refactor ColumnVector hierarchy to make ColumnVector read-only and to introduce WritableColumnVector.

2017-08-24 Thread wenchen
Repository: spark Updated Branches: refs/heads/master dc5d34d8d -> 9e33954dd http://git-wip-us.apache.org/repos/asf/spark/blob/9e33954d/sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/WritableColumnVector.java

[2/2] spark git commit: [SPARK-21745][SQL] Refactor ColumnVector hierarchy to make ColumnVector read-only and to introduce WritableColumnVector.

2017-08-24 Thread wenchen
[SPARK-21745][SQL] Refactor ColumnVector hierarchy to make ColumnVector read-only and to introduce WritableColumnVector. ## What changes were proposed in this pull request? This is a refactoring of `ColumnVector` hierarchy and related classes. 1. make `ColumnVector` read-only 2. introduce

spark git commit: [SPARK-19165][PYTHON][SQL] PySpark APIs using columns as arguments should validate input types for column

2017-08-24 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 95713eb4f -> dc5d34d8d [SPARK-19165][PYTHON][SQL] PySpark APIs using columns as arguments should validate input types for column ## What changes were proposed in this pull request? While preparing to take over

spark git commit: [SPARK-21804][SQL] json_tuple returns null values within repeated columns except the first one

2017-08-24 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 846bc61cf -> 95713eb4f [SPARK-21804][SQL] json_tuple returns null values within repeated columns except the first one ## What changes were proposed in this pull request? When json_tuple in extracting values from JSON it returns null

spark git commit: [MINOR][SQL] The comment of Class ExchangeCoordinator exist a typing and context error

2017-08-24 Thread srowen
Repository: spark Updated Branches: refs/heads/master ce0d3bb37 -> 846bc61cf [MINOR][SQL] The comment of Class ExchangeCoordinator exist a typing and context error ## What changes were proposed in this pull request? The given example in the comment of Class ExchangeCoordinator is exist four

spark git commit: [SPARK-21694][MESOS] Support Mesos CNI network labels

2017-08-24 Thread srowen
Repository: spark Updated Branches: refs/heads/master 43cbfad99 -> ce0d3bb37 [SPARK-21694][MESOS] Support Mesos CNI network labels JIRA ticket: https://issues.apache.org/jira/browse/SPARK-21694 ## What changes were proposed in this pull request? Spark already supports launching containers