GitHub user zhangchj1990 opened a pull request:
https://github.com/apache/spark/pull/21681
Pin tag 210
## What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
## How was this patch tested?
(Please explain how this patch was tested. E.g. unit tests, integration
tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise,
remove this)
Please review http://spark.apache.org/contributing.html before opening a
pull request.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zhangchj1990/spark pin-tag-210
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21681.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21681
commit 6b6eb4e520d07a27aa68d3450f3c7613b233d928
Author: Zheng RuiFeng
Date: 2016-11-16T10:46:27Z
[SPARK-18434][ML] Add missing ParamValidations for ML algos
## What changes were proposed in this pull request?
Add missing ParamValidations for ML algos
## How was this patch tested?
existing tests
Author: Zheng RuiFeng
Closes #15881 from zhengruifeng/arg_checking.
(cherry picked from commit c68f1a38af67957ee28889667193da8f64bb4342)
Signed-off-by: Yanbo Liang
commit 416bc3dd3db7f7ae2cc7b3ffe395decd0c5b73f9
Author: Zheng RuiFeng
Date: 2016-11-16T10:53:23Z
[SPARK-18446][ML][DOCS] Add links to API docs for ML algos
## What changes were proposed in this pull request?
Add links to API docs for ML algos
## How was this patch tested?
Manual checking for the API links
Author: Zheng RuiFeng
Closes #15890 from zhengruifeng/algo_link.
(cherry picked from commit a75e3fe923372c56bc1b2f4baeaaf5868ad28341)
Signed-off-by: Sean Owen
commit b0ae8712358fc8c07aa5efe4d0bd337e7e452078
Author: Xianyang Liu
Date: 2016-11-16T11:59:00Z
[SPARK-18420][BUILD] Fix the errors caused by lint check in Java
Small fix, fix the errors caused by lint check in Java
- Clear unused objects and `UnusedImports`.
- Add comments around the method `finalize` of
`NioBufferedFileInputStream`to turn off checkstyle.
- Cut the line which is longer than 100 characters into two lines.
Travis CI.
```
$ build/mvn -T 4 -q -DskipTests -Pyarn -Phadoop-2.3 -Pkinesis-asl -Phive
-Phive-thriftserver install
$ dev/lint-java
```
Before:
```
Checkstyle checks failed at following occurrences:
[ERROR]
src/main/java/org/apache/spark/network/util/TransportConf.java:[21,8] (imports)
UnusedImports: Unused import -
org.apache.commons.crypto.cipher.CryptoCipherFactory.
[ERROR]
src/test/java/org/apache/spark/network/sasl/SparkSaslSuite.java:[516,5]
(modifier) RedundantModifier: Redundant 'public' modifier.
[ERROR]
src/main/java/org/apache/spark/io/NioBufferedFileInputStream.java:[133]
(coding) NoFinalizer: Avoid using finalizer method.
[ERROR]
src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeMapData.java:[71]
(sizes) LineLength: Line is longer than 100 characters (found 113).
[ERROR]
src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java:[112]
(sizes) LineLength: Line is longer than 100 characters (found 110).
[ERROR]
src/test/java/org/apache/spark/sql/catalyst/expressions/HiveHasherSuite.java:[31,17]
(modifier) ModifierOrder: 'static' modifier out of order with the JLS
suggestions.
[ERROR]src/main/java/org/apache/spark/examples/ml/JavaLogisticRegressionWithElasticNetExample.java:[64]
(sizes) LineLength: Line is longer than 100 characters (found 103).
[ERROR]
src/main/java/org/apache/spark/examples/ml/JavaInteractionExample.java:[22,8]
(imports) UnusedImports: Unused import - org.apache.spark.ml.linalg.Vectors.
[ERROR]
src/main/java/org/apache/spark/examples/ml/JavaInteractionExample.java:[51]
(regexp) RegexpSingleline: No trailing whitespace allowed.
```
After:
```
$ build/mvn -T 4 -q -DskipTests -Pyarn -Phadoop-2.3 -Pkinesis-asl -Phive
-Phive-thriftserver install
$ dev/lint-java
Using `mvn` from path:
/home/travis/build/ConeyLiu/spark/build/apache-maven-3.3.9/bin/mvn
Checkstyle checks passed.
```
Author: Xianyang Liu
Closes #15865 from ConeyLiu/master.
(cherry picked from commit 7569cf6cb85bda7d0e76d3e75e286d4796e77e08)
Signed-off-by: Sean Owen
commit c0dbe08d604dea543eb17ccb802a8a20d6c21a69
Author: gatorsmile
Date: 2016-11-16T16:25:15Z
[SPARK-18415][SQL] Weird Plan Output when CTE used in RunnableCommand
### What changes were proposed in this pull request?
Currently, when CTE is used in RunnableCommand, the Analyzer does not
replace the logical
