spark git commit: [SPARK-25817][SQL] Dataset encoder should support combination of map and product type

2018-10-27 Thread wenchen
Repository: spark Updated Branches: refs/heads/master e54581134 -> ff4bb836a [SPARK-25817][SQL] Dataset encoder should support combination of map and product type ## What changes were proposed in this pull request? After https://github.com/apache/spark/pull/22745 , Dataset encoder supports

svn commit: r30457 - in /dev/spark/2.4.1-SNAPSHOT-2018_10_27_22_02-0f74bac-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-27 Thread pwendell
Author: pwendell Date: Sun Oct 28 05:16:41 2018 New Revision: 30457 Log: Apache Spark 2.4.1-SNAPSHOT-2018_10_27_22_02-0f74bac docs [This commit notification would consist of 1477 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r30456 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_27_20_02-e545811-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-27 Thread pwendell
Author: pwendell Date: Sun Oct 28 03:17:11 2018 New Revision: 30456 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_27_20_02-e545811 docs [This commit notification would consist of 1472 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24709][SQL][2.4] use str instead of basestring in isinstance

2018-10-27 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.4 f575616db -> 0f74bac64 [SPARK-24709][SQL][2.4] use str instead of basestring in isinstance ## What changes were proposed in this pull request? after backport https://github.com/apache/spark/pull/22775 to 2.4, the 2.4 sbt Jenkins QA

spark git commit: [SPARK-19851][SQL] Add support for EVERY and ANY (SOME) aggregates

2018-10-27 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 41e1416f4 -> e54581134 [SPARK-19851][SQL] Add support for EVERY and ANY (SOME) aggregates ## What changes were proposed in this pull request? Implements Every, Some, Any aggregates in SQL. These new aggregate expressions are analyzed in

svn commit: r30455 - in /dev/spark/2.4.1-SNAPSHOT-2018_10_27_18_02-f575616-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-27 Thread pwendell
Author: pwendell Date: Sun Oct 28 01:16:50 2018 New Revision: 30455 Log: Apache Spark 2.4.1-SNAPSHOT-2018_10_27_18_02-f575616 docs [This commit notification would consist of 1477 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r30453 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_27_16_02-41e1416-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-27 Thread pwendell
Author: pwendell Date: Sat Oct 27 23:16:48 2018 New Revision: 30453 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_27_16_02-41e1416 docs [This commit notification would consist of 1472 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25859][ML] add scala/java/python example and doc for PrefixSpan

2018-10-27 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.4 313a1f0a7 -> f575616db [SPARK-25859][ML] add scala/java/python example and doc for PrefixSpan ## What changes were proposed in this pull request? add scala/java/python example and doc for PrefixSpan in branch 2.4 ## How was this

spark git commit: [SPARK-16693][SPARKR] Remove methods deprecated

2018-10-27 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master d5573c578 -> 41e1416f4 [SPARK-16693][SPARKR] Remove methods deprecated ## What changes were proposed in this pull request? Remove deprecated functions which includes: SQLContext/HiveContext stuff sparkR.init jsonFile parquetFile

svn commit: r30450 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_27_08_02-d5573c5-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-27 Thread pwendell
Author: pwendell Date: Sat Oct 27 15:16:59 2018 New Revision: 30450 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_27_08_02-d5573c5 docs [This commit notification would consist of 1473 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23367][BUILD] Include python document style checking

2018-10-27 Thread srowen
Repository: spark Updated Branches: refs/heads/master 6f05669e4 -> d5573c578 [SPARK-23367][BUILD] Include python document style checking ## What changes were proposed in this pull request? Includes python document style checking. - Use sphinx like check, run only if pydocstyle installed on

spark git commit: [MINOR][DOC] Fix comment error of HiveUtils

2018-10-27 Thread srowen
Repository: spark Updated Branches: refs/heads/master e9b71c8f0 -> 6f05669e4 [MINOR][DOC] Fix comment error of HiveUtils ## What changes were proposed in this pull request? Change the version number in comment of `HiveUtils.newClientForExecution` from `13` to `1.2.1` . ## How was this patch