spark git commit: [SPARK-16888][SQL] Implements eval method for expression AssertNotNull

2016-08-03 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 780c7224a -> 27e815c31 [SPARK-16888][SQL] Implements eval method for expression AssertNotNull ## What changes were proposed in this pull request? Implements `eval()` method for expression `AssertNotNull` so that we can convert local

spark git commit: [MINOR][SQL] Fix minor formatting issue of SortAggregateExec.toString

2016-08-03 Thread lian
Repository: spark Updated Branches: refs/heads/master 583d91a19 -> 780c7224a [MINOR][SQL] Fix minor formatting issue of SortAggregateExec.toString ## What changes were proposed in this pull request? This PR fixes a minor formatting issue (missing space after comma) of

spark git commit: [SPARK-16873][CORE] Fix SpillReader NPE when spillFile has no data

2016-08-03 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.6 52d8837c6 -> d2518acc1 [SPARK-16873][CORE] Fix SpillReader NPE when spillFile has no data ## What changes were proposed in this pull request? SpillReader NPE when spillFile has no data. See follow logs: 16/07/31 20:54:04 INFO

spark git commit: [SPARK-16873][CORE] Fix SpillReader NPE when spillFile has no data

2016-08-03 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 bb30a3d0f -> 11854e5a1 [SPARK-16873][CORE] Fix SpillReader NPE when spillFile has no data ## What changes were proposed in this pull request? SpillReader NPE when spillFile has no data. See follow logs: 16/07/31 20:54:04 INFO

spark git commit: [SPARK-16873][CORE] Fix SpillReader NPE when spillFile has no data

2016-08-03 Thread rxin
Repository: spark Updated Branches: refs/heads/master c5eb1df72 -> 583d91a19 [SPARK-16873][CORE] Fix SpillReader NPE when spillFile has no data ## What changes were proposed in this pull request? SpillReader NPE when spillFile has no data. See follow logs: 16/07/31 20:54:04 INFO

[1/3] spark-website git commit: Trademarks page and some FAQ cleanup

2016-08-03 Thread matei
Repository: spark-website Updated Branches: refs/heads/asf-site 612383440 -> 9700f2f4a http://git-wip-us.apache.org/repos/asf/spark-website/blob/9700f2f4/site/releases/spark-release-1-2-1.html -- diff --git

[3/3] spark-website git commit: Trademarks page and some FAQ cleanup

2016-08-03 Thread matei
Trademarks page and some FAQ cleanup Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/9700f2f4 Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/9700f2f4 Diff:

[2/3] spark-website git commit: Trademarks page and some FAQ cleanup

2016-08-03 Thread matei
http://git-wip-us.apache.org/repos/asf/spark-website/blob/9700f2f4/site/news/proposals-open-for-spark-summit-east.html -- diff --git a/site/news/proposals-open-for-spark-summit-east.html

spark git commit: [SPARK-16814][SQL] Fix deprecated parquet constructor usage

2016-08-03 Thread srowen
Repository: spark Updated Branches: refs/heads/master 4775eb414 -> c5eb1df72 [SPARK-16814][SQL] Fix deprecated parquet constructor usage ## What changes were proposed in this pull request? Replace deprecated ParquetWriter with the new builders ## How was this patch tested? Existing tests

spark git commit: [SPARK-16770][BUILD] Fix JLine dependency management and version (Sca…

2016-08-03 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 b44da5b4e -> bb30a3d0f [SPARK-16770][BUILD] Fix JLine dependency management and version (Sca… ## What changes were proposed in this pull request? As of Scala 2.11.x there is no longer a org.scala-lang:jline version aligned to the

spark git commit: [SPARK-16770][BUILD] Fix JLine dependency management and version (Sca…

2016-08-03 Thread srowen
Repository: spark Updated Branches: refs/heads/master 685b08e26 -> 4775eb414 [SPARK-16770][BUILD] Fix JLine dependency management and version (Sca… ## What changes were proposed in this pull request? As of Scala 2.11.x there is no longer a org.scala-lang:jline version aligned to the scala

spark git commit: [SPARK-14204][SQL] register driverClass rather than user-specified class

2016-08-03 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 2daab33c4 -> b44da5b4e [SPARK-14204][SQL] register driverClass rather than user-specified class This is a pull request that was originally merged against branch-1.6 as #12000, now being merged into master as well. srowen zzcclp

spark git commit: [SPARK-16596] [SQL] Refactor DataSourceScanExec to do partition discovery at execution instead of planning time

2016-08-03 Thread davies
Repository: spark Updated Branches: refs/heads/master b55f34370 -> e6f226c56 [SPARK-16596] [SQL] Refactor DataSourceScanExec to do partition discovery at execution instead of planning time ## What changes were proposed in this pull request? Partition discovery is rather expensive, so we

spark git commit: [SPARK-16714][SPARK-16735][SPARK-16646] array, map, greatest, least's type coercion should handle decimal type

2016-08-03 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-2.0 969313bb2 -> 2daab33c4 [SPARK-16714][SPARK-16735][SPARK-16646] array, map, greatest, least's type coercion should handle decimal type ## What changes were proposed in this pull request? Here is a table about the behaviours of

spark git commit: [SPARK-16714][SPARK-16735][SPARK-16646] array, map, greatest, least's type coercion should handle decimal type

2016-08-03 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 639df046a -> b55f34370 [SPARK-16714][SPARK-16735][SPARK-16646] array, map, greatest, least's type coercion should handle decimal type ## What changes were proposed in this pull request? Here is a table about the behaviours of

spark git commit: [SPARK-16796][WEB UI] Visible passwords on Spark environment page

2016-08-03 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.6 92ee6fbf5 -> 52d8837c6 [SPARK-16796][WEB UI] Visible passwords on Spark environment page ## What changes were proposed in this pull request? Mask spark.ssl.keyPassword, spark.ssl.keyStorePassword, spark.ssl.trustStorePassword in Web

spark git commit: [SPARK-16796][WEB UI] Visible passwords on Spark environment page

2016-08-03 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 d9d3504b9 -> 969313bb2 [SPARK-16796][WEB UI] Visible passwords on Spark environment page ## What changes were proposed in this pull request? Mask spark.ssl.keyPassword, spark.ssl.keyStorePassword, spark.ssl.trustStorePassword in Web

spark git commit: [SPARK-16831][PYTHON] Fixed bug in CrossValidator.avgMetrics

2016-08-03 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.6 797e758b1 -> 92ee6fbf5 [SPARK-16831][PYTHON] Fixed bug in CrossValidator.avgMetrics avgMetrics was summed, not averaged, across folds Author: =^_^= Closes #14456 from pkch/pkch-patch-1. (cherry picked from

spark git commit: [SPARK-16831][PYTHON] Fixed bug in CrossValidator.avgMetrics

2016-08-03 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 063a507fc -> d9d3504b9 [SPARK-16831][PYTHON] Fixed bug in CrossValidator.avgMetrics ## What changes were proposed in this pull request? avgMetrics was summed, not averaged, across folds Author: =^_^= Closes

spark git commit: [SPARK-16831][PYTHON] Fixed bug in CrossValidator.avgMetrics

2016-08-03 Thread srowen
Repository: spark Updated Branches: refs/heads/master ae226283e -> 639df046a [SPARK-16831][PYTHON] Fixed bug in CrossValidator.avgMetrics ## What changes were proposed in this pull request? avgMetrics was summed, not averaged, across folds Author: =^_^= Closes #14456