spark git commit: [SPARK-25310][SQL] ArraysOverlap may throw a CompilationException

2018-09-03 Thread ueshin
Repository: spark Updated Branches: refs/heads/master b60ee3a33 -> 4cb2ff9d8 [SPARK-25310][SQL] ArraysOverlap may throw a CompilationException ## What changes were proposed in this pull request? This PR fixes a problem that `ArraysOverlap` function throws a `CompilationException` with non-nu

spark git commit: [SPARK-25307][SQL] ArraySort function may return an error in the code generation phase

2018-09-03 Thread ueshin
Repository: spark Updated Branches: refs/heads/master 8e2169696 -> b60ee3a33 [SPARK-25307][SQL] ArraySort function may return an error in the code generation phase ## What changes were proposed in this pull request? Sorting array of booleans (not nullable) returns a compilation error in the

spark git commit: [SPARK-25308][SQL] ArrayContains function may return a error in the code generation phase.

2018-09-03 Thread ueshin
Repository: spark Updated Branches: refs/heads/master 546683c21 -> 8e2169696 [SPARK-25308][SQL] ArrayContains function may return a error in the code generation phase. ## What changes were proposed in this pull request? Invoking ArrayContains function with non nullable array type throws the

svn commit: r29111 - in /dev/spark/2.4.0-SNAPSHOT-2018_09_03_06_39-546683c-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-03 Thread pwendell
Author: pwendell Date: Mon Sep 3 13:53:40 2018 New Revision: 29111 Log: Apache Spark 2.4.0-SNAPSHOT-2018_09_03_06_39-546683c docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-25298][BUILD] Improve build definition for Scala 2.12

2018-09-03 Thread srowen
Repository: spark Updated Branches: refs/heads/master 39d3d6cc9 -> 546683c21 [SPARK-25298][BUILD] Improve build definition for Scala 2.12 ## What changes were proposed in this pull request? Improve build for Scala 2.12. Current build for sbt fails on the subproject `repl`: ``` [info] Compil

spark git commit: [SPARK-25167][SPARKR][TEST][MINOR] Minor fixes for R sql tests (timestamp comparison)

2018-09-03 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 64bbd134e -> 39d3d6cc9 [SPARK-25167][SPARKR][TEST][MINOR] Minor fixes for R sql tests (timestamp comparison) ## What changes were proposed in this pull request? The "date function on DataFrame" test fails consistently on my laptop. In this