svn commit: r26415 - in /dev/spark/2.3.1-SNAPSHOT-2018_04_18_22_01-32bec6c-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-18 Thread pwendell
Author: pwendell Date: Thu Apr 19 05:17:07 2018 New Revision: 26415 Log: Apache Spark 2.3.1-SNAPSHOT-2018_04_18_22_01-32bec6c docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r26412 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_18_20_01-d5bec48-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-18 Thread pwendell
Author: pwendell Date: Thu Apr 19 03:16:17 2018 New Revision: 26412 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_18_20_01-d5bec48 docs [This commit notification would consist of 1457 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-23919][SQL] Add array_position function

2018-04-18 Thread ueshin
Repository: spark Updated Branches: refs/heads/master 8bb0df2c6 -> d5bec48b9 [SPARK-23919][SQL] Add array_position function ## What changes were proposed in this pull request? The PR adds the SQL function `array_position`. The behavior of the function is based on Presto's one. The function

spark git commit: [SPARK-24014][PYSPARK] Add onStreamingStarted method to StreamingListener

2018-04-18 Thread jshao
Repository: spark Updated Branches: refs/heads/master 0c94e48bc -> 8bb0df2c6 [SPARK-24014][PYSPARK] Add onStreamingStarted method to StreamingListener ## What changes were proposed in this pull request? The `StreamingListener` in PySpark side seems to be lack of `onStreamingStarted` method.

spark git commit: [SPARK-24014][PYSPARK] Add onStreamingStarted method to StreamingListener

2018-04-18 Thread jshao
Repository: spark Updated Branches: refs/heads/branch-2.3 130641102 -> 32bec6ca3 [SPARK-24014][PYSPARK] Add onStreamingStarted method to StreamingListener ## What changes were proposed in this pull request? The `StreamingListener` in PySpark side seems to be lack of `onStreamingStarted` meth

spark git commit: [SPARK-23775][TEST] Make DataFrameRangeSuite not flaky

2018-04-18 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.3 5bcb7bdcc -> 130641102 [SPARK-23775][TEST] Make DataFrameRangeSuite not flaky ## What changes were proposed in this pull request? DataFrameRangeSuite.test("Cancelling stage in a query with Range.") stays sometimes in an infinite loop

spark git commit: [SPARK-23775][TEST] Make DataFrameRangeSuite not flaky

2018-04-18 Thread vanzin
Repository: spark Updated Branches: refs/heads/master a9066478f -> 0c94e48bc [SPARK-23775][TEST] Make DataFrameRangeSuite not flaky ## What changes were proposed in this pull request? DataFrameRangeSuite.test("Cancelling stage in a query with Range.") stays sometimes in an infinite loop and

svn commit: r26405 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_18_16_01-a906647-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-18 Thread pwendell
Author: pwendell Date: Wed Apr 18 23:16:22 2018 New Revision: 26405 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_18_16_01-a906647 docs [This commit notification would consist of 1457 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-23875][SQL][FOLLOWUP] Add IndexedSeq wrapper for ArrayData

2018-04-18 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master f09a9e941 -> a9066478f [SPARK-23875][SQL][FOLLOWUP] Add IndexedSeq wrapper for ArrayData ## What changes were proposed in this pull request? Use specified accessor in `ArrayData.foreach` and `toArray`. ## How was this patch tested? Exist

svn commit: r26402 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_18_12_02-f09a9e9-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-18 Thread pwendell
Author: pwendell Date: Wed Apr 18 19:16:09 2018 New Revision: 26402 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_18_12_02-f09a9e9 docs [This commit notification would consist of 1457 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r26400 - in /dev/spark/2.3.1-SNAPSHOT-2018_04_18_10_01-5bcb7bd-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-18 Thread pwendell
Author: pwendell Date: Wed Apr 18 17:16:04 2018 New Revision: 26400 Log: Apache Spark 2.3.1-SNAPSHOT-2018_04_18_10_01-5bcb7bd docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-23963][SQL] Properly handle large number of columns in query on text-based Hive table

2018-04-18 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 a902323fb -> 041aec4e1 [SPARK-23963][SQL] Properly handle large number of columns in query on text-based Hive table ## What changes were proposed in this pull request? TableReader would get disproportionately slower as the number of c

spark git commit: [SPARK-23963][SQL] Properly handle large number of columns in query on text-based Hive table

2018-04-18 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 a1c56b669 -> 5bcb7bdcc [SPARK-23963][SQL] Properly handle large number of columns in query on text-based Hive table ## What changes were proposed in this pull request? TableReader would get disproportionately slower as the number of c

spark git commit: [SPARK-24007][SQL] EqualNullSafe for FloatType and DoubleType might generate a wrong result by codegen.

2018-04-18 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 e957c4e88 -> a902323fb [SPARK-24007][SQL] EqualNullSafe for FloatType and DoubleType might generate a wrong result by codegen. `EqualNullSafe` for `FloatType` and `DoubleType` might generate a wrong result by codegen. ```scala scala>

spark git commit: [SPARK-24007][SQL] EqualNullSafe for FloatType and DoubleType might generate a wrong result by codegen.

2018-04-18 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 6b99d5bc3 -> a1c56b669 [SPARK-24007][SQL] EqualNullSafe for FloatType and DoubleType might generate a wrong result by codegen. ## What changes were proposed in this pull request? `EqualNullSafe` for `FloatType` and `DoubleType` might

spark git commit: [SPARK-24007][SQL] EqualNullSafe for FloatType and DoubleType might generate a wrong result by codegen.

2018-04-18 Thread lixiao
Repository: spark Updated Branches: refs/heads/master f81fa478f -> f09a9e941 [SPARK-24007][SQL] EqualNullSafe for FloatType and DoubleType might generate a wrong result by codegen. ## What changes were proposed in this pull request? `EqualNullSafe` for `FloatType` and `DoubleType` might gene

svn commit: r26391 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_18_04_03-f81fa47-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-18 Thread pwendell
Author: pwendell Date: Wed Apr 18 11:22:58 2018 New Revision: 26391 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_18_04_03-f81fa47 docs [This commit notification would consist of 1457 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-23926][SQL] Extending reverse function to support ArrayType arguments

2018-04-18 Thread ueshin
Repository: spark Updated Branches: refs/heads/master cce469435 -> f81fa478f [SPARK-23926][SQL] Extending reverse function to support ArrayType arguments ## What changes were proposed in this pull request? This PR extends `reverse` functions to be able to operate over array columns and cover

svn commit: r26387 - in /dev/spark/2.4.0-SNAPSHOT-2018_04_18_00_01-cce4694-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-04-18 Thread pwendell
Author: pwendell Date: Wed Apr 18 07:17:58 2018 New Revision: 26387 Log: Apache Spark 2.4.0-SNAPSHOT-2018_04_18_00_01-cce4694 docs [This commit notification would consist of 1457 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---