svn commit: r28649 - in /dev/spark/v2.3.2-rc4-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2018-08-09 Thread jshao
Author: jshao Date: Fri Aug 10 05:50:52 2018 New Revision: 28649 Log: Apache Spark v2.3.2-rc4 docs [This commit notification would consist of 1446 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r28648 - in /dev/spark/2.3.3-SNAPSHOT-2018_08_09_22_01-e66f3f9-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-09 Thread pwendell
Author: pwendell Date: Fri Aug 10 05:15:36 2018 New Revision: 28648 Log: Apache Spark 2.3.3-SNAPSHOT-2018_08_09_22_01-e66f3f9 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r28647 - /dev/spark/v2.3.2-rc4-bin/

2018-08-09 Thread jshao
Author: jshao Date: Fri Aug 10 04:58:55 2018 New Revision: 28647 Log: Apache Spark v2.3.2-rc4 Added: dev/spark/v2.3.2-rc4-bin/ dev/spark/v2.3.2-rc4-bin/SparkR_2.3.2.tar.gz (with props) dev/spark/v2.3.2-rc4-bin/SparkR_2.3.2.tar.gz.asc

spark git commit: [SPARK-24855][SQL][EXTERNAL] Built-in AVRO support should support specified schema on write

2018-08-09 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master bdd27961c -> 0cea9e3cd [SPARK-24855][SQL][EXTERNAL] Built-in AVRO support should support specified schema on write ## What changes were proposed in this pull request? Allows `avroSchema` option to be specified on write, allowing a user

svn commit: r28646 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_09_20_02-6c7bb57-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-09 Thread pwendell
Author: pwendell Date: Fri Aug 10 03:15:55 2018 New Revision: 28646 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_09_20_02-6c7bb57 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24251][SQL] Add analysis tests for AppendData.

2018-08-09 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 6c7bb575b -> bdd27961c [SPARK-24251][SQL] Add analysis tests for AppendData. ## What changes were proposed in this pull request? This is a follow-up to #21305 that adds a test suite for AppendData analysis. This also fixes the following

[1/2] spark git commit: Preparing Spark release v2.3.2-rc4

2018-08-09 Thread jshao
Repository: spark Updated Branches: refs/heads/branch-2.3 b426ec583 -> e66f3f9b1 Preparing Spark release v2.3.2-rc4 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/6930f488 Tree:

[spark] Git Push Summary

2018-08-09 Thread jshao
Repository: spark Updated Tags: refs/tags/v2.3.2-rc4 [created] 6930f4885 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 2.3.3-SNAPSHOT

2018-08-09 Thread jshao
Preparing development version 2.3.3-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e66f3f9b Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/e66f3f9b Diff:

svn commit: r28644 - in /dev/spark/2.3.3-SNAPSHOT-2018_08_09_18_02-b426ec5-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-09 Thread pwendell
Author: pwendell Date: Fri Aug 10 01:15:33 2018 New Revision: 28644 Log: Apache Spark 2.3.3-SNAPSHOT-2018_08_09_18_02-b426ec5 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24886][INFRA] Fix the testing script to increase timeout for Jenkins build (from 300m to 340m)

2018-08-09 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 9b8521e53 -> 6c7bb575b [SPARK-24886][INFRA] Fix the testing script to increase timeout for Jenkins build (from 300m to 340m) ## What changes were proposed in this pull request? Currently, looks we hit the time limit time to time. Looks

svn commit: r28641 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_09_16_02-9b8521e-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-09 Thread pwendell
Author: pwendell Date: Thu Aug 9 23:16:16 2018 New Revision: 28641 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_09_16_02-9b8521e docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24950][SQL] DateTimeUtilsSuite daysToMillis and millisToDays fails w/java 8 181-b13

2018-08-09 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 b2e0f68f6 -> 42229430f [SPARK-24950][SQL] DateTimeUtilsSuite daysToMillis and millisToDays fails w/java 8 181-b13 - Update DateTimeUtilsSuite so that when testing roundtripping in daysToMillis and millisToDays multiple skipdates can

spark git commit: [SPARK-24950][SQL] DateTimeUtilsSuite daysToMillis and millisToDays fails w/java 8 181-b13

2018-08-09 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.3 9bfc55b1b -> b426ec583 [SPARK-24950][SQL] DateTimeUtilsSuite daysToMillis and millisToDays fails w/java 8 181-b13 ## What changes were proposed in this pull request? - Update DateTimeUtilsSuite so that when testing roundtripping in

spark git commit: [SPARK-24950][SQL] DateTimeUtilsSuite daysToMillis and millisToDays fails w/java 8 181-b13

2018-08-09 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 53ac8504b -> b283c1f05 [SPARK-24950][SQL] DateTimeUtilsSuite daysToMillis and millisToDays fails w/java 8 181-b13 ## What changes were proposed in this pull request? - Update DateTimeUtilsSuite so that when testing roundtripping in

spark git commit: [SPARK-25068][SQL] Add exists function.

2018-08-09 Thread lixiao
Repository: spark Updated Branches: refs/heads/master fec67ed7e -> 9b8521e53 [SPARK-25068][SQL] Add exists function. ## What changes were proposed in this pull request? This pr adds `exists` function which tests whether a predicate holds for one or more elements in the array. ```sql >

spark git commit: [SPARK-25076][SQL] SQLConf should not be retrieved from a stopped SparkSession

2018-08-09 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 7d465d8f4 -> 9bfc55b1b [SPARK-25076][SQL] SQLConf should not be retrieved from a stopped SparkSession ## What changes were proposed in this pull request? When a `SparkSession` is stopped, `SQLConf.get` should use the fallback conf to

spark git commit: [SPARK-25076][SQL] SQLConf should not be retrieved from a stopped SparkSession

2018-08-09 Thread lixiao
Repository: spark Updated Branches: refs/heads/master bd6db1505 -> fec67ed7e [SPARK-25076][SQL] SQLConf should not be retrieved from a stopped SparkSession ## What changes were proposed in this pull request? When a `SparkSession` is stopped, `SQLConf.get` should use the fallback conf to

svn commit: r28640 - in /dev/spark/2.3.3-SNAPSHOT-2018_08_09_14_02-7d465d8-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-09 Thread pwendell
Author: pwendell Date: Thu Aug 9 21:15:35 2018 New Revision: 28640 Log: Apache Spark 2.3.3-SNAPSHOT-2018_08_09_14_02-7d465d8 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25077][SQL] Delete unused variable in WindowExec

2018-08-09 Thread lixiao
Repository: spark Updated Branches: refs/heads/master eb9a696dd -> bd6db1505 [SPARK-25077][SQL] Delete unused variable in WindowExec ## What changes were proposed in this pull request? Just delete the unused variable `inputFields` in WindowExec, avoid making others confused while reading

svn commit: r28638 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_09_12_02-eb9a696-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-09 Thread pwendell
Author: pwendell Date: Thu Aug 9 19:16:15 2018 New Revision: 28638 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_09_12_02-eb9a696 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [MINOR][BUILD] Update Jetty to 9.3.24.v20180605

2018-08-09 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.3 9fb70f458 -> 7d465d8f4 [MINOR][BUILD] Update Jetty to 9.3.24.v20180605 Update Jetty to 9.3.24.v20180605 to pick up security fix Existing tests. Closes #22055 from srowen/Jetty9324. Authored-by: Sean Owen Signed-off-by: Sean Owen

spark git commit: [MINOR][BUILD] Update Jetty to 9.3.24.v20180605

2018-08-09 Thread srowen
Repository: spark Updated Branches: refs/heads/master d36539741 -> eb9a696dd [MINOR][BUILD] Update Jetty to 9.3.24.v20180605 ## What changes were proposed in this pull request? Update Jetty to 9.3.24.v20180605 to pick up security fix ## How was this patch tested? Existing tests. Closes

spark git commit: [SPARK-24626][SQL] Improve location size calculation in Analyze Table command

2018-08-09 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 2949a835f -> d36539741 [SPARK-24626][SQL] Improve location size calculation in Analyze Table command ## What changes were proposed in this pull request? Currently, Analyze table calculates table size sequentially for each partition. We

svn commit: r28636 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_09_08_02-1a7e747-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-09 Thread pwendell
Author: pwendell Date: Thu Aug 9 15:16:22 2018 New Revision: 28636 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_09_08_02-1a7e747 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25063][SQL] Rename class KnowNotNull to KnownNotNull

2018-08-09 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 1a7e747ce -> 2949a835f [SPARK-25063][SQL] Rename class KnowNotNull to KnownNotNull ## What changes were proposed in this pull request? Correct the class name typo checked in through SPARK-24891 ## How was this patch tested? Passed all

spark git commit: [SPARK-25047][ML] Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel

2018-08-09 Thread srowen
Repository: spark Updated Branches: refs/heads/master b2950cef3 -> 1a7e747ce [SPARK-25047][ML] Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel ## What changes were proposed in this pull request? Convert two function fields in ML

spark git commit: Revert "[SPARK-24648][SQL] SqlMetrics should be threadsafe"

2018-08-09 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 386fbd3af -> b2950cef3 Revert "[SPARK-24648][SQL] SqlMetrics should be threadsafe" This reverts commit 5264164a67df498b73facae207eda12ee133be7d. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-23415][SQL][TEST] Make behavior of BufferHolderSparkSubmitSuite correct and stable

2018-08-09 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 56e9e9707 -> 386fbd3af [SPARK-23415][SQL][TEST] Make behavior of BufferHolderSparkSubmitSuite correct and stable ## What changes were proposed in this pull request? This PR addresses two issues in `BufferHolderSparkSubmitSuite`. 1.

spark git commit: [MINOR][DOC] Fix typo

2018-08-09 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 519e03d82 -> 56e9e9707 [MINOR][DOC] Fix typo ## What changes were proposed in this pull request? This PR fixes typo regarding `auxiliary verb + verb[s]`. This is a follow-on of #21956. ## How was this patch tested? N/A Closes #22040

svn commit: r28629 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_09_00_02-519e03d-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-09 Thread pwendell
Author: pwendell Date: Thu Aug 9 07:16:59 2018 New Revision: 28629 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_09_00_02-519e03d docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]