svn commit: r28120 - in /dev/spark/2.3.3-SNAPSHOT-2018_07_14_22_01-f9a2b0a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-07-14 Thread pwendell
Author: pwendell Date: Sun Jul 15 05:15:27 2018 New Revision: 28120 Log: Apache Spark 2.3.3-SNAPSHOT-2018_07_14_22_01-f9a2b0a docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24807][CORE] Adding files/jars twice: output a warning and add a note

2018-07-14 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 3e7dc8296 -> 69993217f [SPARK-24807][CORE] Adding files/jars twice: output a warning and add a note ## What changes were proposed in this pull request? In the PR, I propose to output an warning if the `addFile()` or `addJar()` methods

spark git commit: [SPARK-24776][SQL] Avro unit test: deduplicate code and replace deprecated methods

2018-07-14 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 43e4e851b -> 3e7dc8296 [SPARK-24776][SQL] Avro unit test: deduplicate code and replace deprecated methods ## What changes were proposed in this pull request? Improve Avro unit test: 1. use QueryTest/SharedSQLContext/SQLTestUtils, instead

spark git commit: [SPARK-24718][SQL] Timestamp support pushdown to parquet data source

2018-07-14 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 8aceb961c -> 43e4e851b [SPARK-24718][SQL] Timestamp support pushdown to parquet data source ## What changes were proposed in this pull request? `Timestamp` support pushdown to parquet data source. Only `TIMESTAMP_MICROS` and

svn commit: r28118 - /dev/spark/v2.3.2-rc3-bin/

2018-07-14 Thread jshao
Author: jshao Date: Sun Jul 15 03:04:30 2018 New Revision: 28118 Log: Apache Spark v2.3.2-rc3 Added: dev/spark/v2.3.2-rc3-bin/ dev/spark/v2.3.2-rc3-bin/SparkR_2.3.2.tar.gz (with props) dev/spark/v2.3.2-rc3-bin/SparkR_2.3.2.tar.gz.asc

[1/2] spark git commit: Preparing Spark release v2.3.2-rc3

2018-07-14 Thread jshao
Repository: spark Updated Branches: refs/heads/branch-2.3 9cf375f5b -> f9a2b0a87 Preparing Spark release v2.3.2-rc3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b3726dad Tree:

[2/2] spark git commit: Preparing development version 2.3.3-SNAPSHOT

2018-07-14 Thread jshao
Preparing development version 2.3.3-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f9a2b0a8 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/f9a2b0a8 Diff:

[spark] Git Push Summary

2018-07-14 Thread jshao
Repository: spark Updated Tags: refs/tags/v2.3.2-rc3 [created] b3726dadc - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

svn commit: r28117 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_14_16_01-8aceb96-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-07-14 Thread pwendell
Author: pwendell Date: Sat Jul 14 23:15:42 2018 New Revision: 28117 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_14_16_01-8aceb96 docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24754][ML] Minhash integer overflow

2018-07-14 Thread srowen
Repository: spark Updated Branches: refs/heads/master e1de34113 -> 8aceb961c [SPARK-24754][ML] Minhash integer overflow ## What changes were proposed in this pull request? Use longs in calculating min hash to avoid bias due to int overflow. ## How was this patch tested? Existing tests.

svn commit: r28112 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_14_04_02-e1de341-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-07-14 Thread pwendell
Author: pwendell Date: Sat Jul 14 11:17:47 2018 New Revision: 28112 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_14_04_02-e1de341 docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-17091][SQL] Add rule to convert IN predicate to equivalent Parquet filter

2018-07-14 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master f1a99ad58 -> e1de34113 [SPARK-17091][SQL] Add rule to convert IN predicate to equivalent Parquet filter ## What changes were proposed in this pull request? The original pr is: https://github.com/apache/spark/pull/18424 Add a new