svn commit: r27784 - in /dev/spark/2.3.2-SNAPSHOT-2018_06_27_22_01-0f534d3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-27 Thread pwendell
Author: pwendell Date: Thu Jun 28 05:16:02 2018 New Revision: 27784 Log: Apache Spark 2.3.2-SNAPSHOT-2018_06_27_22_01-0f534d3 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r27783 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_27_20_01-6a97e8e-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-27 Thread pwendell
Author: pwendell Date: Thu Jun 28 03:15:54 2018 New Revision: 27783 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_27_20_01-6a97e8e docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24603][SQL] Fix findTightestCommonType reference in comments

2018-06-27 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 6e1f5e018 -> 0f534d3da [SPARK-24603][SQL] Fix findTightestCommonType reference in comments findTightestCommonTypeOfTwo has been renamed to findTightestCommonType ## What changes were proposed in this pull request? (Please fill in

spark git commit: [SPARK-24603][SQL] Fix findTightestCommonType reference in comments

2018-06-27 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.2 47958270f -> a8537a5ab [SPARK-24603][SQL] Fix findTightestCommonType reference in comments findTightestCommonTypeOfTwo has been renamed to findTightestCommonType ## What changes were proposed in this pull request? (Please fill in

spark git commit: [SPARK-24603][SQL] Fix findTightestCommonType reference in comments

2018-06-27 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 1c9acc243 -> 6a97e8eb3 [SPARK-24603][SQL] Fix findTightestCommonType reference in comments findTightestCommonTypeOfTwo has been renamed to findTightestCommonType ## What changes were proposed in this pull request? (Please fill in changes

spark git commit: [SPARK-24206][SQL][FOLLOW-UP] Update DataSourceReadBenchmark benchmark results

2018-06-27 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master bd32b509a -> 1c9acc243 [SPARK-24206][SQL][FOLLOW-UP] Update DataSourceReadBenchmark benchmark results ## What changes were proposed in this pull request? This pr corrected the default configuration (`spark.master=local[1]`) for

spark git commit: [SPARK-24645][SQL] Skip parsing when csvColumnPruning enabled and partitions scanned only

2018-06-27 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master c5aa54d54 -> bd32b509a [SPARK-24645][SQL] Skip parsing when csvColumnPruning enabled and partitions scanned only ## What changes were proposed in this pull request? In the master, when `csvColumnPruning`(implemented in [this

svn commit: r27779 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_27_16_01-c5aa54d-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-27 Thread pwendell
Author: pwendell Date: Wed Jun 27 23:15:46 2018 New Revision: 27779 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_27_16_01-c5aa54d docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24553][WEB-UI] http 302 fixes for href redirect

2018-06-27 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 893ea224c -> c5aa54d54 [SPARK-24553][WEB-UI] http 302 fixes for href redirect ## What changes were proposed in this pull request? Updated URL/href links to include a '/' before '?id' to make links consistent and avoid http 302 redirect

spark git commit: [SPARK-24204][SQL] Verify a schema in Json/Orc/ParquetFileFormat

2018-06-27 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 221d03acc -> 893ea224c [SPARK-24204][SQL] Verify a schema in Json/Orc/ParquetFileFormat ## What changes were proposed in this pull request? This pr added code to verify a schema in Json/Orc/ParquetFileFormat along with CSVFileFormat. ##

spark git commit: [SPARK-24533] Typesafe rebranded to lightbend. Changing the build downloads path

2018-06-27 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 776befbfd -> 221d03acc [SPARK-24533] Typesafe rebranded to lightbend. Changing the build downloads path Typesafe has rebranded to lightbend. Just changing the downloads path to avoid redirection Tested by running build/mvn -DskipTests

spark git commit: [SPARK-24660][SHS] Show correct error pages when downloading logs

2018-06-27 Thread vanzin
Repository: spark Updated Branches: refs/heads/master c04cb2d1b -> 776befbfd [SPARK-24660][SHS] Show correct error pages when downloading logs ## What changes were proposed in this pull request? SHS is showing bad errors when trying to download logs is not successful. This may happen

svn commit: r27778 - in /dev/spark/2.3.2-SNAPSHOT-2018_06_27_14_01-6e1f5e0-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-27 Thread pwendell
Author: pwendell Date: Wed Jun 27 21:15:23 2018 New Revision: 27778 Log: Apache Spark 2.3.2-SNAPSHOT-2018_06_27_14_01-6e1f5e0 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r27774 - /dev/spark/KEYS

2018-06-27 Thread tgraves
Author: tgraves Date: Wed Jun 27 20:22:34 2018 New Revision: 27774 Log: Update KEYS Modified: dev/spark/KEYS Modified: dev/spark/KEYS == --- dev/spark/KEYS (original) +++ dev/spark/KEYS Wed Jun 27 20:22:34 2018 @@

spark git commit: [SPARK-24613][SQL] Cache with UDF could not be matched with subsequent dependent caches

2018-06-27 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 db538b25a -> 6e1f5e018 [SPARK-24613][SQL] Cache with UDF could not be matched with subsequent dependent caches Wrap the logical plan with a `AnalysisBarrier` for execution plan compilation in CacheManager, in order to avoid the plan

svn commit: r27773 - /release/spark/KEYS

2018-06-27 Thread tgraves
Author: tgraves Date: Wed Jun 27 20:04:43 2018 New Revision: 27773 Log: Update KEYS Modified: release/spark/KEYS Modified: release/spark/KEYS == --- release/spark/KEYS (original) +++ release/spark/KEYS Wed Jun 27

svn commit: r27772 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_27_12_01-c04cb2d-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-27 Thread pwendell
Author: pwendell Date: Wed Jun 27 19:15:40 2018 New Revision: 27772 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_27_12_01-c04cb2d docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-21687][SQL] Spark SQL should set createTime for Hive partition

2018-06-27 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 78ecb6d45 -> c04cb2d1b [SPARK-21687][SQL] Spark SQL should set createTime for Hive partition ## What changes were proposed in this pull request? Set createTime for every hive partition created in Spark SQL, which could be used to manage

spark git commit: [SPARK-24446][YARN] Properly quote library path for YARN.

2018-06-27 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 6a0b77a55 -> 78ecb6d45 [SPARK-24446][YARN] Properly quote library path for YARN. Because the way YARN executes commands via bash -c, everything needs to be quoted so that the whole command is fully contained inside a bash string and is

svn commit: r27769 - in /dev/spark/v2.2.2-rc2-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2018-06-27 Thread tgraves
Author: tgraves Date: Wed Jun 27 17:44:22 2018 New Revision: 27769 Log: Apache Spark v2.2.2-rc2 docs [This commit notification would consist of 1346 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24215][PYSPARK][FOLLOW UP] Implement eager evaluation for DataFrame APIs in PySpark

2018-06-27 Thread lixiao
Repository: spark Updated Branches: refs/heads/master a1a64e358 -> 6a0b77a55 [SPARK-24215][PYSPARK][FOLLOW UP] Implement eager evaluation for DataFrame APIs in PySpark ## What changes were proposed in this pull request? Address comments in #21370 and add more test. ## How was this patch

svn commit: r27768 - /dev/spark/v2.2.2-rc2-bin/

2018-06-27 Thread tgraves
Author: tgraves Date: Wed Jun 27 17:16:26 2018 New Revision: 27768 Log: Apache Spark v2.2.2-rc2 Added: dev/spark/v2.2.2-rc2-bin/ dev/spark/v2.2.2-rc2-bin/SparkR_2.2.2.tar.gz (with props) dev/spark/v2.2.2-rc2-bin/SparkR_2.2.2.tar.gz.asc

[spark] Git Push Summary

2018-06-27 Thread tgraves
Repository: spark Updated Tags: refs/tags/v2.2.2-rc2 [created] fc28ba3db - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 2.2.3-SNAPSHOT

2018-06-27 Thread tgraves
Preparing development version 2.2.3-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/47958270 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/47958270 Diff:

[1/2] spark git commit: Preparing Spark release v2.2.2-rc2

2018-06-27 Thread tgraves
Repository: spark Updated Branches: refs/heads/branch-2.2 72575d0bb -> 47958270f Preparing Spark release v2.2.2-rc2 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/fc28ba3d Tree:

svn commit: r27763 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_27_04_02-a1a64e3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-27 Thread pwendell
Author: pwendell Date: Wed Jun 27 11:21:26 2018 New Revision: 27763 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_27_04_02-a1a64e3 docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-21335][DOC] doc changes for disallowed un-aliased subquery use case

2018-06-27 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 9a76f23c6 -> a1a64e358 [SPARK-21335][DOC] doc changes for disallowed un-aliased subquery use case ## What changes were proposed in this pull request? Document a change for un-aliased subquery use case, to address the last question in PR

svn commit: r27756 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_27_00_01-9a76f23-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-27 Thread pwendell
Author: pwendell Date: Wed Jun 27 07:17:22 2018 New Revision: 27756 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_27_00_01-9a76f23 docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]