spark git commit: [SPARK-23389][CORE] When the shuffle dependency specifies aggregation , and `dependency.mapSideCombine =false`, we should be able to use serialized sorting.

2018-02-28 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 25c2776dd -> 22f3d3334 [SPARK-23389][CORE] When the shuffle dependency specifies aggregation ,and `dependency.mapSideCombine =false`, we should be able to use serialized sorting. ## What changes were proposed in this pull request? When

svn commit: r25338 - in /dev/spark/2.4.0-SNAPSHOT-2018_02_28_16_01-25c2776-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-28 Thread pwendell
Author: pwendell Date: Thu Mar 1 00:15:23 2018 New Revision: 25338 Log: Apache Spark 2.4.0-SNAPSHOT-2018_02_28_16_01-25c2776 docs [This commit notification would consist of 1444 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[1/2] spark-website git commit: Apache Spark 2.3.0 Release: Update Site Menu

2018-02-28 Thread sameerag
Repository: spark-website Updated Branches: refs/heads/asf-site d1ea0db8e -> fefc3ba29 http://git-wip-us.apache.org/repos/asf/spark-website/blob/fefc3ba2/site/news/submit-talks-to-spark-summit-eu-2016.html -- diff --git

[2/2] spark-website git commit: Apache Spark 2.3.0 Release: Update Site Menu

2018-02-28 Thread sameerag
Apache Spark 2.3.0 Release: Update Site Menu Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/fefc3ba2 Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/fefc3ba2 Diff:

[1/4] spark-website git commit: Apache Spark 2.3.0 Release: Announcements & Release Notes

2018-02-28 Thread sameerag
Repository: spark-website Updated Branches: refs/heads/asf-site 26c57a24a -> d1ea0db8e http://git-wip-us.apache.org/repos/asf/spark-website/blob/d1ea0db8/site/screencasts/index.html -- diff --git a/site/screencasts/index.html

[2/4] spark-website git commit: Apache Spark 2.3.0 Release: Announcements & Release Notes

2018-02-28 Thread sameerag
http://git-wip-us.apache.org/repos/asf/spark-website/blob/d1ea0db8/site/releases/spark-release-0-7-2.html -- diff --git a/site/releases/spark-release-0-7-2.html b/site/releases/spark-release-0-7-2.html index f35fd59..7e2073d

[4/4] spark-website git commit: Apache Spark 2.3.0 Release: Announcements & Release Notes

2018-02-28 Thread sameerag
Apache Spark 2.3.0 Release: Announcements & Release Notes Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/d1ea0db8 Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/d1ea0db8 Diff:

[3/4] spark-website git commit: Apache Spark 2.3.0 Release: Announcements & Release Notes

2018-02-28 Thread sameerag
http://git-wip-us.apache.org/repos/asf/spark-website/blob/d1ea0db8/site/news/spark-1-2-2-released.html -- diff --git a/site/news/spark-1-2-2-released.html b/site/news/spark-1-2-2-released.html index ef2cd3c..ca320b2 100644 ---

spark git commit: [SPARK-23523][SQL][FOLLOWUP] Minor refactor of OptimizeMetadataOnlyQuery

2018-02-28 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 476a7f026 -> 25c2776dd [SPARK-23523][SQL][FOLLOWUP] Minor refactor of OptimizeMetadataOnlyQuery ## What changes were proposed in this pull request? Inside `OptimizeMetadataOnlyQuery.getPartitionAttrs`, avoid using `zip` to generate

[41/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/R/rbind.html -- diff --git a/site/docs/2.3.0/api/R/rbind.html b/site/docs/2.3.0/api/R/rbind.html new file mode 100644 index 000..114d838

[36/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/R/write.jdbc.html -- diff --git a/site/docs/2.3.0/api/R/write.jdbc.html b/site/docs/2.3.0/api/R/write.jdbc.html new file mode 100644 index

[12/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/api/java/JavaFutureAction.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/api/java/JavaFutureAction.html

[34/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/allclasses-noframe.html -- diff --git a/site/docs/2.3.0/api/java/allclasses-noframe.html

[14/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/TaskKilledException.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/TaskKilledException.html

[13/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/api/java/JavaDoubleRDD.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/api/java/JavaDoubleRDD.html

[47/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/R/attach.html -- diff --git a/site/docs/2.3.0/api/R/attach.html b/site/docs/2.3.0/api/R/attach.html new file mode 100644 index

[35/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/allclasses-frame.html -- diff --git a/site/docs/2.3.0/api/java/allclasses-frame.html b/site/docs/2.3.0/api/java/allclasses-frame.html new

[11/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/api/java/JavaNewHadoopRDD.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/api/java/JavaNewHadoopRDD.html

[45/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/R/cov.html -- diff --git a/site/docs/2.3.0/api/R/cov.html b/site/docs/2.3.0/api/R/cov.html new file mode 100644 index 000..800a7c3 ---

[31/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/index.html -- diff --git a/site/docs/2.3.0/api/java/index.html b/site/docs/2.3.0/api/java/index.html new file mode 100644 index

[25/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/ExceptionFailure.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/ExceptionFailure.html

[03/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/api/java/function/MapGroupsWithStateFunction.html -- diff --git

[28/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/AccumulatorParam.IntAccumulatorParam$.html -- diff --git

[48/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/R/00frame_toc.html -- diff --git a/site/docs/2.3.0/api/R/00frame_toc.html b/site/docs/2.3.0/api/R/00frame_toc.html new file mode 100644 index

[46/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/R/column_datetime_diff_functions.html -- diff --git a/site/docs/2.3.0/api/R/column_datetime_diff_functions.html

[15/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/TaskCommitDenied.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/TaskCommitDenied.html

[19/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/SparkContext.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/SparkContext.html

[18/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/SparkEnv.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/SparkEnv.html

[49/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/R/00Index.html -- diff --git a/site/docs/2.3.0/api/R/00Index.html b/site/docs/2.3.0/api/R/00Index.html new file mode 100644 index

[02/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/api/java/function/package-summary.html -- diff --git

[07/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/api/java/JavaSparkContext.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/api/java/JavaSparkContext.html

[30/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/lib/jquery.js -- diff --git a/site/docs/2.3.0/api/java/lib/jquery.js b/site/docs/2.3.0/api/java/lib/jquery.js new file mode 100644 index

[39/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/R/spark.gbt.html -- diff --git a/site/docs/2.3.0/api/R/spark.gbt.html b/site/docs/2.3.0/api/R/spark.gbt.html new file mode 100644 index

[05/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/api/java/function/CoGroupFunction.html -- diff --git

[21/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/Resubmitted.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/Resubmitted.html

[27/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/Aggregator.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/Aggregator.html

[08/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/api/java/JavaRDDLike.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/api/java/JavaRDDLike.html

[10/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/api/java/JavaPairRDD.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/api/java/JavaPairRDD.html

[42/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/R/match.html -- diff --git a/site/docs/2.3.0/api/R/match.html b/site/docs/2.3.0/api/R/match.html new file mode 100644 index 000..7da43b2

[33/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/constant-values.html -- diff --git a/site/docs/2.3.0/api/java/constant-values.html b/site/docs/2.3.0/api/java/constant-values.html new

[20/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/SimpleFutureAction.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/SimpleFutureAction.html

[50/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/README.md -- diff --git a/site/docs/2.3.0/README.md b/site/docs/2.3.0/README.md new file mode 100644 index 000..225bb1b --- /dev/null +++

[01/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 1f0b094e6 -> 26c57a24a http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/api/r/PairwiseRRDD.html --

[06/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/api/java/JavaSparkStatusTracker.html -- diff --git

[09/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/api/java/JavaRDD.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/api/java/JavaRDD.html

[16/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/SparkStageInfoImpl.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/SparkStageInfoImpl.html

[29/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/Accumulable.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/Accumulable.html

[37/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/R/summary.html -- diff --git a/site/docs/2.3.0/api/R/summary.html b/site/docs/2.3.0/api/R/summary.html new file mode 100644 index

[17/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/SparkFirehoseListener.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/SparkFirehoseListener.html

[40/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/R/schema.html -- diff --git a/site/docs/2.3.0/api/R/schema.html b/site/docs/2.3.0/api/R/schema.html new file mode 100644 index

[04/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/api/java/function/ForeachFunction.html -- diff --git

[43/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/R/head.html -- diff --git a/site/docs/2.3.0/api/R/head.html b/site/docs/2.3.0/api/R/head.html new file mode 100644 index 000..5145e47 ---

[38/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/R/spark.survreg.html -- diff --git a/site/docs/2.3.0/api/R/spark.survreg.html b/site/docs/2.3.0/api/R/spark.survreg.html new file mode 100644

[23/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/InternalAccumulator.output$.html -- diff --git

[44/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/R/dropTempView.html -- diff --git a/site/docs/2.3.0/api/R/dropTempView.html b/site/docs/2.3.0/api/R/dropTempView.html new file mode 100644

[26/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/CleanShuffle.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/CleanShuffle.html

[22/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/NarrowDependency.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/NarrowDependency.html

[24/51] [partial] spark-website git commit: Apache Spark 2.3.0 Release: Generated Docs

2018-02-28 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/26c57a24/site/docs/2.3.0/api/java/org/apache/spark/FetchFailed.html -- diff --git a/site/docs/2.3.0/api/java/org/apache/spark/FetchFailed.html

spark-website git commit: Add Anirudh Ramanathan to the list of committers.

2018-02-28 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 9883a66db -> 1f0b094e6 Add Anirudh Ramanathan to the list of committers. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/1f0b094e Tree:

spark-website git commit: Add Matthew Cheah to the list of committers.

2018-02-28 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 950c826f1 -> 9883a66db Add Matthew Cheah to the list of committers. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/9883a66d Tree:

spark-website git commit: Add Erik Erlandson to list of committers

2018-02-28 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site fed919d36 -> 950c826f1 Add Erik Erlandson to list of committers Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/950c826f Tree:

spark-website git commit: adding Seth to committers

2018-02-28 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 72a4d4ed2 -> fed919d36 adding Seth to committers Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/fed919d3 Tree:

svn commit: r25332 - in /dev/spark/2.3.1-SNAPSHOT-2018_02_28_10_01-a4eb1e4-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-28 Thread pwendell
Author: pwendell Date: Wed Feb 28 18:15:32 2018 New Revision: 25332 Log: Apache Spark 2.3.1-SNAPSHOT-2018_02_28_10_01-a4eb1e4 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23514] Use SessionState.newHadoopConf() to propage hadoop configs set in SQLConf.

2018-02-28 Thread lixiao
Repository: spark Updated Branches: refs/heads/master fab563b9b -> 476a7f026 [SPARK-23514] Use SessionState.newHadoopConf() to propage hadoop configs set in SQLConf. ## What changes were proposed in this pull request? A few places in `spark-sql` were using `sc.hadoopConfiguration` directly.

svn commit: r25329 - in /dev/spark/2.4.0-SNAPSHOT-2018_02_28_08_02-fab563b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-02-28 Thread pwendell
Author: pwendell Date: Wed Feb 28 16:21:01 2018 New Revision: 25329 Log: Apache Spark 2.4.0-SNAPSHOT-2018_02_28_08_02-fab563b docs [This commit notification would consist of 1444 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23517][PYTHON] Make `pyspark.util._exception_message` produce the trace from Java side by Py4JJavaError

2018-02-28 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 6a8abe29e -> fab563b9b [SPARK-23517][PYTHON] Make `pyspark.util._exception_message` produce the trace from Java side by Py4JJavaError ## What changes were proposed in this pull request? This PR proposes for

spark git commit: [SPARK-23517][PYTHON] Make `pyspark.util._exception_message` produce the trace from Java side by Py4JJavaError

2018-02-28 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 dfa43792f -> a4eb1e47a [SPARK-23517][PYTHON] Make `pyspark.util._exception_message` produce the trace from Java side by Py4JJavaError ## What changes were proposed in this pull request? This PR proposes for

spark-website git commit: Update spark.apache.org and add k8s as a supported option.

2018-02-28 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 6853fd7c6 -> 72a4d4ed2 Update spark.apache.org and add k8s as a supported option. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/72a4d4ed

spark git commit: [SPARK-23508][CORE] Fix BlockmanagerId in case blockManagerIdCache cause oom

2018-02-28 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 fa3667ece -> 9bd25c9bf [SPARK-23508][CORE] Fix BlockmanagerId in case blockManagerIdCache cause oom … cause oom ## What changes were proposed in this pull request? blockManagerIdCache in BlockManagerId will not remove old values

spark git commit: [SPARK-23508][CORE] Fix BlockmanagerId in case blockManagerIdCache cause oom

2018-02-28 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.3 fe9cb4afe -> dfa43792f [SPARK-23508][CORE] Fix BlockmanagerId in case blockManagerIdCache cause oom … cause oom ## What changes were proposed in this pull request? blockManagerIdCache in BlockManagerId will not remove old values

spark git commit: [SPARK-23508][CORE] Fix BlockmanagerId in case blockManagerIdCache cause oom

2018-02-28 Thread wenchen
Repository: spark Updated Branches: refs/heads/master b14993e1f -> 6a8abe29e [SPARK-23508][CORE] Fix BlockmanagerId in case blockManagerIdCache cause oom … cause oom ## What changes were proposed in this pull request? blockManagerIdCache in BlockManagerId will not remove old values which