svn commit: r27961 - in /dev/spark/2.3.2-SNAPSHOT-2018_07_06_22_01-64c72b4-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Sat Jul 7 05:15:48 2018 New Revision: 27961 Log: Apache Spark 2.3.2-SNAPSHOT-2018_07_06_22_01-64c72b4 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24740][PYTHON][ML] Make PySpark's tests compatible with NumPy 1.14+

Repository: spark Updated Branches: refs/heads/master 74f6a92fc -> 044b33b2e [SPARK-24740][PYTHON][ML] Make PySpark's tests compatible with NumPy 1.14+ ## What changes were proposed in this pull request? This PR proposes to make PySpark's tests compatible with NumPy 0.14+ NumPy 0.14.x

spark git commit: [SPARK-24739][PYTHON] Make PySpark compatible with Python 3.7

Repository: spark Updated Branches: refs/heads/branch-2.3 e5cc5f699 -> 64c72b4de [SPARK-24739][PYTHON] Make PySpark compatible with Python 3.7 ## What changes were proposed in this pull request? This PR proposes to make PySpark compatible with Python 3.7. There are rather radical change in

spark git commit: [SPARK-24739][PYTHON] Make PySpark compatible with Python 3.7

Repository: spark Updated Branches: refs/heads/master fc43690d3 -> 74f6a92fc [SPARK-24739][PYTHON] Make PySpark compatible with Python 3.7 ## What changes were proposed in this pull request? This PR proposes to make PySpark compatible with Python 3.7. There are rather radical change in

spark git commit: [SPARK-24749][SQL] Use sameType to compare Array's element type in ArrayContains

Repository: spark Updated Branches: refs/heads/master 4de0425df -> fc43690d3 [SPARK-24749][SQL] Use sameType to compare Array's element type in ArrayContains ## What changes were proposed in this pull request? We should use `DataType.sameType` to compare element type in `ArrayContains`,

svn commit: r27960 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_06_20_02-4de0425-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Sat Jul 7 03:16:26 2018 New Revision: 27960 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_06_20_02-4de0425 docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[42/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/intersect.html -- diff --git a/site/docs/2.2.2/api/R/intersect.html b/site/docs/2.2.2/api/R/intersect.html new file mode 100644 index

[50/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/documentation.md -- diff --git a/documentation.md b/documentation.md index 6c587e0..8a9b62d 100644 --- a/documentation.md +++ b/documentation.md @@ -14,6 +14,7 @@

[43/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/gapplyCollect.html -- diff --git a/site/docs/2.2.2/api/R/gapplyCollect.html b/site/docs/2.2.2/api/R/gapplyCollect.html new file mode 100644

[37/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/spark.bisectingKmeans.html -- diff --git a/site/docs/2.2.2/api/R/spark.bisectingKmeans.html

[33/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/write.jdbc.html -- diff --git a/site/docs/2.2.2/api/R/write.jdbc.html b/site/docs/2.2.2/api/R/write.jdbc.html new file mode 100644 index

[24/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index.html?org%2Fapache%2Fspark%2Fml%2Fclustering%2FLDAModel.html -- diff --git

[36/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/spark.randomForest.html -- diff --git a/site/docs/2.2.2/api/R/spark.randomForest.html b/site/docs/2.2.2/api/R/spark.randomForest.html new

[19/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index.html?org%2Fapache%2Fspark%2Fml%2Fregression%2FLeastSquaresCostFun.html -- diff --git

[28/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index.html -- diff --git a/site/docs/2.2.2/api/java/index.html b/site/docs/2.2.2/api/java/index.html new file mode 100644 index

[38/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/sd.html -- diff --git a/site/docs/2.2.2/api/R/sd.html b/site/docs/2.2.2/api/R/sd.html new file mode 100644 index 000..16a114a ---

[08/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/lib/jquery.js -- diff --git a/site/docs/2.2.2/api/java/lib/jquery.js b/site/docs/2.2.2/api/java/lib/jquery.js new file mode 100644 index

[12/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index.html?org%2Fapache%2Fspark%2Fmllib%2Ftree%2Fmodel%2FDecisionTreeModel.html -- diff --git

[49/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/00Index.html -- diff --git a/site/docs/2.2.2/api/R/00Index.html b/site/docs/2.2.2/api/R/00Index.html new file mode 100644 index

[18/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index.html?org%2Fapache%2Fspark%2Fmllib%2Fclassification%2FClassificationModel.html -- diff --git

[46/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/coalesce.html -- diff --git a/site/docs/2.2.2/api/R/coalesce.html b/site/docs/2.2.2/api/R/coalesce.html new file mode 100644 index

[25/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index.html?org%2Fapache%2Fspark%2Fml%2Fclassification%2FLogisticRegressionTrainingSummary.html -- diff --git

[09/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index.html?org%2Fapache%2Fspark%2Fsql%2Fstreaming%2FStreamingQueryStatus.html -- diff --git

[30/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/constant-values.html -- diff --git a/site/docs/2.2.2/api/java/constant-values.html b/site/docs/2.2.2/api/java/constant-values.html new

[32/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/allclasses-frame.html -- diff --git a/site/docs/2.2.2/api/java/allclasses-frame.html b/site/docs/2.2.2/api/java/allclasses-frame.html new

[03/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/org/apache/spark/ExceptionFailure.html -- diff --git a/site/docs/2.2.2/api/java/org/apache/spark/ExceptionFailure.html

[31/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/allclasses-noframe.html -- diff --git a/site/docs/2.2.2/api/java/allclasses-noframe.html

[13/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index.html?org%2Fapache%2Fspark%2Fmllib%2Fregression%2Fpackage-tree.html -- diff --git

[15/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index.html?org%2Fapache%2Fspark%2Fmllib%2Flinalg%2FMatrixImplicits.html -- diff --git

[02/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/org/apache/spark/FetchFailed.html -- diff --git a/site/docs/2.2.2/api/java/org/apache/spark/FetchFailed.html

[05/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/org/apache/spark/Aggregator.html -- diff --git a/site/docs/2.2.2/api/java/org/apache/spark/Aggregator.html

[29/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index-all.html -- diff --git a/site/docs/2.2.2/api/java/index-all.html b/site/docs/2.2.2/api/java/index-all.html new file mode 100644

[10/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index.html?org%2Fapache%2Fspark%2Fsql%2Fexpressions%2Fjavalang%2Ftyped.html -- diff --git

[35/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/structField.html -- diff --git a/site/docs/2.2.2/api/R/structField.html b/site/docs/2.2.2/api/R/structField.html new file mode 100644 index

[04/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/org/apache/spark/CleanShuffle.html -- diff --git a/site/docs/2.2.2/api/java/org/apache/spark/CleanShuffle.html

[45/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/crossJoin.html -- diff --git a/site/docs/2.2.2/api/R/crossJoin.html b/site/docs/2.2.2/api/R/crossJoin.html new file mode 100644 index

[14/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index.html?org%2Fapache%2Fspark%2Fmllib%2Foptimization%2FLeastSquaresGradient.html -- diff --git

[34/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/translate.html -- diff --git a/site/docs/2.2.2/api/R/translate.html b/site/docs/2.2.2/api/R/translate.html new file mode 100644 index

[07/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/org/apache/index.html -- diff --git a/site/docs/2.2.2/api/java/org/apache/index.html b/site/docs/2.2.2/api/java/org/apache/index.html new

[39/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/read.parquet.html -- diff --git a/site/docs/2.2.2/api/R/read.parquet.html b/site/docs/2.2.2/api/R/read.parquet.html new file mode 100644

[47/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/arrange.html -- diff --git a/site/docs/2.2.2/api/R/arrange.html b/site/docs/2.2.2/api/R/arrange.html new file mode 100644 index

[11/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index.html?org%2Fapache%2Fspark%2Fsql%2FDataFrameStatFunctions.html -- diff --git

[20/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index.html?org%2Fapache%2Fspark%2Fml%2Fregression%2FDecisionTreeRegressionModel.html -- diff --git

[41/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/log1p.html -- diff --git a/site/docs/2.2.2/api/R/log1p.html b/site/docs/2.2.2/api/R/log1p.html new file mode 100644 index 000..ec4b4dc

[22/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index.html?org%2Fapache%2Fspark%2Fml%2Ffeature%2FStringIndexerModel.html -- diff --git

[01/51] [partial] spark-website git commit: Spark 2.2.2 docs

Repository: spark-website Updated Branches: refs/heads/asf-site 5660fb9a4 -> e10014632 http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/org/apache/spark/InternalAccumulator.output$.html

[44/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/R/encode.html -- diff --git a/site/docs/2.2.2/api/R/encode.html b/site/docs/2.2.2/api/R/encode.html new file mode 100644 index

[06/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/org/apache/spark/AccumulatorParam.IntAccumulatorParam$.html -- diff --git

[23/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index.html?org%2Fapache%2Fspark%2Fml%2Ffeature%2FIndexToString.html -- diff --git

[16/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index.html?org%2Fapache%2Fspark%2Fmllib%2Ffeature%2FHashingTF.html -- diff --git

[27/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index.html?org%2Fapache%2Fspark%2Fapi%2Fjava%2Ffunction%2FForeachPartitionFunction.html -- diff --git

[21/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index.html?org%2Fapache%2Fspark%2Fml%2Fparam%2FDoubleArrayParam.html -- diff --git

[17/51] [partial] spark-website git commit: Spark 2.2.2 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e1001463/site/docs/2.2.2/api/java/index.html?org%2Fapache%2Fspark%2Fmllib%2Fclustering%2FLDA.html -- diff --git

svn commit: r27944 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_06_04_01-a381bce-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri Jul 6 11:17:35 2018 New Revision: 27944 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_06_04_01-a381bce docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24673][SQL][PYTHON][FOLLOWUP] Support Column arguments in timezone of from_utc_timestamp/to_utc_timestamp

Repository: spark Updated Branches: refs/heads/master 141953f4c -> a381bce72 [SPARK-24673][SQL][PYTHON][FOLLOWUP] Support Column arguments in timezone of from_utc_timestamp/to_utc_timestamp ## What changes were proposed in this pull request? This pr supported column arguments in timezone of

svn commit: r27941 - in /dev/spark/2.3.2-SNAPSHOT-2018_07_06_02_01-e5cc5f6-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri Jul 6 09:16:15 2018 New Revision: 27941 Log: Apache Spark 2.3.2-SNAPSHOT-2018_07_06_02_01-e5cc5f6 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24535][SPARKR] fix tests on java check error

Repository: spark Updated Branches: refs/heads/master bf67f70c4 -> 141953f4c [SPARK-24535][SPARKR] fix tests on java check error ## What changes were proposed in this pull request? change to skip tests if - couldn't determine java version fix problem on windows ## How was this patch

spark git commit: [SPARK-24535][SPARKR] fix tests on java check error

Repository: spark Updated Branches: refs/heads/branch-2.3 bc7ee7586 -> e5cc5f699 [SPARK-24535][SPARKR] fix tests on java check error ## What changes were proposed in this pull request? change to skip tests if - couldn't determine java version fix problem on windows ## How was this patch