spark git commit: [SPARK-20567] Lazily bind in GenerateExec

Repository: spark Updated Branches: refs/heads/branch-2.2 c199764ba -> c80242ab9 [SPARK-20567] Lazily bind in GenerateExec It is not valid to eagerly bind with the child's output as this causes failures when we attempt to canonicalize the plan (replacing the attribute references with

spark git commit: [SPARK-20567] Lazily bind in GenerateExec

Repository: spark Updated Branches: refs/heads/master b946f3160 -> 6235132a8 [SPARK-20567] Lazily bind in GenerateExec It is not valid to eagerly bind with the child's output as this causes failures when we attempt to canonicalize the plan (replacing the attribute references with dummies).

spark git commit: [SPARK-20558][CORE] clear InheritableThreadLocal variables in SparkContext when stopping it

Repository: spark Updated Branches: refs/heads/branch-2.0 068500a4a -> 46659974e [SPARK-20558][CORE] clear InheritableThreadLocal variables in SparkContext when stopping it ## What changes were proposed in this pull request? To better understand this problem, let's take a look at an example

spark git commit: [SPARK-20558][CORE] clear InheritableThreadLocal variables in SparkContext when stopping it

Repository: spark Updated Branches: refs/heads/branch-2.1 5915588a9 -> d10b0f654 [SPARK-20558][CORE] clear InheritableThreadLocal variables in SparkContext when stopping it ## What changes were proposed in this pull request? To better understand this problem, let's take a look at an example

spark git commit: [SPARK-20558][CORE] clear InheritableThreadLocal variables in SparkContext when stopping it

Repository: spark Updated Branches: refs/heads/branch-2.2 871b073b9 -> c199764ba [SPARK-20558][CORE] clear InheritableThreadLocal variables in SparkContext when stopping it ## What changes were proposed in this pull request? To better understand this problem, let's take a look at an example

spark git commit: [SPARK-20558][CORE] clear InheritableThreadLocal variables in SparkContext when stopping it

Repository: spark Updated Branches: refs/heads/master ef3df9125 -> b946f3160 [SPARK-20558][CORE] clear InheritableThreadLocal variables in SparkContext when stopping it ## What changes were proposed in this pull request? To better understand this problem, let's take a look at an example

[48/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/00frame_toc.html -- diff --git a/site/docs/2.1.1/api/R/00frame_toc.html b/site/docs/2.1.1/api/R/00frame_toc.html new file mode 100644 index

[44/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/columns.html -- diff --git a/site/docs/2.1.1/api/R/columns.html b/site/docs/2.1.1/api/R/columns.html new file mode 100644 index

[29/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/registerTempTable-deprecated.html -- diff --git a/site/docs/2.1.1/api/R/registerTempTable-deprecated.html

[36/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/index.html -- diff --git a/site/docs/2.1.1/api/R/index.html b/site/docs/2.1.1/api/R/index.html new file mode 100644 index 000..11d4c8d

[01/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

Repository: spark-website Updated Branches: refs/heads/asf-site e4019e64c -> d4f0c34ac http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/java/org/apache/spark/SparkEnv.html -- diff --git

[38/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/gapply.html -- diff --git a/site/docs/2.1.1/api/R/gapply.html b/site/docs/2.1.1/api/R/gapply.html new file mode 100644 index

[21/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/toRadians.html -- diff --git a/site/docs/2.1.1/api/R/toRadians.html b/site/docs/2.1.1/api/R/toRadians.html new file mode 100644 index

[39/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/filter.html -- diff --git a/site/docs/2.1.1/api/R/filter.html b/site/docs/2.1.1/api/R/filter.html new file mode 100644 index

[23/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/str.html -- diff --git a/site/docs/2.1.1/api/R/str.html b/site/docs/2.1.1/api/R/str.html new file mode 100644 index 000..3bbf4d3 ---

[06/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/java/org/apache/spark/InternalAccumulator.html -- diff --git a/site/docs/2.1.1/api/java/org/apache/spark/InternalAccumulator.html

[25/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/spark.gaussianMixture.html -- diff --git a/site/docs/2.1.1/api/R/spark.gaussianMixture.html

[20/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/unpersist.html -- diff --git a/site/docs/2.1.1/api/R/unpersist.html b/site/docs/2.1.1/api/R/unpersist.html new file mode 100644 index

[16/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/java/allclasses-noframe.html -- diff --git a/site/docs/2.1.1/api/java/allclasses-noframe.html

[34/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/locate.html -- diff --git a/site/docs/2.1.1/api/R/locate.html b/site/docs/2.1.1/api/R/locate.html new file mode 100644 index

[07/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/java/org/apache/spark/ExecutorRemoved.html -- diff --git a/site/docs/2.1.1/api/java/org/apache/spark/ExecutorRemoved.html

[22/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/summarize.html -- diff --git a/site/docs/2.1.1/api/R/summarize.html b/site/docs/2.1.1/api/R/summarize.html new file mode 100644 index

[35/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/join.html -- diff --git a/site/docs/2.1.1/api/R/join.html b/site/docs/2.1.1/api/R/join.html new file mode 100644 index 000..04240b6 ---

[17/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/java/allclasses-frame.html -- diff --git a/site/docs/2.1.1/api/java/allclasses-frame.html b/site/docs/2.1.1/api/java/allclasses-frame.html new

[40/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/endsWith.html -- diff --git a/site/docs/2.1.1/api/R/endsWith.html b/site/docs/2.1.1/api/R/endsWith.html new file mode 100644 index

[04/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/java/org/apache/spark/RangePartitioner.html -- diff --git a/site/docs/2.1.1/api/java/org/apache/spark/RangePartitioner.html

[45/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/ceil.html -- diff --git a/site/docs/2.1.1/api/R/ceil.html b/site/docs/2.1.1/api/R/ceil.html new file mode 100644 index 000..745ae17 ---

[33/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/merge.html -- diff --git a/site/docs/2.1.1/api/R/merge.html b/site/docs/2.1.1/api/R/merge.html new file mode 100644 index 000..73b5bf9

[41/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/distinct.html -- diff --git a/site/docs/2.1.1/api/R/distinct.html b/site/docs/2.1.1/api/R/distinct.html new file mode 100644 index

[02/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/java/org/apache/spark/SparkContext.html -- diff --git a/site/docs/2.1.1/api/java/org/apache/spark/SparkContext.html

[24/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/sparkR.callJStatic.html -- diff --git a/site/docs/2.1.1/api/R/sparkR.callJStatic.html b/site/docs/2.1.1/api/R/sparkR.callJStatic.html new

[12/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/java/lib/jquery.js -- diff --git a/site/docs/2.1.1/api/java/lib/jquery.js b/site/docs/2.1.1/api/java/lib/jquery.js new file mode 100644 index

[31/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/partitionBy.html -- diff --git a/site/docs/2.1.1/api/R/partitionBy.html b/site/docs/2.1.1/api/R/partitionBy.html new file mode 100644 index

[47/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/approxCountDistinct.html -- diff --git a/site/docs/2.1.1/api/R/approxCountDistinct.html b/site/docs/2.1.1/api/R/approxCountDistinct.html new

[10/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/java/org/apache/spark/AccumulatorParam.IntAccumulatorParam$.html -- diff --git

[37/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/groupBy.html -- diff --git a/site/docs/2.1.1/api/R/groupBy.html b/site/docs/2.1.1/api/R/groupBy.html new file mode 100644 index

[19/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/withColumn.html -- diff --git a/site/docs/2.1.1/api/R/withColumn.html b/site/docs/2.1.1/api/R/withColumn.html new file mode 100644 index

[43/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/covar_pop.html -- diff --git a/site/docs/2.1.1/api/R/covar_pop.html b/site/docs/2.1.1/api/R/covar_pop.html new file mode 100644 index

[15/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/java/constant-values.html -- diff --git a/site/docs/2.1.1/api/java/constant-values.html b/site/docs/2.1.1/api/java/constant-values.html new

[14/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/java/index-all.html -- diff --git a/site/docs/2.1.1/api/java/index-all.html b/site/docs/2.1.1/api/java/index-all.html new file mode 100644

[13/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/java/index.html -- diff --git a/site/docs/2.1.1/api/java/index.html b/site/docs/2.1.1/api/java/index.html new file mode 100644 index

[50/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/README.md -- diff --git a/site/docs/2.1.1/README.md b/site/docs/2.1.1/README.md new file mode 100644 index 000..ffd3b57 --- /dev/null +++

[32/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/nafunctions.html -- diff --git a/site/docs/2.1.1/api/R/nafunctions.html b/site/docs/2.1.1/api/R/nafunctions.html new file mode 100644 index

[26/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/show.html -- diff --git a/site/docs/2.1.1/api/R/show.html b/site/docs/2.1.1/api/R/show.html new file mode 100644 index 000..50eb890 ---

[03/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/java/org/apache/spark/SparkConf.html -- diff --git a/site/docs/2.1.1/api/java/org/apache/spark/SparkConf.html

[49/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/00Index.html -- diff --git a/site/docs/2.1.1/api/R/00Index.html b/site/docs/2.1.1/api/R/00Index.html new file mode 100644 index

[42/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/dapplyCollect.html -- diff --git a/site/docs/2.1.1/api/R/dapplyCollect.html b/site/docs/2.1.1/api/R/dapplyCollect.html new file mode 100644

[46/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/attach.html -- diff --git a/site/docs/2.1.1/api/R/attach.html b/site/docs/2.1.1/api/R/attach.html new file mode 100644 index

[11/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/java/org/apache/spark/Accumulable.html -- diff --git a/site/docs/2.1.1/api/java/org/apache/spark/Accumulable.html

[18/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/write.orc.html -- diff --git a/site/docs/2.1.1/api/R/write.orc.html b/site/docs/2.1.1/api/R/write.orc.html new file mode 100644 index

[27/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/select.html -- diff --git a/site/docs/2.1.1/api/R/select.html b/site/docs/2.1.1/api/R/select.html new file mode 100644 index

[05/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/java/org/apache/spark/JobExecutionStatus.html -- diff --git a/site/docs/2.1.1/api/java/org/apache/spark/JobExecutionStatus.html

[08/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/java/org/apache/spark/ComplexFutureAction.html -- diff --git a/site/docs/2.1.1/api/java/org/apache/spark/ComplexFutureAction.html

[30/51] [partial] spark-website git commit: Add Spark 2.1.1 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/d4f0c34a/site/docs/2.1.1/api/R/randomSplit.html -- diff --git a/site/docs/2.1.1/api/R/randomSplit.html b/site/docs/2.1.1/api/R/randomSplit.html new file mode 100644 index

[3/4] spark-website git commit: Add Spark 2.1.1 release.

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e4019e64/site/news/spark-1-4-1-released.html -- diff --git a/site/news/spark-1-4-1-released.html b/site/news/spark-1-4-1-released.html index d4327a4..faf7639 100644 ---

[2/4] spark-website git commit: Add Spark 2.1.1 release.

http://git-wip-us.apache.org/repos/asf/spark-website/blob/e4019e64/site/release-process.html -- diff --git a/site/release-process.html b/site/release-process.html index 4dded93..7782ab0 100644 --- a/site/release-process.html +++

[4/4] spark-website git commit: Add Spark 2.1.1 release.

Add Spark 2.1.1 release. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/e4019e64 Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/e4019e64 Diff:

[1/4] spark-website git commit: Add Spark 2.1.1 release.

Repository: spark-website Updated Branches: refs/heads/asf-site 09046892b -> e4019e64c http://git-wip-us.apache.org/repos/asf/spark-website/blob/e4019e64/site/sitemap.xml -- diff --git a/site/sitemap.xml b/site/sitemap.xml

spark git commit: [SPARK-20421][CORE] Add a missing deprecation tag.

Repository: spark Updated Branches: refs/heads/master 13f47dc50 -> ef3df9125 [SPARK-20421][CORE] Add a missing deprecation tag. In the previous patch I deprecated StorageStatus, but not the method in SparkContext that exposes that class publicly. So deprecate the method too. Author: Marcelo

spark git commit: [SPARK-20421][CORE] Add a missing deprecation tag.

Repository: spark Updated Branches: refs/heads/branch-2.2 4f4083bfa -> 871b073b9 [SPARK-20421][CORE] Add a missing deprecation tag. In the previous patch I deprecated StorageStatus, but not the method in SparkContext that exposes that class publicly. So deprecate the method too. Author:

spark git commit: [SPARK-20490][SPARKR][DOC] add family tag for not function

Repository: spark Updated Branches: refs/heads/master b1e639ab0 -> 13f47dc50 [SPARK-20490][SPARKR][DOC] add family tag for not function ## What changes were proposed in this pull request? doc only ## How was this patch tested? manual Author: Felix Cheung

spark git commit: [SPARK-19235][SQL][TEST][FOLLOW-UP] Enable Test Cases in DDLSuite with Hive Metastore

Repository: spark Updated Branches: refs/heads/branch-2.2 01f3be7dd -> 4f4083bfa [SPARK-19235][SQL][TEST][FOLLOW-UP] Enable Test Cases in DDLSuite with Hive Metastore ### What changes were proposed in this pull request? This is a follow-up of enabling test cases in DDLSuite with Hive

spark git commit: [SPARK-19235][SQL][TEST][FOLLOW-UP] Enable Test Cases in DDLSuite with Hive Metastore

Repository: spark Updated Branches: refs/heads/master e300a5a14 -> b1e639ab0 [SPARK-19235][SQL][TEST][FOLLOW-UP] Enable Test Cases in DDLSuite with Hive Metastore ### What changes were proposed in this pull request? This is a follow-up of enabling test cases in DDLSuite with Hive Metastore.

spark git commit: [SPARK-20300][ML][PYSPARK] Python API for ALSModel.recommendForAllUsers, Items

Repository: spark Updated Branches: refs/heads/branch-2.2 ef5e2a050 -> 01f3be7dd [SPARK-20300][ML][PYSPARK] Python API for ALSModel.recommendForAllUsers,Items Add Python API for `ALSModel` methods `recommendForAllUsers`, `recommendForAllItems` ## How was this patch tested? New doc tests.

spark git commit: [SPARK-20300][ML][PYSPARK] Python API for ALSModel.recommendForAllUsers, Items

Repository: spark Updated Branches: refs/heads/master 86174ea89 -> e300a5a14 [SPARK-20300][ML][PYSPARK] Python API for ALSModel.recommendForAllUsers,Items Add Python API for `ALSModel` methods `recommendForAllUsers`, `recommendForAllItems` ## How was this patch tested? New doc tests.

spark git commit: [SPARK-20549] java.io.CharConversionException: Invalid UTF-32' in JsonToStructs

Repository: spark Updated Branches: refs/heads/master afb21bf22 -> 86174ea89 [SPARK-20549] java.io.CharConversionException: Invalid UTF-32' in JsonToStructs ## What changes were proposed in this pull request? A fix for the same problem was made in #17693 but ignored `JsonToStructs`. This PR

spark git commit: [SPARK-20549] java.io.CharConversionException: Invalid UTF-32' in JsonToStructs

Repository: spark Updated Branches: refs/heads/branch-2.2 b146481ff -> ef5e2a050 [SPARK-20549] java.io.CharConversionException: Invalid UTF-32' in JsonToStructs ## What changes were proposed in this pull request? A fix for the same problem was made in #17693 but ignored `JsonToStructs`. This