spark git commit: [SPARK-12139][SQL] REGEX Column Specification

Repository: spark Updated Branches: refs/heads/master d3e071658 -> 2cbfc975b [SPARK-12139][SQL] REGEX Column Specification ## What changes were proposed in this pull request? Hive interprets regular expression, e.g., `(a)?+.+` in query specification. This PR enables spark to support this

spark-website git commit: Fix downloads page

Repository: spark-website Updated Branches: refs/heads/asf-site ee654d1f3 -> f2d5d2a68 Fix downloads page Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/f2d5d2a6 Tree:

spark git commit: [SPARK-19285][SQL] Implement UDF0

Repository: spark Updated Branches: refs/heads/master 1cad31f00 -> d3e071658 [SPARK-19285][SQL] Implement UDF0 ### What changes were proposed in this pull request? This PR is to implement UDF0. `UDF0` is needed when users need to implement a JAVA UDF with no argument. ### How was this patch

[36/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/groupBy.html -- diff --git a/site/docs/2.2.0/api/R/groupBy.html b/site/docs/2.2.0/api/R/groupBy.html new file mode 100644 index

[30/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/nafunctions.html -- diff --git a/site/docs/2.2.0/api/R/nafunctions.html b/site/docs/2.2.0/api/R/nafunctions.html new file mode 100644 index

[24/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/shiftLeft.html -- diff --git a/site/docs/2.2.0/api/R/shiftLeft.html b/site/docs/2.2.0/api/R/shiftLeft.html new file mode 100644 index

[32/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/listColumns.html -- diff --git a/site/docs/2.2.0/api/R/listColumns.html b/site/docs/2.2.0/api/R/listColumns.html new file mode 100644 index

[42/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/crosstab.html -- diff --git a/site/docs/2.2.0/api/R/crosstab.html b/site/docs/2.2.0/api/R/crosstab.html new file mode 100644 index

[11/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/java/constant-values.html -- diff --git a/site/docs/2.2.0/api/java/constant-values.html b/site/docs/2.2.0/api/java/constant-values.html new

[19/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/tableNames.html -- diff --git a/site/docs/2.2.0/api/R/tableNames.html b/site/docs/2.2.0/api/R/tableNames.html new file mode 100644 index

[22/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/spark.lda.html -- diff --git a/site/docs/2.2.0/api/R/spark.lda.html b/site/docs/2.2.0/api/R/spark.lda.html new file mode 100644 index

[34/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/intersect.html -- diff --git a/site/docs/2.2.0/api/R/intersect.html b/site/docs/2.2.0/api/R/intersect.html new file mode 100644 index

[49/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/00Index.html -- diff --git a/site/docs/2.2.0/api/R/00Index.html b/site/docs/2.2.0/api/R/00Index.html new file mode 100644 index

[41/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/dayofyear.html -- diff --git a/site/docs/2.2.0/api/R/dayofyear.html b/site/docs/2.2.0/api/R/dayofyear.html new file mode 100644 index

[38/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/first.html -- diff --git a/site/docs/2.2.0/api/R/first.html b/site/docs/2.2.0/api/R/first.html new file mode 100644 index 000..2a4edc9

[37/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/gapply.html -- diff --git a/site/docs/2.2.0/api/R/gapply.html b/site/docs/2.2.0/api/R/gapply.html new file mode 100644 index

[06/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/java/org/apache/spark/AccumulatorParam.IntAccumulatorParam$.html -- diff --git

[27/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/regexp_replace.html -- diff --git a/site/docs/2.2.0/api/R/regexp_replace.html b/site/docs/2.2.0/api/R/regexp_replace.html new file mode

[02/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/java/org/apache/spark/FetchFailed.html -- diff --git a/site/docs/2.2.0/api/java/org/apache/spark/FetchFailed.html

[13/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/java/allclasses-frame.html -- diff --git a/site/docs/2.2.0/api/java/allclasses-frame.html b/site/docs/2.2.0/api/java/allclasses-frame.html new

[18/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/to_json.html -- diff --git a/site/docs/2.2.0/api/R/to_json.html b/site/docs/2.2.0/api/R/to_json.html new file mode 100644 index

[44/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/coltypes.html -- diff --git a/site/docs/2.2.0/api/R/coltypes.html b/site/docs/2.2.0/api/R/coltypes.html new file mode 100644 index

[01/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

Repository: spark-website Updated Branches: refs/heads/asf-site 04d5ce051 -> ee654d1f3 http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/java/org/apache/spark/InternalAccumulator.output$.html

[53/56] spark-website git commit: Rebuild for 2.2.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/ee654d1f/site/screencasts/3-transformations-and-caching.html -- diff --git a/site/screencasts/3-transformations-and-caching.html

[26/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/round.html -- diff --git a/site/docs/2.2.0/api/R/round.html b/site/docs/2.2.0/api/R/round.html new file mode 100644 index 000..35b3cbf

[09/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/java/index.html -- diff --git a/site/docs/2.2.0/api/java/index.html b/site/docs/2.2.0/api/java/index.html new file mode 100644 index

[50/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/README.md -- diff --git a/site/docs/2.2.0/README.md b/site/docs/2.2.0/README.md new file mode 100644 index 000..90e10a1 --- /dev/null +++

[05/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/java/org/apache/spark/Aggregator.html -- diff --git a/site/docs/2.2.0/api/java/org/apache/spark/Aggregator.html

[28/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/randn.html -- diff --git a/site/docs/2.2.0/api/R/randn.html b/site/docs/2.2.0/api/R/randn.html new file mode 100644 index 000..ed45118

[39/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/explain.html -- diff --git a/site/docs/2.2.0/api/R/explain.html b/site/docs/2.2.0/api/R/explain.html new file mode 100644 index

[40/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/dropDuplicates.html -- diff --git a/site/docs/2.2.0/api/R/dropDuplicates.html b/site/docs/2.2.0/api/R/dropDuplicates.html new file mode

[20/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/subset.html -- diff --git a/site/docs/2.2.0/api/R/subset.html b/site/docs/2.2.0/api/R/subset.html new file mode 100644 index

[31/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/merge.html -- diff --git a/site/docs/2.2.0/api/R/merge.html b/site/docs/2.2.0/api/R/merge.html new file mode 100644 index 000..0bc3629

[56/56] spark-website git commit: Rebuild for 2.2.0

Rebuild for 2.2.0 Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/ee654d1f Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/ee654d1f Diff:

[54/56] spark-website git commit: Rebuild for 2.2.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/ee654d1f/site/releases/spark-release-0-5-2.html -- diff --git a/site/releases/spark-release-0-5-2.html b/site/releases/spark-release-0-5-2.html index 1ebbb72..ad37cd1

[12/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/java/allclasses-noframe.html -- diff --git a/site/docs/2.2.0/api/java/allclasses-noframe.html

[47/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/add_months.html -- diff --git a/site/docs/2.2.0/api/R/add_months.html b/site/docs/2.2.0/api/R/add_months.html new file mode 100644 index

[04/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/java/org/apache/spark/CleanShuffle.html -- diff --git a/site/docs/2.2.0/api/java/org/apache/spark/CleanShuffle.html

[43/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/cosh.html -- diff --git a/site/docs/2.2.0/api/R/cosh.html b/site/docs/2.2.0/api/R/cosh.html new file mode 100644 index 000..0b06194 ---

[29/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/over.html -- diff --git a/site/docs/2.2.0/api/R/over.html b/site/docs/2.2.0/api/R/over.html new file mode 100644 index 000..539a56f ---

[17/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/unpersist.html -- diff --git a/site/docs/2.2.0/api/R/unpersist.html b/site/docs/2.2.0/api/R/unpersist.html new file mode 100644 index

[35/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/histogram.html -- diff --git a/site/docs/2.2.0/api/R/histogram.html b/site/docs/2.2.0/api/R/histogram.html new file mode 100644 index

[16/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/with.html -- diff --git a/site/docs/2.2.0/api/R/with.html b/site/docs/2.2.0/api/R/with.html new file mode 100644 index 000..d6e656c ---

[10/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/java/index-all.html -- diff --git a/site/docs/2.2.0/api/java/index-all.html b/site/docs/2.2.0/api/java/index-all.html new file mode 100644

[15/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/write.json.html -- diff --git a/site/docs/2.2.0/api/R/write.json.html b/site/docs/2.2.0/api/R/write.json.html new file mode 100644 index

[46/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/atan2.html -- diff --git a/site/docs/2.2.0/api/R/atan2.html b/site/docs/2.2.0/api/R/atan2.html new file mode 100644 index 000..4a141c7

[25/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/schema.html -- diff --git a/site/docs/2.2.0/api/R/schema.html b/site/docs/2.2.0/api/R/schema.html new file mode 100644 index

[52/56] spark-website git commit: Update for 2.2.0

Update for 2.2.0 Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/76d1abf1 Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/76d1abf1 Diff:

[14/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/write.text.html -- diff --git a/site/docs/2.2.0/api/R/write.text.html b/site/docs/2.2.0/api/R/write.text.html new file mode 100644 index

[48/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/00frame_toc.html -- diff --git a/site/docs/2.2.0/api/R/00frame_toc.html b/site/docs/2.2.0/api/R/00frame_toc.html new file mode 100644 index

[07/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/java/org/apache/spark/Accumulable.html -- diff --git a/site/docs/2.2.0/api/java/org/apache/spark/Accumulable.html

[08/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/java/lib/jquery.js -- diff --git a/site/docs/2.2.0/api/java/lib/jquery.js b/site/docs/2.2.0/api/java/lib/jquery.js new file mode 100644 index

[45/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/cancelJobGroup.html -- diff --git a/site/docs/2.2.0/api/R/cancelJobGroup.html b/site/docs/2.2.0/api/R/cancelJobGroup.html new file mode

[03/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/java/org/apache/spark/ExceptionFailure.html -- diff --git a/site/docs/2.2.0/api/java/org/apache/spark/ExceptionFailure.html

[33/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/join.html -- diff --git a/site/docs/2.2.0/api/R/join.html b/site/docs/2.2.0/api/R/join.html new file mode 100644 index 000..b93c531 ---

[23/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/skewness.html -- diff --git a/site/docs/2.2.0/api/R/skewness.html b/site/docs/2.2.0/api/R/skewness.html new file mode 100644 index

[21/56] [partial] spark-website git commit: Add Spark 2.2.0 docs

http://git-wip-us.apache.org/repos/asf/spark-website/blob/f7ec1155/site/docs/2.2.0/api/R/sqrt.html -- diff --git a/site/docs/2.2.0/api/R/sqrt.html b/site/docs/2.2.0/api/R/sqrt.html new file mode 100644 index 000..031881c ---

spark git commit: [SPARK-16019][YARN] Use separate RM poll interval when starting client AM.

Repository: spark Updated Branches: refs/heads/master ebc124d4c -> 1cad31f00 [SPARK-16019][YARN] Use separate RM poll interval when starting client AM. Currently the code monitoring the launch of the client AM uses the value of spark.yarn.report.interval as the interval for polling the RM; if

spark git commit: [SPARK-21365][PYTHON] Deduplicate logics parsing DDL type/schema definition

Repository: spark Updated Branches: refs/heads/master 66d216865 -> ebc124d4c [SPARK-21365][PYTHON] Deduplicate logics parsing DDL type/schema definition ## What changes were proposed in this pull request? This PR deals with four points as below: - Reuse existing DDL parser APIs rather than

spark git commit: [SPARK-21366][SQL][TEST] Add sql test for window functions

Repository: spark Updated Branches: refs/heads/branch-2.2 edcd9fbc9 -> 399aa016e [SPARK-21366][SQL][TEST] Add sql test for window functions ## What changes were proposed in this pull request? Add sql test for window functions, also remove uncecessary test cases in `WindowQuerySuite`. ##

spark git commit: [SPARK-21366][SQL][TEST] Add sql test for window functions

Repository: spark Updated Branches: refs/heads/master 7514db1de -> 66d216865 [SPARK-21366][SQL][TEST] Add sql test for window functions ## What changes were proposed in this pull request? Add sql test for window functions, also remove uncecessary test cases in `WindowQuerySuite`. ## How

spark git commit: [SPARK-21263][SQL] Do not allow partially parsing double and floats via NumberFormat in CSV

Repository: spark Updated Branches: refs/heads/master a4baa8f48 -> 7514db1de [SPARK-21263][SQL] Do not allow partially parsing double and floats via NumberFormat in CSV ## What changes were proposed in this pull request? This PR proposes to remove `NumberFormat.parse` use to disallow a case

spark git commit: [SPARK-20331][SQL] Enhanced Hive partition pruning predicate pushdown

Repository: spark Updated Branches: refs/heads/master d4d9e17b3 -> a4baa8f48 [SPARK-20331][SQL] Enhanced Hive partition pruning predicate pushdown (Link to Jira: https://issues.apache.org/jira/browse/SPARK-20331) ## What changes were proposed in this pull request? Spark 2.1 introduced

spark git commit: [SPARK-20456][PYTHON][FOLLOWUP] Fix timezone-dependent doctests in unix_timestamp and from_unixtime

Repository: spark Updated Branches: refs/heads/master 97a1aa2c7 -> d4d9e17b3 [SPARK-20456][PYTHON][FOLLOWUP] Fix timezone-dependent doctests in unix_timestamp and from_unixtime ## What changes were proposed in this pull request? This PR proposes to simply ignore the results in examples that