spark git commit: [SPARK-17651][SPARKR] Set R package version number along with mvn

Repository: spark Updated Branches: refs/heads/branch-2.0 452e468f2 -> b111a81f2 [SPARK-17651][SPARKR] Set R package version number along with mvn This PR sets the R package version while tagging releases. Note that since R doesn't accept `-SNAPSHOT` in version number field, we remove that

spark git commit: [SPARK-17651][SPARKR] Set R package version number along with mvn

Repository: spark Updated Branches: refs/heads/master 90a30f463 -> 7c382524a [SPARK-17651][SPARKR] Set R package version number along with mvn ## What changes were proposed in this pull request? This PR sets the R package version while tagging releases. Note that since R doesn't accept

spark git commit: [SPARK-17635][SQL] Remove hardcode "agg_plan" in HashAggregateExec

Repository: spark Updated Branches: refs/heads/master a16619683 -> 79159a1e8 [SPARK-17635][SQL] Remove hardcode "agg_plan" in HashAggregateExec ## What changes were proposed in this pull request? "agg_plan" are hardcoded in HashAggregateExec, which have potential issue, so removing them.

spark git commit: Skip building R vignettes if Spark is not built

Repository: spark Updated Branches: refs/heads/branch-2.0 b25a8e6e1 -> f14f47f07 Skip building R vignettes if Spark is not built ## What changes were proposed in this pull request? When we build the docs separately we don't have the JAR files from the Spark build in the same tree. As the

spark git commit: Skip building R vignettes if Spark is not built

Repository: spark Updated Branches: refs/heads/master 17b72d31e -> 9f24a17c5 Skip building R vignettes if Spark is not built ## What changes were proposed in this pull request? When we build the docs separately we don't have the JAR files from the Spark build in the same tree. As the SparkR

spark git commit: Bump doc version for release 2.0.1.

Repository: spark Updated Branches: refs/heads/branch-2.0 ec377e773 -> 053b20a79 Bump doc version for release 2.0.1. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/053b20a7 Tree:

spark git commit: [SPARK-17494][SQL] changePrecision() on compact decimal should respect rounding mode

Repository: spark Updated Branches: refs/heads/master 3497ebe51 -> 8bde03bf9 [SPARK-17494][SQL] changePrecision() on compact decimal should respect rounding mode ## What changes were proposed in this pull request? Floor()/Ceil() of decimal is implemented using changePrecision() by passing a

spark git commit: [SPARK-17494][SQL] changePrecision() on compact decimal should respect rounding mode

Repository: spark Updated Branches: refs/heads/branch-2.0 966abd6af -> ec377e773 [SPARK-17494][SQL] changePrecision() on compact decimal should respect rounding mode ## What changes were proposed in this pull request? Floor()/Ceil() of decimal is implemented using changePrecision() by

spark git commit: [SPARK-17627] Mark Streaming Providers Experimental

Repository: spark Updated Branches: refs/heads/branch-2.0 59e6ab11a -> 966abd6af [SPARK-17627] Mark Streaming Providers Experimental All of structured streaming is experimental in its first release. We missed the annotation on two of the APIs. Author: Michael Armbrust

spark git commit: [SPARK-17627] Mark Streaming Providers Experimental

Repository: spark Updated Branches: refs/heads/master 6902edab7 -> 3497ebe51 [SPARK-17627] Mark Streaming Providers Experimental All of structured streaming is experimental in its first release. We missed the annotation on two of the APIs. Author: Michael Armbrust

spark git commit: [MINOR][BUILD] Fix CheckStyle Error

Repository: spark Updated Branches: refs/heads/master 976f3b122 -> 1ea49916a [MINOR][BUILD] Fix CheckStyle Error ## What changes were proposed in this pull request? This PR is to fix the code style errors before 2.0.1 release. ## How was this patch tested? Manual. Before: ```

spark git commit: [SPARK-17513][SQL] Make StreamExecution garbage-collect its metadata

Repository: spark Updated Branches: refs/heads/master 7e418e99c -> 976f3b122 [SPARK-17513][SQL] Make StreamExecution garbage-collect its metadata ## What changes were proposed in this pull request? This PR modifies StreamExecution such that it discards metadata for batches that have already

spark git commit: [SPARK-17513][SQL] Make StreamExecution garbage-collect its metadata

Repository: spark Updated Branches: refs/heads/branch-2.0 8d8e2332c -> 726f05716 [SPARK-17513][SQL] Make StreamExecution garbage-collect its metadata ## What changes were proposed in this pull request? This PR modifies StreamExecution such that it discards metadata for batches that have

spark git commit: [SPARK-17513][SQL] Make StreamExecution garbage-collect its metadata

Repository: spark Updated Branches: refs/heads/branch-2.0 7026eb87e -> 5456a1b4f [SPARK-17513][SQL] Make StreamExecution garbage-collect its metadata ## What changes were proposed in this pull request? This PR modifies StreamExecution such that it discards metadata for batches that have

spark git commit: [SPARK-17513][SQL] Make StreamExecution garbage-collect its metadata

Repository: spark Updated Branches: refs/heads/master 26145a5af -> be9d57fc9 [SPARK-17513][SQL] Make StreamExecution garbage-collect its metadata ## What changes were proposed in this pull request? This PR modifies StreamExecution such that it discards metadata for batches that have already

spark git commit: [SPARK-17571][SQL] AssertOnQuery.condition should always return Boolean value

Repository: spark Updated Branches: refs/heads/branch-2.0 151f808a1 -> 27ce39cf2 [SPARK-17571][SQL] AssertOnQuery.condition should always return Boolean value ## What changes were proposed in this pull request? AssertOnQuery has two apply constructor: one that accepts a closure that returns

spark git commit: [SPARK-17571][SQL] AssertOnQuery.condition should always return Boolean value

Repository: spark Updated Branches: refs/heads/master 1dbb725db -> 8f0c35a4d [SPARK-17571][SQL] AssertOnQuery.condition should always return Boolean value ## What changes were proposed in this pull request? AssertOnQuery has two apply constructor: one that accepts a closure that returns

spark git commit: [SPARK-17561][DOCS] DataFrameWriter documentation formatting problems

Repository: spark Updated Branches: refs/heads/master dca771bec -> b9323fc93 [SPARK-17561][DOCS] DataFrameWriter documentation formatting problems ## What changes were proposed in this pull request? Fix ` / ` problems in SQL scaladoc. ## How was this patch tested? Scaladoc build and manual

spark git commit: [SPARK-17558] Bump Hadoop 2.7 version from 2.7.2 to 2.7.3

tly released and contained a number of bug fixes. ## How was this patch tested? The change should be covered by existing tests. Author: Reynold Xin <r...@databricks.com> Closes #15115 from rxin/SPARK-17558. (cherry picked from commit dca771bec6edb1cd8fc75861d364e0ba9dccf7c3) Signed-off-by: Re

spark git commit: [SPARK-17558] Bump Hadoop 2.7 version from 2.7.2 to 2.7.3

tly released and contained a number of bug fixes. ## How was this patch tested? The change should be covered by existing tests. Author: Reynold Xin <r...@databricks.com> Closes #15115 from rxin/SPARK-17558. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.a

spark git commit: [SPARK-17301][SQL] Remove unused classTag field from AtomicType base class

Repository: spark Updated Branches: refs/heads/master 736a7911c -> 48b459ddd [SPARK-17301][SQL] Remove unused classTag field from AtomicType base class There's an unused `classTag` val in the AtomicType base class which is causing unnecessary slowness in deserialization because it needs to

spark git commit: [SPARK-17301][SQL] Remove unused classTag field from AtomicType base class

Repository: spark Updated Branches: refs/heads/branch-2.0 976a43dbf -> 59032570f [SPARK-17301][SQL] Remove unused classTag field from AtomicType base class There's an unused `classTag` val in the AtomicType base class which is causing unnecessary slowness in deserialization because it needs

spark git commit: [SPARK-17274][SQL] Move join optimizer rules into a separate file

gle file. ## How was this patch tested? This should be covered by existing tests. Author: Reynold Xin <r...@databricks.com> Closes #14846 from rxin/SPARK-17274. (cherry picked from commit 718b6bad2d698b76be6906d51da13626e9f3890e) Signed-off-by: Reynold Xin <r...@databricks.com> Proj

spark git commit: [SPARK-17274][SQL] Move join optimizer rules into a separate file

ile. ## How was this patch tested? This should be covered by existing tests. Author: Reynold Xin <r...@databricks.com> Closes #14846 from rxin/SPARK-17274. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/718b6bad T

spark git commit: [SPARK-17273][SQL] Move expression optimizer rules into a separate file

ion rules into a single file. ## How was this patch tested? This should be covered by existing tests. Author: Reynold Xin <r...@databricks.com> Closes #14845 from rxin/SPARK-17273. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/

spark git commit: [SPARK-17272][SQL] Move subquery optimizer rules into its own file

gle file. ## How was this patch tested? This should be covered by existing tests. Author: Reynold Xin <r...@databricks.com> Closes #14844 from rxin/SPARK-17272. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/0243

spark git commit: [SPARK-17270][SQL] Move object optimization rules into its own file (branch-2.0)

red by existing tests. Author: Reynold Xin <r...@databricks.com> Closes #14843 from rxin/SPARK-17270-branch-2.0. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f91614f3 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/f916

spark git commit: [SPARK-17269][SQL] Move finish analysis optimization stage into its own file

I'm submitting separate pull requests so we can more easily merge this in branch-2.0 to simplify optimizer backports. This should be covered by existing tests. Author: Reynold Xin <r...@databricks.com> Closes #14838 from rxin/SPARK-17269. (cherry picked fr

spark git commit: [SPARK-17269][SQL] Move finish analysis optimization stage into its own file

4838 from rxin/SPARK-17269. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/dcefac43 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/dcefac43 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/dcefac43 Branch: r

spark git commit: [SPARK-17235][SQL] Support purging of old logs in MetadataLog

Repository: spark Updated Branches: refs/heads/branch-2.0 52feb3fbf -> dfdfc3092 [SPARK-17235][SQL] Support purging of old logs in MetadataLog ## What changes were proposed in this pull request? This patch adds a purge interface to MetadataLog, and an implementation in HDFSMetadataLog. The

spark git commit: [SPARK-17235][SQL] Support purging of old logs in MetadataLog

Repository: spark Updated Branches: refs/heads/master a11d10f18 -> f64a1ddd0 [SPARK-17235][SQL] Support purging of old logs in MetadataLog ## What changes were proposed in this pull request? This patch adds a purge interface to MetadataLog, and an implementation in HDFSMetadataLog. The purge

spark git commit: [SPARK-17246][SQL] Add BigDecimal literal

Repository: spark Updated Branches: refs/heads/branch-2.0 deb6a54cf -> 52feb3fbf [SPARK-17246][SQL] Add BigDecimal literal ## What changes were proposed in this pull request? This PR adds parser support for `BigDecimal` literals. If you append the suffix `BD` to a valid number then this will

spark git commit: [SPARK-17246][SQL] Add BigDecimal literal

Repository: spark Updated Branches: refs/heads/master 8e5475be3 -> a11d10f18 [SPARK-17246][SQL] Add BigDecimal literal ## What changes were proposed in this pull request? This PR adds parser support for `BigDecimal` literals. If you append the suffix `BD` to a valid number then this will be

spark git commit: [SPARK-17242][DOCUMENT] Update links of external dstream projects

Repository: spark Updated Branches: refs/heads/branch-2.0 73014a2aa -> 27ed6d5dc [SPARK-17242][DOCUMENT] Update links of external dstream projects ## What changes were proposed in this pull request? Updated links of external dstream projects. ## How was this patch tested? Just document

spark git commit: [SPARK-17242][DOCUMENT] Update links of external dstream projects

Repository: spark Updated Branches: refs/heads/master b964a172a -> 341e0e778 [SPARK-17242][DOCUMENT] Update links of external dstream projects ## What changes were proposed in this pull request? Updated links of external dstream projects. ## How was this patch tested? Just document

spark git commit: [SPARK-17215][SQL] Method `SQLContext.parseDataType(dataTypeString: String)` could be removed.

Repository: spark Updated Branches: refs/heads/master 4d0706d61 -> 5f02d2e5b [SPARK-17215][SQL] Method `SQLContext.parseDataType(dataTypeString: String)` could be removed. ## What changes were proposed in this pull request? Method `SQLContext.parseDataType(dataTypeString: String)` could be

spark git commit: [SPARK-17228][SQL] Not infer/propagate non-deterministic constraints

Repository: spark Updated Branches: refs/heads/branch-2.0 3258f27a8 -> aa57083af [SPARK-17228][SQL] Not infer/propagate non-deterministic constraints ## What changes were proposed in this pull request? Given that filters based on non-deterministic constraints shouldn't be pushed down in the

spark git commit: [SPARK-17228][SQL] Not infer/propagate non-deterministic constraints

Repository: spark Updated Branches: refs/heads/master 3a60be4b1 -> ac27557eb [SPARK-17228][SQL] Not infer/propagate non-deterministic constraints ## What changes were proposed in this pull request? Given that filters based on non-deterministic constraints shouldn't be pushed down in the

spark git commit: [SPARK-16216][SQL][BRANCH-2.0] Backport Read/write dateFormat/timestampFormat options for CSV and JSON

Repository: spark Updated Branches: refs/heads/branch-2.0 9f363a690 -> 3258f27a8 [SPARK-16216][SQL][BRANCH-2.0] Backport Read/write dateFormat/timestampFormat options for CSV and JSON ## What changes were proposed in this pull request? This PR backports

spark git commit: [SPARK-17186][SQL] remove catalog table type INDEX

Repository: spark Updated Branches: refs/heads/branch-2.0 a6e6a047b -> df87f161c [SPARK-17186][SQL] remove catalog table type INDEX ## What changes were proposed in this pull request? Actually Spark SQL doesn't support index, the catalog table type `INDEX` is from Hive. However, most

spark git commit: [SPARK-17186][SQL] remove catalog table type INDEX

Repository: spark Updated Branches: refs/heads/master b9994ad05 -> 52fa45d62 [SPARK-17186][SQL] remove catalog table type INDEX ## What changes were proposed in this pull request? Actually Spark SQL doesn't support index, the catalog table type `INDEX` is from Hive. However, most operations

spark git commit: [MINOR][SQL] Remove implemented functions from comments of 'HiveSessionCatalog.scala'

Repository: spark Updated Branches: refs/heads/branch-2.0 a772b4b5d -> a6e6a047b [MINOR][SQL] Remove implemented functions from comments of 'HiveSessionCatalog.scala' ## What changes were proposed in this pull request? This PR removes implemented functions from comments of

spark git commit: [MINOR][SQL] Remove implemented functions from comments of 'HiveSessionCatalog.scala'

Repository: spark Updated Branches: refs/heads/master c1937dd19 -> b9994ad05 [MINOR][SQL] Remove implemented functions from comments of 'HiveSessionCatalog.scala' ## What changes were proposed in this pull request? This PR removes implemented functions from comments of

spark git commit: [SPARK-16862] Configurable buffer size in `UnsafeSorterSpillReader`

Repository: spark Updated Branches: refs/heads/master bf8ff833e -> c1937dd19 [SPARK-16862] Configurable buffer size in `UnsafeSorterSpillReader` ## What changes were proposed in this pull request? Jira: https://issues.apache.org/jira/browse/SPARK-16862 `BufferedInputStream` used in

spark git commit: [SPARK-16550][SPARK-17042][CORE] Certain classes fail to deserialize in block manager replication

Repository: spark Updated Branches: refs/heads/master 71afeeea4 -> 8e223ea67 [SPARK-16550][SPARK-17042][CORE] Certain classes fail to deserialize in block manager replication ## What changes were proposed in this pull request? This is a straightforward clone of JoshRosen 's original patch.

spark git commit: [SPARK-17162] Range does not support SQL generation

Repository: spark Updated Branches: refs/heads/branch-2.0 6dcc1a3f0 -> 01a4d69f3 [SPARK-17162] Range does not support SQL generation ## What changes were proposed in this pull request? The range operator previously didn't support SQL generation, which made it not possible to use in views.

spark git commit: [SPARK-17162] Range does not support SQL generation

Repository: spark Updated Branches: refs/heads/master 929cb8bee -> 84770b59f [SPARK-17162] Range does not support SQL generation ## What changes were proposed in this pull request? The range operator previously didn't support SQL generation, which made it not possible to use in views. ##

spark git commit: [SPARK-17158][SQL] Change error message for out of range numeric literals

Repository: spark Updated Branches: refs/heads/branch-2.0 efe832200 -> 379b12729 [SPARK-17158][SQL] Change error message for out of range numeric literals ## What changes were proposed in this pull request? Modifies error message for numeric literals to Numeric literal does not fit in range

spark git commit: [SPARK-17158][SQL] Change error message for out of range numeric literals

Repository: spark Updated Branches: refs/heads/master a117afa7c -> ba1737c21 [SPARK-17158][SQL] Change error message for out of range numeric literals ## What changes were proposed in this pull request? Modifies error message for numeric literals to Numeric literal does not fit in range

spark git commit: [SPARK-17149][SQL] array.sql for testing array related functions

Repository: spark Updated Branches: refs/heads/master acac7a508 -> a117afa7c [SPARK-17149][SQL] array.sql for testing array related functions ## What changes were proposed in this pull request? This patch creates array.sql in SQLQueryTestSuite for testing array related functions, including:

spark git commit: [SPARK-16686][SQL] Remove PushProjectThroughSample since it is handled by ColumnPruning

Repository: spark Updated Branches: refs/heads/branch-2.0 d0707c6ba -> 3276ccfac [SPARK-16686][SQL] Remove PushProjectThroughSample since it is handled by ColumnPruning We push down `Project` through `Sample` in `Optimizer` by the rule `PushProjectThroughSample`. However, if the projected

spark git commit: HOTFIX: compilation broken due to protected ctor.

Repository: spark Updated Branches: refs/heads/branch-2.0 c180d637a -> 05b180faa HOTFIX: compilation broken due to protected ctor. (cherry picked from commit b482c09fa22c5762a355f95820e4ba3e2517fb77) Signed-off-by: Reynold Xin Project:

spark git commit: HOTFIX: compilation broken due to protected ctor.

Repository: spark Updated Branches: refs/heads/master f5472dda5 -> b482c09fa HOTFIX: compilation broken due to protected ctor. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b482c09f Tree:

spark git commit: [SPARK-16947][SQL] Support type coercion and foldable expression for inline tables

Repository: spark Updated Branches: refs/heads/branch-2.0 ea684b69c -> c180d637a [SPARK-16947][SQL] Support type coercion and foldable expression for inline tables This patch improves inline table support with the following: 1. Support type coercion. 2. Support using foldable expressions.

spark git commit: [SPARK-17069] Expose spark.range() as table-valued function in SQL

Repository: spark Updated Branches: refs/heads/branch-2.0 176af17a7 -> ea684b69c [SPARK-17069] Expose spark.range() as table-valued function in SQL This adds analyzer rules for resolving table-valued functions, and adds one builtin implementation for range(). The arguments for range() are

spark git commit: [MINOR][DOC] Fix the descriptions for `properties` argument in the documenation for jdbc APIs

Repository: spark Updated Branches: refs/heads/branch-2.0 3e0163bee -> 68a24d3e7 [MINOR][DOC] Fix the descriptions for `properties` argument in the documenation for jdbc APIs ## What changes were proposed in this pull request? This should be credited to mvervuurt. The main purpose of this

spark git commit: [MINOR][DOC] Fix the descriptions for `properties` argument in the documenation for jdbc APIs

Repository: spark Updated Branches: refs/heads/master f7c9ff57c -> 0f6aa8afa [MINOR][DOC] Fix the descriptions for `properties` argument in the documenation for jdbc APIs ## What changes were proposed in this pull request? This should be credited to mvervuurt. The main purpose of this PR is

spark git commit: [SPARK-17068][SQL] Make view-usage visible during analysis

Repository: spark Updated Branches: refs/heads/master 4a2c375be -> f7c9ff57c [SPARK-17068][SQL] Make view-usage visible during analysis ## What changes were proposed in this pull request? This PR adds a field to subquery alias in order to make the usage of views in a resolved `LogicalPlan`

spark git commit: [SPARK-17084][SQL] Rename ParserUtils.assert to validate

Repository: spark Updated Branches: refs/heads/branch-2.0 6cb3eab7c -> 3e0163bee [SPARK-17084][SQL] Rename ParserUtils.assert to validate ## What changes were proposed in this pull request? This PR renames `ParserUtils.assert` to `ParserUtils.validate`. This is done because this method is

spark git commit: [SPARK-17084][SQL] Rename ParserUtils.assert to validate

Repository: spark Updated Branches: refs/heads/master e28a8c589 -> 4a2c375be [SPARK-17084][SQL] Rename ParserUtils.assert to validate ## What changes were proposed in this pull request? This PR renames `ParserUtils.assert` to `ParserUtils.validate`. This is done because this method is used

spark git commit: [SPARK-17089][DOCS] Remove api doc link for mapReduceTriplets operator

Repository: spark Updated Branches: refs/heads/branch-2.0 022230c20 -> 6cb3eab7c [SPARK-17089][DOCS] Remove api doc link for mapReduceTriplets operator ## What changes were proposed in this pull request? Remove the api doc link for mapReduceTriplets operator because in latest api they are

spark git commit: [SPARK-17089][DOCS] Remove api doc link for mapReduceTriplets operator

Repository: spark Updated Branches: refs/heads/master c34b546d6 -> e28a8c589 [SPARK-17089][DOCS] Remove api doc link for mapReduceTriplets operator ## What changes were proposed in this pull request? Remove the api doc link for mapReduceTriplets operator because in latest api they are

[2/2] spark git commit: [SPARK-16964][SQL] Remove private[sql] and private[spark] from sql.execution package [Backport]

[SPARK-16964][SQL] Remove private[sql] and private[spark] from sql.execution package [Backport] ## What changes were proposed in this pull request? This PR backports https://github.com/apache/spark/pull/14554 to branch-2.0. I have also changed the visibility of a few similar Hive classes. ##

[1/2] spark git commit: [SPARK-16964][SQL] Remove private[sql] and private[spark] from sql.execution package [Backport]

Repository: spark Updated Branches: refs/heads/branch-2.0 237ae54c9 -> 1c5697116 http://git-wip-us.apache.org/repos/asf/spark/blob/1c569711/sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala

spark git commit: Revert "[SPARK-16964][SQL] Remove private[hive] from sql.hive.execution package"

Repository: spark Updated Branches: refs/heads/branch-2.0 2e2c787bf -> 237ae54c9 Revert "[SPARK-16964][SQL] Remove private[hive] from sql.hive.execution package" This reverts commit 2e2c787bf588e129eaaadc792737fd9d2892939c. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-16964][SQL] Remove private[hive] from sql.hive.execution package

Repository: spark Updated Branches: refs/heads/branch-2.0 45036327f -> 2e2c787bf [SPARK-16964][SQL] Remove private[hive] from sql.hive.execution package ## What changes were proposed in this pull request? This PR is a small follow-up to https://github.com/apache/spark/pull/14554. This also

spark git commit: [SPARK-16964][SQL] Remove private[hive] from sql.hive.execution package

Repository: spark Updated Branches: refs/heads/master 7b65030e7 -> 8fdc6ce40 [SPARK-16964][SQL] Remove private[hive] from sql.hive.execution package ## What changes were proposed in this pull request? This PR is a small follow-up to https://github.com/apache/spark/pull/14554. This also

spark git commit: [SPARK-16966][SQL][CORE] App Name is a randomUUID even when "spark.app.name" exists

Repository: spark Updated Branches: refs/heads/branch-2.0 a21ecc996 -> 750f88045 [SPARK-16966][SQL][CORE] App Name is a randomUUID even when "spark.app.name" exists ## What changes were proposed in this pull request? Don't override app name specified in `SparkConf` with a random app name.

spark git commit: [SPARK-16966][SQL][CORE] App Name is a randomUUID even when "spark.app.name" exists

Repository: spark Updated Branches: refs/heads/master 67f025d90 -> cdaa562c9 [SPARK-16966][SQL][CORE] App Name is a randomUUID even when "spark.app.name" exists ## What changes were proposed in this pull request? Don't override app name specified in `SparkConf` with a random app name. Only

spark git commit: [SPARK-17013][SQL] Parse negative numeric literals

Repository: spark Updated Branches: refs/heads/master abff92bfd -> 00e103a6e [SPARK-17013][SQL] Parse negative numeric literals ## What changes were proposed in this pull request? This patch updates the SQL parser to parse negative numeric literals as numeric literals, instead of unary minus

spark git commit: [SPARK-17013][SQL] Parse negative numeric literals

Repository: spark Updated Branches: refs/heads/branch-2.0 b4047fc21 -> bde94cd71 [SPARK-17013][SQL] Parse negative numeric literals ## What changes were proposed in this pull request? This patch updates the SQL parser to parse negative numeric literals as numeric literals, instead of unary

spark git commit: [SPARK-17018][SQL] literals.sql for testing literal parsing

Repository: spark Updated Branches: refs/heads/branch-2.0 6bf20cd94 -> bc683f037 [SPARK-17018][SQL] literals.sql for testing literal parsing ## What changes were proposed in this pull request? This patch adds literals.sql for testing literal parsing end-to-end in SQL. ## How was this patch

spark git commit: [SPARK-17018][SQL] literals.sql for testing literal parsing

Repository: spark Updated Branches: refs/heads/master acaf2a81a -> cf9367826 [SPARK-17018][SQL] literals.sql for testing literal parsing ## What changes were proposed in this pull request? This patch adds literals.sql for testing literal parsing end-to-end in SQL. ## How was this patch

spark git commit: [SPARK-17015][SQL] group-by/order-by ordinal and arithmetic tests

Repository: spark Updated Branches: refs/heads/branch-2.0 33a213f33 -> 6bf20cd94 [SPARK-17015][SQL] group-by/order-by ordinal and arithmetic tests This patch adds three test files: 1. arithmetic.sql.out 2. order-by-ordinal.sql 3. group-by-ordinal.sql This includes

spark git commit: [SPARK-17015][SQL] group-by/order-by ordinal and arithmetic tests

Repository: spark Updated Branches: refs/heads/master 0db373aaf -> a7b02db45 [SPARK-17015][SQL] group-by/order-by ordinal and arithmetic tests ## What changes were proposed in this pull request? This patch adds three test files: 1. arithmetic.sql.out 2. order-by-ordinal.sql 3.

spark git commit: [SPARK-17010][MINOR][DOC] Wrong description in memory management document

Repository: spark Updated Branches: refs/heads/master 665e17532 -> 7a6a3c3fb [SPARK-17010][MINOR][DOC] Wrong description in memory management document ## What changes were proposed in this pull request? change the remain percent to right one. ## How was this patch tested? Manual review

spark git commit: [SPARK-17010][MINOR][DOC] Wrong description in memory management document

Repository: spark Updated Branches: refs/heads/branch-2.0 d3a30d2f0 -> 1e4013571 [SPARK-17010][MINOR][DOC] Wrong description in memory management document ## What changes were proposed in this pull request? change the remain percent to right one. ## How was this patch tested? Manual review

spark git commit: [SPARK-17007][SQL] Move test data files into a test-data folder

Repository: spark Updated Branches: refs/heads/master 425c7c2db -> 665e17532 [SPARK-17007][SQL] Move test data files into a test-data folder ## What changes were proposed in this pull request? This patch moves all the test data files in sql/core/src/test/resources to

spark git commit: [SPARK-17008][SPARK-17009][SQL] Normalization and isolation in SQLQueryTestSuite.

Repository: spark Updated Branches: refs/heads/master ab648c000 -> 425c7c2db [SPARK-17008][SPARK-17009][SQL] Normalization and isolation in SQLQueryTestSuite. ## What changes were proposed in this pull request? This patch enhances SQLQueryTestSuite in two ways: 1. SPARK-17009: Use a new

spark git commit: Fixed typo

Repository: spark Updated Branches: refs/heads/master 121643bc7 -> 9dc3e602d Fixed typo ## What changes were proposed in this pull request? Fixed small typo - "value ... ~~in~~ is null" ## How was this patch tested? Still compiles! Author: Michał Kiełbowicz

spark git commit: Fixed typo

Repository: spark Updated Branches: refs/heads/branch-2.0 2d136dba4 -> 475ee3815 Fixed typo ## What changes were proposed in this pull request? Fixed small typo - "value ... ~~in~~ is null" ## How was this patch tested? Still compiles! Author: Michał Kiełbowicz

spark git commit: [SPARK-16563][SQL] fix spark sql thrift server FetchResults bug

Repository: spark Updated Branches: refs/heads/branch-2.0 6fc54b776 -> 601c649d0 [SPARK-16563][SQL] fix spark sql thrift server FetchResults bug ## What changes were proposed in this pull request? Add a constant iterator which point to head of result. The header will be used to reset

spark git commit: [SPARK-16563][SQL] fix spark sql thrift server FetchResults bug

Repository: spark Updated Branches: refs/heads/master bca43cd63 -> e17a76efd [SPARK-16563][SQL] fix spark sql thrift server FetchResults bug ## What changes were proposed in this pull request? Add a constant iterator which point to head of result. The header will be used to reset iterator

spark git commit: Update docs to include SASL support for RPC

Repository: spark Updated Branches: refs/heads/branch-2.0 9748a2928 -> 6fc54b776 Update docs to include SASL support for RPC ## What changes were proposed in this pull request? Update docs to include SASL support for RPC Evidence:

spark git commit: Update docs to include SASL support for RPC

Repository: spark Updated Branches: refs/heads/master 9216901d5 -> 53d1c7877 Update docs to include SASL support for RPC ## What changes were proposed in this pull request? Update docs to include SASL support for RPC Evidence:

spark git commit: [SPARK-16873][CORE] Fix SpillReader NPE when spillFile has no data

Repository: spark Updated Branches: refs/heads/branch-1.6 52d8837c6 -> d2518acc1 [SPARK-16873][CORE] Fix SpillReader NPE when spillFile has no data ## What changes were proposed in this pull request? SpillReader NPE when spillFile has no data. See follow logs: 16/07/31 20:54:04 INFO

spark git commit: [SPARK-16873][CORE] Fix SpillReader NPE when spillFile has no data

Repository: spark Updated Branches: refs/heads/branch-2.0 bb30a3d0f -> 11854e5a1 [SPARK-16873][CORE] Fix SpillReader NPE when spillFile has no data ## What changes were proposed in this pull request? SpillReader NPE when spillFile has no data. See follow logs: 16/07/31 20:54:04 INFO

spark git commit: [SPARK-16873][CORE] Fix SpillReader NPE when spillFile has no data

Repository: spark Updated Branches: refs/heads/master c5eb1df72 -> 583d91a19 [SPARK-16873][CORE] Fix SpillReader NPE when spillFile has no data ## What changes were proposed in this pull request? SpillReader NPE when spillFile has no data. See follow logs: 16/07/31 20:54:04 INFO

spark git commit: [SPARK-16858][SQL][TEST] Removal of TestHiveSharedState

Repository: spark Updated Branches: refs/heads/master e9fc0b6a8 -> b73a57060 [SPARK-16858][SQL][TEST] Removal of TestHiveSharedState ### What changes were proposed in this pull request? This PR is to remove `TestHiveSharedState`. Also, this is also associated with the Hive refractoring for

spark git commit: [SPARK-16855][SQL] move Greatest and Least from conditionalExpressions.scala to arithmetic.scala

Repository: spark Updated Branches: refs/heads/master cbdff4935 -> a9beeaaae [SPARK-16855][SQL] move Greatest and Least from conditionalExpressions.scala to arithmetic.scala ## What changes were proposed in this pull request? `Greatest` and `Least` are not conditional expressions, but

spark git commit: [SPARK-16850][SQL] Improve type checking error message for greatest/least

Repository: spark Updated Branches: refs/heads/branch-2.0 a937c9ee4 -> f190bb83b [SPARK-16850][SQL] Improve type checking error message for greatest/least Greatest/least function does not have the most friendly error message for data types. This patch improves the error message to not show

spark git commit: [SPARK-16836][SQL] Add support for CURRENT_DATE/CURRENT_TIMESTAMP literals

Repository: spark Updated Branches: refs/heads/master 146001a9f -> 2330f3ecb [SPARK-16836][SQL] Add support for CURRENT_DATE/CURRENT_TIMESTAMP literals ## What changes were proposed in this pull request? In Spark 1.6 (with Hive support) we could use `CURRENT_DATE` and `CURRENT_TIMESTAMP`

spark git commit: [SPARK-16836][SQL] Add support for CURRENT_DATE/CURRENT_TIMESTAMP literals

Repository: spark Updated Branches: refs/heads/branch-2.0 ef7927e8e -> a937c9ee4 [SPARK-16836][SQL] Add support for CURRENT_DATE/CURRENT_TIMESTAMP literals ## What changes were proposed in this pull request? In Spark 1.6 (with Hive support) we could use `CURRENT_DATE` and `CURRENT_TIMESTAMP`

spark git commit: [SPARK-16793][SQL] Set the temporary warehouse path to sc'conf in TestHive.

Repository: spark Updated Branches: refs/heads/master 2eedc00b0 -> 5184df06b [SPARK-16793][SQL] Set the temporary warehouse path to sc'conf in TestHive. ## What changes were proposed in this pull request? With SPARK-15034, we could use the value of spark.sql.warehouse.dir to set the

spark git commit: [SPARK-16818] Exchange reuse incorrectly reuses scans over different sets of partitions

Repository: spark Updated Branches: refs/heads/branch-2.0 1813bbd9b -> 5fbf5f93e [SPARK-16818] Exchange reuse incorrectly reuses scans over different sets of partitions https://github.com/apache/spark/pull/14425 rebased for branch-2.0 Author: Eric Liang Closes #14427

spark git commit: [SPARK-16813][SQL] Remove private[sql] and private[spark] from catalyst package

es #14418 from rxin/SPARK-16813. (cherry picked from commit 064d91ff7342002414d3274694a8e2e37f154986) Signed-off-by: Reynold Xin <r...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d357ca30 Tree:

spark git commit: [SPARK-16812] Open up SparkILoop.getAddedJars

ars added. ## How was this patch tested? N/A - this is a simple visibility change. Author: Reynold Xin <r...@databricks.com> Closes #14417 from rxin/SPARK-16812. (cherry picked from commit 7c27d075c39ebaf3e762284e2536fe7be0e3da87) Signed-off-by: Reynold Xin <r...@databricks.com>

spark git commit: [SPARK-16812] Open up SparkILoop.getAddedJars

ars added. ## How was this patch tested? N/A - this is a simple visibility change. Author: Reynold Xin <r...@databricks.com> Closes #14417 from rxin/SPARK-16812. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7c27d075 T

spark git commit: [SPARK-16818] Exchange reuse incorrectly reuses scans over different sets of partitions

may not be uniquely identifying. cc rxin ## How was this patch tested? Unit tests. Author: Eric Liang <e...@databricks.com> Closes #14425 from ericl/spark-16818. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/957a

spark git commit: [SPARK-16772][PYTHON][DOCS] Restore "datatype string" to Python API docstrings

Repository: spark Updated Branches: refs/heads/master 2c15323ad -> 2182e4322 [SPARK-16772][PYTHON][DOCS] Restore "datatype string" to Python API docstrings ## What changes were proposed in this pull request? This PR corrects [an error made in an earlier

<    3   4   5   6   7   8   9   10   11   12   >