spark git commit: [SPARK-20719][SQL] Support LIMIT ALL

2017-05-12 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master e3d2022e4 -> b84ff7eb6 [SPARK-20719][SQL] Support LIMIT ALL ### What changes were proposed in this pull request? `LIMIT ALL` is the same as omitting the `LIMIT` clause. It is supported by both PrestgreSQL and Presto. This PR is to support

spark git commit: [SPARK-20594][SQL] The staging directory should be a child directory starts with "." to avoid being deleted if we set hive.exec.stagingdir under the table directory.

2017-05-12 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 0d3a63193 -> e3d2022e4 [SPARK-20594][SQL] The staging directory should be a child directory starts with "." to avoid being deleted if we set hive.exec.stagingdir under the table directory. JIRA Issue:

spark git commit: [SPARK-20594][SQL] The staging directory should be a child directory starts with "." to avoid being deleted if we set hive.exec.stagingdir under the table directory.

2017-05-12 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 f14246959 -> d99165b97 [SPARK-20594][SQL] The staging directory should be a child directory starts with "." to avoid being deleted if we set hive.exec.stagingdir under the table directory. JIRA Issue:

spark git commit: [SPARK-20714][SS] Fix match error when watermark is set with timeout = no timeout / processing timeout

2017-05-12 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.2 7123ec8e1 -> f14246959 [SPARK-20714][SS] Fix match error when watermark is set with timeout = no timeout / processing timeout ## What changes were proposed in this pull request? When watermark is set, and timeout conf is NoTimeout or

spark git commit: [SPARK-20714][SS] Fix match error when watermark is set with timeout = no timeout / processing timeout

2017-05-12 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 7d6ff3910 -> 0d3a63193 [SPARK-20714][SS] Fix match error when watermark is set with timeout = no timeout / processing timeout ## What changes were proposed in this pull request? When watermark is set, and timeout conf is NoTimeout or

spark git commit: [SPARK-20702][CORE] TaskContextImpl.markTaskCompleted should not hide the original error

2017-05-12 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master b526f70c1 -> 7d6ff3910 [SPARK-20702][CORE] TaskContextImpl.markTaskCompleted should not hide the original error ## What changes were proposed in this pull request? This PR adds an `error` parameter to `TaskContextImpl.markTaskCompleted`

spark git commit: [SPARK-20702][CORE] TaskContextImpl.markTaskCompleted should not hide the original error

2017-05-12 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.2 eed3a5aa1 -> 7123ec8e1 [SPARK-20702][CORE] TaskContextImpl.markTaskCompleted should not hide the original error ## What changes were proposed in this pull request? This PR adds an `error` parameter to

spark git commit: [SPARK-19951][SQL] Add string concatenate operator || to Spark SQL

2017-05-12 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 92ea7fd7b -> b526f70c1 [SPARK-19951][SQL] Add string concatenate operator || to Spark SQL ## What changes were proposed in this pull request? This pr added code to support `||` for string concatenation. This string operation is supported

spark git commit: [SPARK-20710][SQL] Support aliases in CUBE/ROLLUP/GROUPING SETS

2017-05-12 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 18725f566 -> eed3a5aa1 [SPARK-20710][SQL] Support aliases in CUBE/ROLLUP/GROUPING SETS ## What changes were proposed in this pull request? This pr added `Analyzer` code for supporting aliases in CUBE/ROLLUP/GROUPING SETS (This is

spark git commit: [SPARK-20710][SQL] Support aliases in CUBE/ROLLUP/GROUPING SETS

2017-05-12 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 54b4f2ad4 -> 92ea7fd7b [SPARK-20710][SQL] Support aliases in CUBE/ROLLUP/GROUPING SETS ## What changes were proposed in this pull request? This pr added `Analyzer` code for supporting aliases in CUBE/ROLLUP/GROUPING SETS (This is

spark git commit: [SPARK-20718][SQL][FOLLOWUP] Fix canonicalization for HiveTableScanExec

2017-05-12 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 10b724436 -> 18725f566 [SPARK-20718][SQL][FOLLOWUP] Fix canonicalization for HiveTableScanExec ## What changes were proposed in this pull request? Fix canonicalization for different filter orders in `HiveTableScanExec`. ## How was

spark git commit: [SPARK-20718][SQL][FOLLOWUP] Fix canonicalization for HiveTableScanExec

2017-05-12 Thread wenchen
Repository: spark Updated Branches: refs/heads/master b23693390 -> 54b4f2ad4 [SPARK-20718][SQL][FOLLOWUP] Fix canonicalization for HiveTableScanExec ## What changes were proposed in this pull request? Fix canonicalization for different filter orders in `HiveTableScanExec`. ## How was this

spark git commit: [SPARK-17424] Fix unsound substitution bug in ScalaReflection.

2017-05-12 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.1 6e89d5740 -> 95de4672e [SPARK-17424] Fix unsound substitution bug in ScalaReflection. ## What changes were proposed in this pull request? This method gets a type's primary constructor and fills in type parameters with concrete types.

spark git commit: [SPARK-17424] Fix unsound substitution bug in ScalaReflection.

2017-05-12 Thread wenchen
Repository: spark Updated Branches: refs/heads/master fc8a2b6ee -> b23693390 [SPARK-17424] Fix unsound substitution bug in ScalaReflection. ## What changes were proposed in this pull request? This method gets a type's primary constructor and fills in type parameters with concrete types. For

spark git commit: [SPARK-20554][BUILD] Remove usage of scala.language.reflectiveCalls

2017-05-12 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 c1e5ac267 -> 21764f8d1 [SPARK-20554][BUILD] Remove usage of scala.language.reflectiveCalls ## What changes were proposed in this pull request? Remove uses of scala.language.reflectiveCalls that are either unnecessary or probably

spark git commit: [SPARK-20554][BUILD] Remove usage of scala.language.reflectiveCalls

2017-05-12 Thread srowen
Repository: spark Updated Branches: refs/heads/master 720708ccd -> fc8a2b6ee [SPARK-20554][BUILD] Remove usage of scala.language.reflectiveCalls ## What changes were proposed in this pull request? Remove uses of scala.language.reflectiveCalls that are either unnecessary or probably

spark git commit: [SPARK-20639][SQL] Add single argument support for to_timestamp in SQL with documentation improvement

2017-05-12 Thread wenchen
Repository: spark Updated Branches: refs/heads/master af40bb115 -> 720708ccd [SPARK-20639][SQL] Add single argument support for to_timestamp in SQL with documentation improvement ## What changes were proposed in this pull request? This PR proposes three things as below: - Use casting rules

spark git commit: [SPARK-20619][ML] StringIndexer supports multiple ways to order label

2017-05-12 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 888b84abe -> af40bb115 [SPARK-20619][ML] StringIndexer supports multiple ways to order label ## What changes were proposed in this pull request? StringIndexer maps labels to numbers according to the descending order of label frequency.

spark git commit: [SPARK-20704][SPARKR] change CRAN test to run single thread

2017-05-12 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 a8d981dc5 -> c1e5ac267 [SPARK-20704][SPARKR] change CRAN test to run single thread ## What changes were proposed in this pull request? - [x] need to test by running R CMD check --as-cran - [x] sanity check vignettes ## How was this

spark git commit: [SPARK-20704][SPARKR] change CRAN test to run single thread

2017-05-12 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master c8da53560 -> 888b84abe [SPARK-20704][SPARKR] change CRAN test to run single thread ## What changes were proposed in this pull request? - [x] need to test by running R CMD check --as-cran - [x] sanity check vignettes ## How was this patch