spark git commit: [SPARK-19824][CORE] Update JsonProtocol to keep consistent with the UI

2017-06-18 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 112bd9bfc -> ea542d29b [SPARK-19824][CORE] Update JsonProtocol to keep consistent with the UI ## What changes were proposed in this pull request? Fix any inconsistent part in JsonProtocol with the UI. This PR also contains the modification

spark git commit: [SPARK-21090][CORE] Optimize the unified memory manager code

2017-06-18 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 c0d4acce5 -> d3c79b77a [SPARK-21090][CORE] Optimize the unified memory manager code ## What changes were proposed in this pull request? 1.In `acquireStorageMemory`, when the Memory Mode is OFF_HEAP ,the `maxOffHeapMemory` should be mod

spark git commit: [SPARK-21090][CORE] Optimize the unified memory manager code

2017-06-18 Thread wenchen
Repository: spark Updated Branches: refs/heads/master f913f158e -> 112bd9bfc [SPARK-21090][CORE] Optimize the unified memory manager code ## What changes were proposed in this pull request? 1.In `acquireStorageMemory`, when the Memory Mode is OFF_HEAP ,the `maxOffHeapMemory` should be modifie

spark git commit: [SPARK-20948][SQL] Built-in SQL Function UnaryMinus/UnaryPositive support string type

2017-06-18 Thread lixiao
Repository: spark Updated Branches: refs/heads/master ce49428ef -> f913f158e [SPARK-20948][SQL] Built-in SQL Function UnaryMinus/UnaryPositive support string type ## What changes were proposed in this pull request? Built-in SQL Function UnaryMinus/UnaryPositive support string type, if it's

spark git commit: [SPARK-20749][SQL][FOLLOWUP] Support character_length

2017-06-18 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 110ce1f27 -> ce49428ef [SPARK-20749][SQL][FOLLOWUP] Support character_length ## What changes were proposed in this pull request? The function `char_length` is shorthand for `character_length` function. Both Hive and Postgresql support `ch

spark git commit: [SPARK-20892][SPARKR] Add SQL trunc function to SparkR

2017-06-18 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 05f83c532 -> 110ce1f27 [SPARK-20892][SPARKR] Add SQL trunc function to SparkR ## What changes were proposed in this pull request? Add SQL trunc function ## How was this patch tested? standard test Author: actuaryzhang Closes #18291 fro

spark git commit: [SPARK-21128][R] Remove both "spark-warehouse" and "metastore_db" before listing files in R tests

2017-06-18 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 75a6d0585 -> 05f83c532 [SPARK-21128][R] Remove both "spark-warehouse" and "metastore_db" before listing files in R tests ## What changes were proposed in this pull request? This PR proposes to list the files in test _after_ removing both

spark git commit: [MINOR][R] Add knitr and rmarkdown packages/improve output for version info in AppVeyor tests

2017-06-18 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 8747f8ef0 -> c0d4acce5 [MINOR][R] Add knitr and rmarkdown packages/improve output for version info in AppVeyor tests ## What changes were proposed in this pull request? This PR proposes three things as below: **Install packages per d

spark git commit: [MINOR][R] Add knitr and rmarkdown packages/improve output for version info in AppVeyor tests

2017-06-18 Thread srowen
Repository: spark Updated Branches: refs/heads/master 0d8604bb8 -> 75a6d0585 [MINOR][R] Add knitr and rmarkdown packages/improve output for version info in AppVeyor tests ## What changes were proposed in this pull request? This PR proposes three things as below: **Install packages per docum

spark git commit: [SPARK-21126] The configuration which named "spark.core.connection.auth.wait.timeout" hasn't been used in spark

2017-06-18 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 d3deeb35b -> 8747f8ef0 [SPARK-21126] The configuration which named "spark.core.connection.auth.wait.timeout" hasn't been used in spark [https://issues.apache.org/jira/browse/SPARK-21126](https://issues.apache.org/jira/browse/SPARK-2112

spark git commit: [SPARK-21126] The configuration which named "spark.core.connection.auth.wait.timeout" hasn't been used in spark

2017-06-18 Thread srowen
Repository: spark Updated Branches: refs/heads/master edcb878e2 -> 0d8604bb8 [SPARK-21126] The configuration which named "spark.core.connection.auth.wait.timeout" hasn't been used in spark [https://issues.apache.org/jira/browse/SPARK-21126](https://issues.apache.org/jira/browse/SPARK-21126) T