spark git commit: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-30 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.2 287440df6 -> 3cad66e5e [SPARK-20877][SPARKR][WIP] add timestamps to test runs to investigate how long they run Jenkins, AppVeyor Author: Felix Cheung Closes #18104 from felixcheung/rtimetest. (cherry

spark git commit: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-30 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 1f5dddffa -> 382fefd18 [SPARK-20877][SPARKR][WIP] add timestamps to test runs ## What changes were proposed in this pull request? to investigate how long they run ## How was this patch tested? Jenkins, AppVeyor Author: Felix Cheung

spark git commit: Revert "[SPARK-20392][SQL] Set barrier to prevent re-entering a tree"

2017-05-30 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 52ed9b289 -> 1f5dddffa Revert "[SPARK-20392][SQL] Set barrier to prevent re-entering a tree" This reverts commit 8ce0d8ffb68bd9e89c23d3a026308dcc039a1b1d. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-20275][UI] Do not display "Completed" column for in-progress applications

2017-05-30 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 5fdc7d80f -> 287440df6 [SPARK-20275][UI] Do not display "Completed" column for in-progress applications ## What changes were proposed in this pull request? Current HistoryServer will display completed date of in-progress application

spark git commit: [SPARK-20275][UI] Do not display "Completed" column for in-progress applications

2017-05-30 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.1 38f37c557 -> 46400867c [SPARK-20275][UI] Do not display "Completed" column for in-progress applications ## What changes were proposed in this pull request? Current HistoryServer will display completed date of in-progress application

spark git commit: [SPARK-20275][UI] Do not display "Completed" column for in-progress applications

2017-05-30 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 10e526e7e -> 52ed9b289 [SPARK-20275][UI] Do not display "Completed" column for in-progress applications ## What changes were proposed in this pull request? Current HistoryServer will display completed date of in-progress application as

spark git commit: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL UI tab

2017-05-30 Thread wenchen
Repository: spark Updated Branches: refs/heads/master fa757ee1d -> 10e526e7e [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL UI tab ## What changes were proposed in this pull request? Currently the `DataFrameWriter` operations have several problems: 1. non-file-format data source

[1/2] spark git commit: [SPARK-20883][SPARK-20376][SS] Refactored StateStore APIs and added conf to choose implementation

2017-05-30 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 4bb6a53eb -> fa757ee1d http://git-wip-us.apache.org/repos/asf/spark/blob/fa757ee1/sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/state/StateStoreSuite.scala

[2/2] spark git commit: [SPARK-20883][SPARK-20376][SS] Refactored StateStore APIs and added conf to choose implementation

2017-05-30 Thread zsxwing
[SPARK-20883][SPARK-20376][SS] Refactored StateStore APIs and added conf to choose implementation ## What changes were proposed in this pull request? A bunch of changes to the StateStore APIs and implementation. Current state store API has a bunch of problems that causes too many transient

spark git commit: [SPARK-20924][SQL] Unable to call the function registered in the not-current database

2017-05-30 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 f6730a70c -> 5fdc7d80f [SPARK-20924][SQL] Unable to call the function registered in the not-current database ### What changes were proposed in this pull request? We are unable to call the function registered in the not-current

spark git commit: [SPARK-20924][SQL] Unable to call the function registered in the not-current database

2017-05-30 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 798a04fd7 -> 4bb6a53eb [SPARK-20924][SQL] Unable to call the function registered in the not-current database ### What changes were proposed in this pull request? We are unable to call the function registered in the not-current database.

spark git commit: HOTFIX: fix Scalastyle break introduced in 4d57981cfb18e7500cde6c03ae46c7c9b697d064

2017-05-30 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master de953c214 -> 798a04fd7 HOTFIX: fix Scalastyle break introduced in 4d57981cfb18e7500cde6c03ae46c7c9b697d064 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/798a04fd

spark git commit: [SPARK-20333] HashPartitioner should be compatible with num of child RDD's partitions.

2017-05-30 Thread irashid
Repository: spark Updated Branches: refs/heads/master 4d57981cf -> de953c214 [SPARK-20333] HashPartitioner should be compatible with num of child RDD's partitions. ## What changes were proposed in this pull request? Fix test "don't submit stage until its dependencies map outputs are

spark git commit: [SPARK-19236][CORE] Added createOrReplaceGlobalTempView method

2017-05-30 Thread lixiao
Repository: spark Updated Branches: refs/heads/master ff5676b01 -> 4d57981cf [SPARK-19236][CORE] Added createOrReplaceGlobalTempView method ## What changes were proposed in this pull request? Added the createOrReplaceGlobalTempView method for dataset Author: Arman

spark git commit: [SPARK-20899][PYSPARK] PySpark supports stringIndexerOrderType in RFormula

2017-05-30 Thread yliang
Repository: spark Updated Branches: refs/heads/master 35b644bd0 -> ff5676b01 [SPARK-20899][PYSPARK] PySpark supports stringIndexerOrderType in RFormula ## What changes were proposed in this pull request? PySpark supports stringIndexerOrderType in RFormula as in #17967. ## How was this patch

spark git commit: [SPARK-20916][SQL] Improve error message for unaliased subqueries in FROM clause

2017-05-30 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 80fb24b85 -> 35b644bd0 [SPARK-20916][SQL] Improve error message for unaliased subqueries in FROM clause ## What changes were proposed in this pull request? We changed the parser to reject unaliased subqueries in the FROM clause in

spark git commit: [MINOR] Fix some indent issues.

2017-05-30 Thread srowen
Repository: spark Updated Branches: refs/heads/master d797ed0ef -> 80fb24b85 [MINOR] Fix some indent issues. ## What changes were proposed in this pull request? Fix some indent issues. ## How was this patch tested? existing tests. Author: Yuming Wang Closes #18133 from

spark git commit: [SPARK-20909][SQL] Add build-int SQL function - DAYOFWEEK

2017-05-30 Thread ueshin
Repository: spark Updated Branches: refs/heads/master 96a4d1d08 -> d797ed0ef [SPARK-20909][SQL] Add build-int SQL function - DAYOFWEEK ## What changes were proposed in this pull request? Add build-int SQL function - DAYOFWEEK ## How was this patch tested? unit tests Author: Yuming Wang