[1/3] spark-website git commit: Add 1.6.3 release.

2016-11-07 Thread rxin
Repository: spark-website Updated Branches: refs/heads/asf-site 24d32b75d -> b9aa4c3ee http://git-wip-us.apache.org/repos/asf/spark-website/blob/b9aa4c3e/site/releases/spark-release-1-2-1.html -- diff --git

[3/3] spark-website git commit: Add 1.6.3 release.

2016-11-07 Thread rxin
Add 1.6.3 release. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/b9aa4c3e Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/b9aa4c3e Diff:

[2/3] spark-website git commit: Add 1.6.3 release.

2016-11-07 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark-website/blob/b9aa4c3e/site/news/spark-2-0-0-released.html -- diff --git a/site/news/spark-2-0-0-released.html b/site/news/spark-2-0-0-released.html index dd2f3e8..070d5ac 100644 ---

spark git commit: [SPARK-16575][CORE] partition calculation mismatch with sc.binaryFiles

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 4cb4e5ff0 -> c8879bf1e [SPARK-16575][CORE] partition calculation mismatch with sc.binaryFiles ## What changes were proposed in this pull request? This Pull request comprises of the critical bug SPARK-16575 changes. This change

spark git commit: [SPARK-16575][CORE] partition calculation mismatch with sc.binaryFiles

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master 1da64e1fa -> 6f3697136 [SPARK-16575][CORE] partition calculation mismatch with sc.binaryFiles ## What changes were proposed in this pull request? This Pull request comprises of the critical bug SPARK-16575 changes. This change rectifies

spark git commit: [SPARK-18217][SQL] Disallow creating permanent views based on temporary views or UDFs

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master c1a0c66bd -> 1da64e1fa [SPARK-18217][SQL] Disallow creating permanent views based on temporary views or UDFs ### What changes were proposed in this pull request? Based on the discussion in

spark git commit: [SPARK-18217][SQL] Disallow creating permanent views based on temporary views or UDFs

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 4943929d8 -> 4cb4e5ff0 [SPARK-18217][SQL] Disallow creating permanent views based on temporary views or UDFs ### What changes were proposed in this pull request? Based on the discussion in

spark git commit: [SPARK-18261][STRUCTURED STREAMING] Add statistics to MemorySink for joining

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 29f59c733 -> 4943929d8 [SPARK-18261][STRUCTURED STREAMING] Add statistics to MemorySink for joining ## What changes were proposed in this pull request? Right now, there is no way to join the output of a memory sink with any table: >

spark git commit: [SPARK-18261][STRUCTURED STREAMING] Add statistics to MemorySink for joining

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master 9b0593d5e -> c1a0c66bd [SPARK-18261][STRUCTURED STREAMING] Add statistics to MemorySink for joining ## What changes were proposed in this pull request? Right now, there is no way to join the output of a memory sink with any table: >

spark git commit: [SPARK-18086] Add support for Hive session vars.

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 4af82d56f -> 29f59c733 [SPARK-18086] Add support for Hive session vars. ## What changes were proposed in this pull request? This adds support for Hive variables: * Makes values set via `spark-sql --hivevar name=value` accessible *

spark git commit: [SPARK-18086] Add support for Hive session vars.

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master 3eda05703 -> 9b0593d5e [SPARK-18086] Add support for Hive session vars. ## What changes were proposed in this pull request? This adds support for Hive variables: * Makes values set via `spark-sql --hivevar name=value` accessible * Adds

spark git commit: [SPARK-18295][SQL] Make to_json function null safe (matching it to from_json)

2016-11-07 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-2.1 9873d57f2 -> 4af82d56f [SPARK-18295][SQL] Make to_json function null safe (matching it to from_json) ## What changes were proposed in this pull request? This PR proposes to match up the behaviour of `to_json` to `from_json` function

spark git commit: [SPARK-18295][SQL] Make to_json function null safe (matching it to from_json)

2016-11-07 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 3a710b94b -> 3eda05703 [SPARK-18295][SQL] Make to_json function null safe (matching it to from_json) ## What changes were proposed in this pull request? This PR proposes to match up the behaviour of `to_json` to `from_json` function for

spark git commit: [SPARK-18236] Reduce duplicate objects in Spark UI and HistoryServer

2016-11-07 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 19cf20806 -> 3a710b94b [SPARK-18236] Reduce duplicate objects in Spark UI and HistoryServer ## What changes were proposed in this pull request? When profiling heap dumps from the HistoryServer and live Spark web UIs, I found a large

spark git commit: [SPARK-17490][SQL] Optimize SerializeFromObject() for a primitive array

2016-11-07 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.1 d1eac3ef4 -> 9873d57f2 [SPARK-17490][SQL] Optimize SerializeFromObject() for a primitive array Waiting for merging #13680 This PR optimizes `SerializeFromObject()` for an primitive array. This is derived from #13758 to address one of

spark git commit: [SPARK-17490][SQL] Optimize SerializeFromObject() for a primitive array

2016-11-07 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 8f0ea011a -> 19cf20806 [SPARK-17490][SQL] Optimize SerializeFromObject() for a primitive array ## What changes were proposed in this pull request? Waiting for merging #13680 This PR optimizes `SerializeFromObject()` for an primitive

spark git commit: [SPARK-14914][CORE] Fix Resource not closed after using, mostly for unit tests

2016-11-07 Thread mridulm80
Repository: spark Updated Branches: refs/heads/master 0d95662e7 -> 8f0ea011a [SPARK-14914][CORE] Fix Resource not closed after using, mostly for unit tests ## What changes were proposed in this pull request? Close `FileStreams`, `ZipFiles` etc to release the resources after using. Not

spark git commit: [SPARK-17108][SQL] Fix BIGINT and INT comparison failure in spark sql

2016-11-07 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master b06c23db9 -> 0d95662e7 [SPARK-17108][SQL] Fix BIGINT and INT comparison failure in spark sql ## What changes were proposed in this pull request? Add a function to check if two integers are compatible when invoking `acceptsType()` in

spark git commit: [SPARK-17108][SQL] Fix BIGINT and INT comparison failure in spark sql

2016-11-07 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.1 7a84edb24 -> d1eac3ef4 [SPARK-17108][SQL] Fix BIGINT and INT comparison failure in spark sql ## What changes were proposed in this pull request? Add a function to check if two integers are compatible when invoking `acceptsType()` in

[1/2] spark git commit: Preparing Spark release v2.0.2-rc3

2016-11-07 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-2.0 10525c294 -> a39f8c101 Preparing Spark release v2.0.2-rc3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/584354ea Tree:

[2/2] spark git commit: Preparing development version 2.0.3-SNAPSHOT

2016-11-07 Thread pwendell
Preparing development version 2.0.3-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a39f8c10 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/a39f8c10 Diff:

[spark] Git Push Summary

2016-11-07 Thread pwendell
Repository: spark Updated Tags: refs/tags/v2.0.2-rc3 [created] 584354eaa - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-18283][STRUCTURED STREAMING][KAFKA] Added test to check whether default starting offset in latest

2016-11-07 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.0 b5d7217af -> 10525c294 [SPARK-18283][STRUCTURED STREAMING][KAFKA] Added test to check whether default starting offset in latest ## What changes were proposed in this pull request? Added test to check whether default starting offset

spark git commit: [SPARK-18283][STRUCTURED STREAMING][KAFKA] Added test to check whether default starting offset in latest

2016-11-07 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master daa975f4b -> b06c23db9 [SPARK-18283][STRUCTURED STREAMING][KAFKA] Added test to check whether default starting offset in latest ## What changes were proposed in this pull request? Added test to check whether default starting offset in

spark git commit: [SPARK-18283][STRUCTURED STREAMING][KAFKA] Added test to check whether default starting offset in latest

2016-11-07 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 6b332909f -> 7a84edb24 [SPARK-18283][STRUCTURED STREAMING][KAFKA] Added test to check whether default starting offset in latest ## What changes were proposed in this pull request? Added test to check whether default starting offset

spark git commit: [SPARK-18125][SQL][BRANCH-2.0] Fix a compilation error in codegen due to splitExpression

2016-11-07 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.0 dd5cb0a98 -> b5d7217af [SPARK-18125][SQL][BRANCH-2.0] Fix a compilation error in codegen due to splitExpression ## What changes were proposed in this pull request? Backport to branch 2.0. As reported in the jira, sometimes the

spark git commit: [SPARK-18291][SPARKR][ML] SparkR glm predict should output original label when family = binomial.

2016-11-07 Thread yliang
Repository: spark Updated Branches: refs/heads/branch-2.1 df40ee2b4 -> 6b332909f [SPARK-18291][SPARKR][ML] SparkR glm predict should output original label when family = binomial. ## What changes were proposed in this pull request? SparkR ```spark.glm``` predict should output original label

spark git commit: [SPARK-18291][SPARKR][ML] SparkR glm predict should output original label when family = binomial.

2016-11-07 Thread yliang
Repository: spark Updated Branches: refs/heads/master a814eeac6 -> daa975f4b [SPARK-18291][SPARKR][ML] SparkR glm predict should output original label when family = binomial. ## What changes were proposed in this pull request? SparkR ```spark.glm``` predict should output original label when

spark git commit: [SPARK-18125][SQL] Fix a compilation error in codegen due to splitExpression

2016-11-07 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.1 410102957 -> df40ee2b4 [SPARK-18125][SQL] Fix a compilation error in codegen due to splitExpression ## What changes were proposed in this pull request? As reported in the jira, sometimes the generated java code in codegen will cause

spark git commit: [SPARK-18125][SQL] Fix a compilation error in codegen due to splitExpression

2016-11-07 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 57626a557 -> a814eeac6 [SPARK-18125][SQL] Fix a compilation error in codegen due to splitExpression ## What changes were proposed in this pull request? As reported in the jira, sometimes the generated java code in codegen will cause

spark git commit: [SPARK-16904][SQL] Removal of Hive Built-in Hash Functions and TestHiveFunctionRegistry

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 2fa1a632a -> 410102957 [SPARK-16904][SQL] Removal of Hive Built-in Hash Functions and TestHiveFunctionRegistry ### What changes were proposed in this pull request? Currently, the Hive built-in `hash` function is not being used in

spark git commit: [SPARK-16904][SQL] Removal of Hive Built-in Hash Functions and TestHiveFunctionRegistry

2016-11-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master 9db06c442 -> 57626a557 [SPARK-16904][SQL] Removal of Hive Built-in Hash Functions and TestHiveFunctionRegistry ### What changes were proposed in this pull request? Currently, the Hive built-in `hash` function is not being used in Spark