spark git commit: [SPARK-16286][SQL] Implement stack table generating function

2016-07-05 Thread wenchen
Repository: spark Updated Branches: refs/heads/master fdde7d0aa -> d0d28507c [SPARK-16286][SQL] Implement stack table generating function ## What changes were proposed in this pull request? This PR implements `stack` table generating function. ## How was this patch tested? Pass the Jenkins

[spark] Git Push Summary

2016-07-05 Thread pwendell
Repository: spark Updated Tags: refs/tags/v2.0.0-rc2 [created] 4a55b2326 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 2.0.1-SNAPSHOT

2016-07-05 Thread pwendell
Preparing development version 2.0.1-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/6e8fa86e Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/6e8fa86e Diff:

[1/2] spark git commit: Preparing Spark release v2.0.0-rc2

2016-07-05 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-2.0 0fe2a8c16 -> 6e8fa86eb Preparing Spark release v2.0.0-rc2 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4a55b232 Tree:

spark git commit: [SPARK-16348][ML][MLLIB][PYTHON] Use full classpaths for pyspark ML JVM calls

2016-07-05 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-2.0 a2ef13a7d -> 0fe2a8c16 [SPARK-16348][ML][MLLIB][PYTHON] Use full classpaths for pyspark ML JVM calls ## What changes were proposed in this pull request? Issue: Omitting the full classpath can cause problems when calling JVM methods

spark git commit: [SPARK-16348][ML][MLLIB][PYTHON] Use full classpaths for pyspark ML JVM calls

2016-07-05 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 59f9c1bd1 -> fdde7d0aa [SPARK-16348][ML][MLLIB][PYTHON] Use full classpaths for pyspark ML JVM calls ## What changes were proposed in this pull request? Issue: Omitting the full classpath can cause problems when calling JVM methods or

spark git commit: [SPARK-16385][CORE] Catch correct exception when calling method via reflection.

2016-07-05 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 4db63fd2b -> 59f9c1bd1 [SPARK-16385][CORE] Catch correct exception when calling method via reflection. Using "Method.invoke" causes an exception to be thrown, not an error, so Utils.waitForProcess() was always throwing an exception when

spark git commit: [SPARK-16385][CORE] Catch correct exception when calling method via reflection.

2016-07-05 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.0 801fb7994 -> a2ef13a7d [SPARK-16385][CORE] Catch correct exception when calling method via reflection. Using "Method.invoke" causes an exception to be thrown, not an error, so Utils.waitForProcess() was always throwing an exception

spark git commit: [SPARK-16383][SQL] Remove `SessionState.executeSql`

2016-07-05 Thread rxin
Repository: spark Updated Branches: refs/heads/master 1f0d02130 -> 4db63fd2b [SPARK-16383][SQL] Remove `SessionState.executeSql` ## What changes were proposed in this pull request? This PR removes `SessionState.executeSql` in favor of `SparkSession.sql`. We can remove this safely since the

spark git commit: [SPARK-16359][STREAMING][KAFKA] unidoc skip kafka 0.10

2016-07-05 Thread tdas
Repository: spark Updated Branches: refs/heads/master 920cb5fe4 -> 1f0d02130 [SPARK-16359][STREAMING][KAFKA] unidoc skip kafka 0.10 ## What changes were proposed in this pull request? during sbt unidoc task, skip the streamingKafka010 subproject and filter kafka 0.10 classes from the

spark git commit: [SPARK-16359][STREAMING][KAFKA] unidoc skip kafka 0.10

2016-07-05 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-2.0 9c1596b6c -> 801fb7994 [SPARK-16359][STREAMING][KAFKA] unidoc skip kafka 0.10 ## What changes were proposed in this pull request? during sbt unidoc task, skip the streamingKafka010 subproject and filter kafka 0.10 classes from the

spark git commit: [SPARK-15730][SQL] Respect the --hiveconf in the spark-sql command line

2016-07-05 Thread rxin
Repository: spark Updated Branches: refs/heads/master 5b7a1770a -> 920cb5fe4 [SPARK-15730][SQL] Respect the --hiveconf in the spark-sql command line ## What changes were proposed in this pull request? This PR makes spark-sql (backed by SparkSQLCLIDriver) respects confs set by hiveconf, which

spark git commit: [SPARK-15730][SQL] Respect the --hiveconf in the spark-sql command line

2016-07-05 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 cabee2324 -> 9c1596b6c [SPARK-15730][SQL] Respect the --hiveconf in the spark-sql command line ## What changes were proposed in this pull request? This PR makes spark-sql (backed by SparkSQLCLIDriver) respects confs set by hiveconf,

spark git commit: [HOTFIX] Fix build break.

2016-07-05 Thread rxin
Repository: spark Updated Branches: refs/heads/master 1fca9da95 -> 5b7a1770a [HOTFIX] Fix build break. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/5b7a1770 Tree:

spark git commit: [SPARK-16212][STREAMING][KAFKA] use random port for embedded kafka

2016-07-05 Thread tdas
Repository: spark Updated Branches: refs/heads/master 16a2a7d71 -> 1fca9da95 [SPARK-16212][STREAMING][KAFKA] use random port for embedded kafka ## What changes were proposed in this pull request? Testing for 0.10 uncovered an issue with a fixed port number being used in KafkaTestUtils.

spark git commit: [SPARK-16212][STREAMING][KAFKA] use random port for embedded kafka

2016-07-05 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-2.0 0754ccb2b -> cabee2324 [SPARK-16212][STREAMING][KAFKA] use random port for embedded kafka ## What changes were proposed in this pull request? Testing for 0.10 uncovered an issue with a fixed port number being used in KafkaTestUtils.

spark git commit: [SPARK-16311][SQL] Metadata refresh should work on temporary views

2016-07-05 Thread rxin
Repository: spark Updated Branches: refs/heads/master 07d9c5327 -> 16a2a7d71 [SPARK-16311][SQL] Metadata refresh should work on temporary views ## What changes were proposed in this pull request? This patch fixes the bug that the refresh command does not work on temporary views. This patch

spark git commit: [SPARK-16311][SQL] Metadata refresh should work on temporary views

2016-07-05 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 cc100ab54 -> 0754ccb2b [SPARK-16311][SQL] Metadata refresh should work on temporary views ## What changes were proposed in this pull request? This patch fixes the bug that the refresh command does not work on temporary views. This

spark git commit: [SPARK-9876][SQL][FOLLOWUP] Enable string and binary tests for Parquet predicate pushdown and replace deprecated fromByteArray.

2016-07-05 Thread lian
Repository: spark Updated Branches: refs/heads/master 7f7eb3934 -> 07d9c5327 [SPARK-9876][SQL][FOLLOWUP] Enable string and binary tests for Parquet predicate pushdown and replace deprecated fromByteArray. ## What changes were proposed in this pull request? It seems Parquet has been upgraded

spark git commit: [SPARK-16360][SQL] Speed up SQL query performance by removing redundant `executePlan` call

2016-07-05 Thread lian
Repository: spark Updated Branches: refs/heads/master 7742d9f15 -> 7f7eb3934 [SPARK-16360][SQL] Speed up SQL query performance by removing redundant `executePlan` call ## What changes were proposed in this pull request? Currently, there are a few reports about Spark 2.0 query performance

spark git commit: [SPARK-15198][SQL] Support for pushing down filters for boolean types in ORC data source

2016-07-05 Thread lian
Repository: spark Updated Branches: refs/heads/master 8f6cf00c6 -> 7742d9f15 [SPARK-15198][SQL] Support for pushing down filters for boolean types in ORC data source ## What changes were proposed in this pull request? It seems ORC supports all the types in