spark git commit: [SPARK-16546][SQL][PYSPARK] update python dataframe.drop

2016-07-14 Thread rxin
Repository: spark Updated Branches: refs/heads/master 2e4075e2e -> 183242382 [SPARK-16546][SQL][PYSPARK] update python dataframe.drop ## What changes were proposed in this pull request? Make `dataframe.drop` API in python support multi-columns parameters, so that it is the same with scala

spark git commit: [SPARK-16557][SQL] Remove stale doc in sql/README.md

2016-07-14 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 aa4690b1b -> c5f935582 [SPARK-16557][SQL] Remove stale doc in sql/README.md ## What changes were proposed in this pull request? Most of the documentation in https://github.com/apache/spark/blob/master/sql/README.md is stale. It would

spark git commit: [SPARK-16557][SQL] Remove stale doc in sql/README.md

2016-07-14 Thread rxin
Repository: spark Updated Branches: refs/heads/master 972673aca -> 2e4075e2e [SPARK-16557][SQL] Remove stale doc in sql/README.md ## What changes were proposed in this pull request? Most of the documentation in https://github.com/apache/spark/blob/master/sql/README.md is stale. It would be

spark git commit: [SPARK-16555] Work around Jekyll error-handling bug which led to silent failures

2016-07-14 Thread rxin
Repository: spark Updated Branches: refs/heads/master 01c4c1fa5 -> 972673aca [SPARK-16555] Work around Jekyll error-handling bug which led to silent failures If a custom Jekyll template tag throws Ruby's equivalent of a "file not found" exception, then Jekyll will stop the doc building

spark git commit: [SPARK-16555] Work around Jekyll error-handling bug which led to silent failures

2016-07-14 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 5c56bc00c -> aa4690b1b [SPARK-16555] Work around Jekyll error-handling bug which led to silent failures If a custom Jekyll template tag throws Ruby's equivalent of a "file not found" exception, then Jekyll will stop the doc building

spark git commit: [SPARK-16553][DOCS] Fix SQL example file name in docs

2016-07-14 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 1fe0bcdd0 -> 5c56bc00c [SPARK-16553][DOCS] Fix SQL example file name in docs ## What changes were proposed in this pull request? Fixes a typo in the sql programming guide ## How was this patch tested? Building docs locally (If this

spark git commit: [SPARK-16313][SQL][BRANCH-1.6] Spark should not silently drop exceptions in file listing

2016-07-14 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.6 4381e2121 -> 6ea7d4bd3 [SPARK-16313][SQL][BRANCH-1.6] Spark should not silently drop exceptions in file listing ## What changes were proposed in this pull request? Spark silently drops exceptions during file listing. This is a very

spark git commit: [SPARK-16540][YARN][CORE] Avoid adding jars twice for Spark running on yarn

2016-07-14 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 31ca741ae -> 91575cac3 [SPARK-16540][YARN][CORE] Avoid adding jars twice for Spark running on yarn ## What changes were proposed in this pull request? Currently when running spark on yarn, jars specified with --jars, --packages will be

spark git commit: [SPARK-16540][YARN][CORE] Avoid adding jars twice for Spark running on yarn

2016-07-14 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.0 23e1ab9c7 -> 1fe0bcdd0 [SPARK-16540][YARN][CORE] Avoid adding jars twice for Spark running on yarn ## What changes were proposed in this pull request? Currently when running spark on yarn, jars specified with --jars, --packages will

spark git commit: [SPARK-16528][SQL] Fix NPE problem in HiveClientImpl

2016-07-14 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 741801921 -> 23e1ab9c7 [SPARK-16528][SQL] Fix NPE problem in HiveClientImpl ## What changes were proposed in this pull request? There are some calls to methods or fields (getParameters, properties) which are then passed to Java/Scala

spark git commit: [SPARK-16528][SQL] Fix NPE problem in HiveClientImpl

2016-07-14 Thread rxin
Repository: spark Updated Branches: refs/heads/master c576f9fb9 -> 31ca741ae [SPARK-16528][SQL] Fix NPE problem in HiveClientImpl ## What changes were proposed in this pull request? There are some calls to methods or fields (getParameters, properties) which are then passed to Java/Scala

[1/2] spark git commit: Preparing Spark release v2.0.0-rc4

2016-07-14 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-2.0 29281bc40 -> 0a651aa26 Preparing Spark release v2.0.0-rc4 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e5f8c111 Tree:

[2/2] spark git commit: Preparing development version 2.0.1-SNAPSHOT

2016-07-14 Thread pwendell
Preparing development version 2.0.1-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/0a651aa2 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/0a651aa2 Diff:

spark git commit: [SPARK-16529][SQL][TEST] `withTempDatabase` should set `default` database before dropping

2016-07-14 Thread lian
Repository: spark Updated Branches: refs/heads/branch-2.0 0a651aa26 -> 741801921 [SPARK-16529][SQL][TEST] `withTempDatabase` should set `default` database before dropping ## What changes were proposed in this pull request? `SQLTestUtils.withTempDatabase` is a frequently used test harness to

spark git commit: [SPARK-16529][SQL][TEST] `withTempDatabase` should set `default` database before dropping

2016-07-14 Thread lian
Repository: spark Updated Branches: refs/heads/master 12005c88f -> c576f9fb9 [SPARK-16529][SQL][TEST] `withTempDatabase` should set `default` database before dropping ## What changes were proposed in this pull request? `SQLTestUtils.withTempDatabase` is a frequently used test harness to

[spark] Git Push Summary

2016-07-14 Thread pwendell
Repository: spark Updated Tags: refs/tags/v2.0.0-rc4 [created] e5f8c1117 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-16538][SPARKR] fix R call with namespace operator on SparkSession functions

2016-07-14 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 093ebbc62 -> 12005c88f [SPARK-16538][SPARKR] fix R call with namespace operator on SparkSession functions ## What changes were proposed in this pull request? Fix function routing to work with and without namespace operator

spark git commit: [SPARK-16538][SPARKR] fix R call with namespace operator on SparkSession functions

2016-07-14 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 4e9080f44 -> 29281bc40 [SPARK-16538][SPARKR] fix R call with namespace operator on SparkSession functions ## What changes were proposed in this pull request? Fix function routing to work with and without namespace operator

spark git commit: [SPARK-16509][SPARKR] Rename window.partitionBy and window.orderBy to windowPartitionBy and windowOrderBy.

2016-07-14 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 56183b84f -> 093ebbc62 [SPARK-16509][SPARKR] Rename window.partitionBy and window.orderBy to windowPartitionBy and windowOrderBy. ## What changes were proposed in this pull request? Rename window.partitionBy and window.orderBy to

spark git commit: [SPARK-16543][SQL] Rename the columns of `SHOW PARTITION/COLUMNS` commands

2016-07-14 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 1b5c9e52a -> 56183b84f [SPARK-16543][SQL] Rename the columns of `SHOW PARTITION/COLUMNS` commands ## What changes were proposed in this pull request? This PR changes the name of columns returned by `SHOW PARTITION` and `SHOW COLUMNS`

spark git commit: [SPARK-16530][SQL][TRIVIAL] Wrong Parser Keyword in ALTER TABLE CHANGE COLUMN

2016-07-14 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master b7b5e1787 -> 1b5c9e52a [SPARK-16530][SQL][TRIVIAL] Wrong Parser Keyword in ALTER TABLE CHANGE COLUMN What changes were proposed in this pull request? Based on the [Hive SQL

spark git commit: [SPARK-16505][YARN] Optionally propagate error during shuffle service startup.

2016-07-14 Thread tgraves
Repository: spark Updated Branches: refs/heads/master c4bc2ed84 -> b7b5e1787 [SPARK-16505][YARN] Optionally propagate error during shuffle service startup. This prevents the NM from starting when something is wrong, which would lead to later errors which are confusing and harder to debug.

spark git commit: [SPARK-14963][MINOR][YARN] Fix typo in YarnShuffleService recovery file name

2016-07-14 Thread tgraves
Repository: spark Updated Branches: refs/heads/master e3f8a0336 -> c4bc2ed84 [SPARK-14963][MINOR][YARN] Fix typo in YarnShuffleService recovery file name ## What changes were proposed in this pull request? Due to the changes of

spark git commit: [SPARK-16403][EXAMPLES] Cleanup to remove unused imports, consistent style, minor fixes

2016-07-14 Thread srowen
Repository: spark Updated Branches: refs/heads/master 252d4f27f -> e3f8a0336 [SPARK-16403][EXAMPLES] Cleanup to remove unused imports, consistent style, minor fixes ## What changes were proposed in this pull request? Cleanup of examples, mostly from PySpark-ML to fix minor issues: unused

spark git commit: [SPARK-16500][ML][MLLIB][OPTIMIZER] add LBFGS convergence warning for all used place in MLLib

2016-07-14 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 b3ebecbb7 -> 240c42b28 [SPARK-16500][ML][MLLIB][OPTIMIZER] add LBFGS convergence warning for all used place in MLLib ## What changes were proposed in this pull request? Add warning_for the following case when LBFGS training not

spark git commit: [SPARK-16448] RemoveAliasOnlyProject should not remove alias with metadata

2016-07-14 Thread lian
Repository: spark Updated Branches: refs/heads/master 39c836e97 -> db7317ac3 [SPARK-16448] RemoveAliasOnlyProject should not remove alias with metadata ## What changes were proposed in this pull request? `Alias` with metadata is not a no-op and we should not strip it in