spark git commit: Small update in the readme file

2015-07-06 Thread rxin
Repository: spark Updated Branches: refs/heads/master 0e194645f - 57c72fcce Small update in the readme file Just change the attribute from -PsparkR to -Psparkr Author: Dirceu Semighini Filho dirceu.semigh...@gmail.com Closes #7242 from dirceusemighini/patch-1 and squashes the following

spark git commit: [SPARK-8784] [SQL] Add Python API for hex and unhex

2015-07-06 Thread rxin
Repository: spark Updated Branches: refs/heads/master 57c72fcce - 37e4d9214 [SPARK-8784] [SQL] Add Python API for hex and unhex Add Python API for hex/unhex, also cleanup Hex/Unhex Author: Davies Liu dav...@databricks.com Closes #7223 from davies/hex and squashes the following commits:

spark git commit: [SPARK-4485] [SQL] 1) Add broadcast hash outer join, (2) Fix SparkPlanTest

2015-07-06 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 37e4d9214 - 2471c0bf7 [SPARK-4485] [SQL] 1) Add broadcast hash outer join, (2) Fix SparkPlanTest This pull request (1) extracts common functions used by hash outer joins and put it in interface HashOuterJoin (2) adds ShuffledHashOuterJoin

spark git commit: [SPARK-8841] [SQL] Fix partition pruning percentage log message

2015-07-06 Thread lian
Repository: spark Updated Branches: refs/heads/master 86768b7b3 - 39e4e7e4d [SPARK-8841] [SQL] Fix partition pruning percentage log message When pruning partitions for a query plan, a message is logged indicating what how many partitions were selected based on predicate criteria, and what

spark git commit: [SPARK-8765] [MLLIB] Fix PySpark PowerIterationClustering test issue

2015-07-06 Thread meng
Repository: spark Updated Branches: refs/heads/master 96c5eeec3 - 0effe180f [SPARK-8765] [MLLIB] Fix PySpark PowerIterationClustering test issue PySpark PowerIterationClustering test failure due to bad demo data. If the data is small, PowerIterationClustering will behavior indeterministic.

spark git commit: [SPARK-8463][SQL] Use DriverRegistry to load jdbc driver at writing path

2015-07-06 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 e990561ce - 4d813833d [SPARK-8463][SQL] Use DriverRegistry to load jdbc driver at writing path JIRA: https://issues.apache.org/jira/browse/SPARK-8463 Currently, at the reading path, `DriverRegistry` is used to load needed jdbc driver

spark git commit: [SPARK-8463][SQL] Use DriverRegistry to load jdbc driver at writing path

2015-07-06 Thread rxin
Repository: spark Updated Branches: refs/heads/master 09a06418d - d4d6d31db [SPARK-8463][SQL] Use DriverRegistry to load jdbc driver at writing path JIRA: https://issues.apache.org/jira/browse/SPARK-8463 Currently, at the reading path, `DriverRegistry` is used to load needed jdbc driver at

spark git commit: [SPARK-6707] [CORE] [MESOS] Mesos Scheduler should allow the user to specify constraints based on slave attributes

2015-07-06 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 9ff203346 - 1165b17d2 [SPARK-6707] [CORE] [MESOS] Mesos Scheduler should allow the user to specify constraints based on slave attributes Currently, the mesos scheduler only looks at the 'cpu' and 'mem' resources when trying to determine

spark git commit: [SPARK-8656] [WEBUI] Fix the webUI and JSON API number is not synced

2015-07-06 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 132e7fca1 - 9ff203346 [SPARK-8656] [WEBUI] Fix the webUI and JSON API number is not synced Spark standalone master web UI show Alive Workers total core, total used cores and Alive workers total memory, memory used. But the JSON API page

spark git commit: [SPARK-8588] [SQL] Regression test

2015-07-06 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 0effe180f - 7b467cc93 [SPARK-8588] [SQL] Regression test This PR adds regression test for https://issues.apache.org/jira/browse/SPARK-8588 (fixed by https://github.com/apache/spark/commit/457d07eaa023b44b75344110508f629925eb6247).

spark git commit: [SPARK-8072] [SQL] Better AnalysisException for writing DataFrame with identically named columns

2015-07-06 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 7b467cc93 - 09a06418d [SPARK-8072] [SQL] Better AnalysisException for writing DataFrame with identically named columns Adding a function checkConstraints which will check for the constraints to be applied on the dataframe / dataframe

spark git commit: [MINOR] [SQL] remove unused code in Exchange

2015-07-06 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 2471c0bf7 - 132e7fca1 [MINOR] [SQL] remove unused code in Exchange Author: Daoyuan Wang daoyuan.w...@intel.com Closes #7234 from adrian-wang/exchangeclean and squashes the following commits: b093ec9 [Daoyuan Wang] remove unused code

spark git commit: Revert [SPARK-7212] [MLLIB] Add sequence learning flag

2015-07-06 Thread meng
Repository: spark Updated Branches: refs/heads/master 1165b17d2 - 96c5eeec3 Revert [SPARK-7212] [MLLIB] Add sequence learning flag This reverts commit 25f574eb9a3cb9b93b7d9194a8ec16e00ce2c036. After speaking to some users and developers, we realized that FP-growth doesn't meet the

spark git commit: [SPARK-8819] Fix build for maven 3.3.x

2015-07-06 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.4 4d813833d - 947b84598 [SPARK-8819] Fix build for maven 3.3.x This is a workaround for MSHADE-148, which leads to an infinite loop when building Spark with maven 3.3.x. This was originally caused by #6441, which added a bunch of test

spark git commit: [SPARK-8819] Fix build for maven 3.3.x

2015-07-06 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.3 502e1fd68 - 5f1d1c0b8 [SPARK-8819] Fix build for maven 3.3.x This is a workaround for MSHADE-148, which leads to an infinite loop when building Spark with maven 3.3.x. This was originally caused by #6441, which added a bunch of test

spark git commit: Revert [SPARK-8781] Fix variables in published pom.xml are not resolved

2015-07-06 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 9eae5fa64 - 929dfa24b Revert [SPARK-8781] Fix variables in published pom.xml are not resolved This reverts commit 82cf3315e690f4ac15b50edea6a3d673aa5be4c0. Conflicts: pom.xml Project:

[2/2] spark git commit: Preparing development version 1.4.2-SNAPSHOT

2015-07-06 Thread pwendell
Preparing development version 1.4.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/5c080c2e Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/5c080c2e Diff:

Git Push Summary

2015-07-06 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.4.1-rc3 [created] f8aab7a7b - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[1/2] spark git commit: Preparing Spark release v1.4.1-rc3

2015-07-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 997444c78 - 5c080c2ee Preparing Spark release v1.4.1-rc3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f8aab7a7 Tree:

spark git commit: Revert [SPARK-8781] Fix variables in published pom.xml are not resolved

2015-07-06 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.3 5f1d1c0b8 - 960aec976 Revert [SPARK-8781] Fix variables in published pom.xml are not resolved This reverts commit 502e1fd68f9efc0311062146fa058dec3ef0e70b. Conflicts: pom.xml Project:

spark git commit: Revert [SPARK-8781] Fix variables in published pom.xml are not resolved

2015-07-06 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.4 947b84598 - 997444c78 Revert [SPARK-8781] Fix variables in published pom.xml are not resolved This reverts commit 82cf3315e690f4ac15b50edea6a3d673aa5be4c0. Conflicts: pom.xml Project:

spark git commit: [SPARK-6747] [SQL] Throw an AnalysisException when unsupported Java list types used in Hive UDF

2015-07-06 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 929dfa24b - 1821fc165 [SPARK-6747] [SQL] Throw an AnalysisException when unsupported Java list types used in Hive UDF The current implementation can't handle List as a return type in Hive UDF and throws meaningless Match Error. We assume

spark git commit: [SPARK-5562] [MLLIB] LDA should handle empty document.

2015-07-06 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 1821fc165 - 6718c1eb6 [SPARK-5562] [MLLIB] LDA should handle empty document. See the jira https://issues.apache.org/jira/browse/SPARK-5562 Author: Alok Singh singhal@Aloks-MacBook-Pro.local Author: Alok Singh

spark git commit: [HOTFIX] Rename release-profile to release

2015-07-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/master c46aaf47f - 1cb2629f1 [HOTFIX] Rename release-profile to release when publishing releases. We named it as 'release-profile' because that is the Maven convention. However, it turns out this special name causes several other things to

spark git commit: [HOTFIX] Rename release-profile to release

2015-07-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 5c080c2ee - 397bafd7d [HOTFIX] Rename release-profile to release when publishing releases. We named it as 'release-profile' because that is the Maven convention. However, it turns out this special name causes several other things to

Git Push Summary

2015-07-06 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.4.1-rc3 [deleted] f8aab7a7b - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 1.4.2-SNAPSHOT

2015-07-06 Thread pwendell
Preparing development version 1.4.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/bf8b47d1 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/bf8b47d1 Diff:

Git Push Summary

2015-07-06 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.4.1-rc3 [created] 3e8ae3894 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[1/2] spark git commit: Preparing Spark release v1.4.1-rc3

2015-07-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 397bafd7d - bf8b47d17 Preparing Spark release v1.4.1-rc3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/3e8ae389 Tree:

spark git commit: [SPARK-8831][SQL] Support AbstractDataType in TypeCollection.

2015-07-06 Thread rxin
Repository: spark Updated Branches: refs/heads/master 6d0411b4f - 86768b7b3 [SPARK-8831][SQL] Support AbstractDataType in TypeCollection. Otherwise it is impossible to declare an expression supporting DecimalType. Author: Reynold Xin r...@databricks.com Closes #7232 from