git commit: HOTFIX: Bump spark-ec2 version to 1.1.0

2014-08-29 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 a4a7a2414 -> c71b5c6db HOTFIX: Bump spark-ec2 version to 1.1.0 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c71b5c6d Tree: http://git-wip-us.apache.org/repos/asf

git commit: [SPARK-3307] [PySpark] Fix doc string of SparkContext.broadcast()

2014-08-29 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 27df6ce6a -> e248328b3 [SPARK-3307] [PySpark] Fix doc string of SparkContext.broadcast() remove invalid docs Author: Davies Liu Closes #2202 from davies/keep and squashes the following commits: aa3b44f [Davies Liu] remove invalid docs

git commit: [SPARK-3307] [PySpark] Fix doc string of SparkContext.broadcast()

2014-08-29 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.1 c71b5c6db -> 98d0716a1 [SPARK-3307] [PySpark] Fix doc string of SparkContext.broadcast() remove invalid docs Author: Davies Liu Closes #2202 from davies/keep and squashes the following commits: aa3b44f [Davies Liu] remove invalid d

git commit: [Docs] SQL doc formatting and typo fixes

2014-08-29 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master e248328b3 -> 53aa8316e [Docs] SQL doc formatting and typo fixes As [reported on the dev list](http://apache-spark-developers-list.1001551.n3.nabble.com/VOTE-Release-Apache-Spark-1-1-0-RC2-tp8107p8131.html): * Code fencing with triple-backt

git commit: [Docs] SQL doc formatting and typo fixes

2014-08-29 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.1 98d0716a1 -> bfa2dc99a [Docs] SQL doc formatting and typo fixes As [reported on the dev list](http://apache-spark-developers-list.1001551.n3.nabble.com/VOTE-Release-Apache-Spark-1-1-0-RC2-tp8107p8131.html): * Code fencing with triple-b

git commit: SPARK-2813: [SQL] Implement SQRT() directly in Spark SQL

2014-08-29 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 53aa8316e -> 2f1519def SPARK-2813: [SQL] Implement SQRT() directly in Spark SQL This PR adds a native implementation for SQL SQRT() and thus avoids delegating this function to Hive. Author: William Benton Closes #1750 from willb/spark-

git commit: [SPARK-3234][Build] Fixed environment variables that rely on deprecated command line options in make-distribution.sh

2014-08-29 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 2f1519def -> 287c0ac77 [SPARK-3234][Build] Fixed environment variables that rely on deprecated command line options in make-distribution.sh Please refer to [SPARK-3234](https://issues.apache.org/jira/browse/SPARK-3234) for details. Autho

git commit: [SPARK-3234][Build] Fixed environment variables that rely on deprecated command line options in make-distribution.sh

2014-08-29 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 bfa2dc99a -> cf049efdc [SPARK-3234][Build] Fixed environment variables that rely on deprecated command line options in make-distribution.sh Please refer to [SPARK-3234](https://issues.apache.org/jira/browse/SPARK-3234) for details. A

git commit: [SPARK-3198] [SQL] Remove the TreeNode.id

2014-08-29 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 287c0ac77 -> dc4d577c6 [SPARK-3198] [SQL] Remove the TreeNode.id Thus id property of the TreeNode API does save time in a faster way to compare 2 TreeNodes, it is kind of performance bottleneck during the expression object creation in a m

git commit: [SQL] Turns on in-memory columnar compression in HiveCompatibilitySuite

2014-08-29 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master dc4d577c6 -> b1eccfc88 [SQL] Turns on in-memory columnar compression in HiveCompatibilitySuite `HiveCompatibilitySuite` already turns on in-memory columnar caching, it would be good to also enable compression to improve test coverage. Aut

git commit: [SPARK-3269][SQL] Decreases initial buffer size for row set to prevent OOM

2014-08-29 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master b1eccfc88 -> d94a44d7c [SPARK-3269][SQL] Decreases initial buffer size for row set to prevent OOM When a large batch size is specified, `SparkSQLOperationManager` OOMs even if the whole result set is much smaller than the batch size. Auth

git commit: [SPARK-3269][SQL] Decreases initial buffer size for row set to prevent OOM

2014-08-29 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.1 cf049efdc -> 9bae345ab [SPARK-3269][SQL] Decreases initial buffer size for row set to prevent OOM When a large batch size is specified, `SparkSQLOperationManager` OOMs even if the whole result set is much smaller than the batch size.

git commit: [SPARK-3291][SQL]TestcaseName in createQueryTest should not contain ":"

2014-08-29 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master d94a44d7c -> 634d04b87 [SPARK-3291][SQL]TestcaseName in createQueryTest should not contain ":" ":" is not allowed to appear in a file name of Windows system. If file name contains ":", this file can't be checked out in a Windows system and

git commit: [SPARK-3291][SQL]TestcaseName in createQueryTest should not contain ":"

2014-08-29 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.1 9bae345ab -> c1333b852 [SPARK-3291][SQL]TestcaseName in createQueryTest should not contain ":" ":" is not allowed to appear in a file name of Windows system. If file name contains ":", this file can't be checked out in a Windows system

git commit: [SPARK-3173][SQL] Timestamp support in the parser

2014-08-29 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 634d04b87 -> 98ddbe6cd [SPARK-3173][SQL] Timestamp support in the parser If you have a table with TIMESTAMP column, that column can't be used in WHERE clause properly - it is not evaluated properly. [More](https://issues.apache.org/jira/

[1/2] git commit: Revert "[maven-release-plugin] prepare for next development iteration"

2014-08-29 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 c1333b852 -> c4b7ec8dd Revert "[maven-release-plugin] prepare for next development iteration" This reverts commit a4a7a241441489a0d31365e18476ae2e1c34464d. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-

[2/2] git commit: Revert "[maven-release-plugin] prepare release v1.1.0-rc2"

2014-08-29 Thread pwendell
Revert "[maven-release-plugin] prepare release v1.1.0-rc2" This reverts commit 711aebb329ca28046396af1e34395a0df92b5327. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c4b7ec8d Tree: http://git-wip-us.apache.org/repos/asf/sp

git commit: [SPARK-3296][mllib] spark-example should be run-example in head notation of DenseKMeans and SparseNaiveBayes

2014-08-29 Thread meng
Repository: spark Updated Branches: refs/heads/master 98ddbe6cd -> 13901764f [SPARK-3296][mllib] spark-example should be run-example in head notation of DenseKMeans and SparseNaiveBayes `./bin/spark-example` should be `./bin/run-example` in DenseKMeans and SparseNaiveBayes Author: wangfei

git commit: [SPARK-3296][mllib] spark-example should be run-example in head notation of DenseKMeans and SparseNaiveBayes

2014-08-29 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.1 c4b7ec8dd -> b0facb590 [SPARK-3296][mllib] spark-example should be run-example in head notation of DenseKMeans and SparseNaiveBayes `./bin/spark-example` should be `./bin/run-example` in DenseKMeans and SparseNaiveBayes Author: wang

git commit: [SPARK-3320][SQL] Made batched in-memory column buffer building work for SchemaRDDs with empty partitions

2014-08-29 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 13901764f -> 32b18dd52 [SPARK-3320][SQL] Made batched in-memory column buffer building work for SchemaRDDs with empty partitions Author: Cheng Lian Closes #2213 from liancheng/spark-3320 and squashes the following commits: 45a0139 [Chen

git commit: [SPARK-3320][SQL] Made batched in-memory column buffer building work for SchemaRDDs with empty partitions

2014-08-29 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.1 b0facb590 -> aa9364a03 [SPARK-3320][SQL] Made batched in-memory column buffer building work for SchemaRDDs with empty partitions Author: Cheng Lian Closes #2213 from liancheng/spark-3320 and squashes the following commits: 45a0139 [

git commit: Adding new CHANGES.txt

2014-08-29 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 aa9364a03 -> 272b4a68d Adding new CHANGES.txt Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/272b4a68 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/272b4

git commit: [maven-release-plugin] prepare release v1.1.0-rc3

2014-08-29 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 272b4a68d -> 2b2e02265 [maven-release-plugin] prepare release v1.1.0-rc3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/2b2e0226 Tree: http://git-wip-us.apache.org

git commit: [maven-release-plugin] prepare for next development iteration

2014-08-29 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 2b2e02265 -> 8b5f0dbd8 [maven-release-plugin] prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8b5f0dbd Tree: http://git-wip-u

Git Push Summary

2014-08-29 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.1.0-rc3 [created] 25596d1da - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

git commit: BUILD: Adding back CDH4 as per user requests

2014-08-29 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 32b18dd52 -> a004a8d87 BUILD: Adding back CDH4 as per user requests Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a004a8d8 Tree: http://git-wip-us.apache.org/repos/as

git commit: BUILD: Adding back CDH4 as per user requests

2014-08-29 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 8b5f0dbd8 -> d4ce26426 BUILD: Adding back CDH4 as per user requests Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d4ce2642 Tree: http://git-wip-us.apache.org/repo

git commit: [SPARK-3305] Remove unused import from UI classes.

2014-08-29 Thread rxin
Repository: spark Updated Branches: refs/heads/master a004a8d87 -> 7e662af33 [SPARK-3305] Remove unused import from UI classes. Author: Kousuke Saruta Closes #2200 from sarutak/SPARK-3305 and squashes the following commits: 3cbd6ee [Kousuke Saruta] Removed unused import from classes related

[2/2] git commit: [SPARK-2288] Hide ShuffleBlockManager behind ShuffleManager

2014-08-29 Thread rxin
[SPARK-2288] Hide ShuffleBlockManager behind ShuffleManager By Hiding the shuffleblockmanager behind Shufflemanager, we decouple the shuffle data's block mapping management work from Diskblockmananger. This give a more clear interface and more easy for other shuffle manager to implement their o

[1/2] [SPARK-2288] Hide ShuffleBlockManager behind ShuffleManager

2014-08-29 Thread rxin
Repository: spark Updated Branches: refs/heads/master 7e662af33 -> acea92806 http://git-wip-us.apache.org/repos/asf/spark/blob/acea9280/tools/src/main/scala/org/apache/spark/tools/StoragePerfTester.scala -- diff --git a/tools/

git commit: Manually close old pull requests Closes #1824

2014-08-29 Thread rxin
Repository: spark Updated Branches: refs/heads/master acea92806 -> d90434c03 Manually close old pull requests Closes #1824 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d90434c0 Tree: http://git-wip-us.apache.org/repos/a