spark git commit: [SPARK-9710] [TEST] Fix RPackageUtilsSuite when R is not available.

2015-09-23 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.5 4174b94f0 -> 6c6cadb8f [SPARK-9710] [TEST] Fix RPackageUtilsSuite when R is not available. RUtils.isRInstalled throws an exception if R is not installed, instead of returning false. Fix that. Author: Marcelo Vanzin

Git Push Summary

2015-09-23 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.5.1-rc1 [created] 4df97937d - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-10763] [ML] [JAVA] [TEST] Update Java MLLIB/ML tests to use simplified dataframe construction

2015-09-23 Thread meng
Repository: spark Updated Branches: refs/heads/master 758c9d25e -> d91967e15 [SPARK-10763] [ML] [JAVA] [TEST] Update Java MLLIB/ML tests to use simplified dataframe construction As introduced in https://issues.apache.org/jira/browse/SPARK-10630 we now have an easier way to create dataframes

[1/2] spark git commit: Preparing Spark release v1.5.1-rc1

2015-09-23 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.5 179f36ed3 -> 3fb011a48 Preparing Spark release v1.5.1-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4df97937 Tree:

[2/2] spark git commit: Preparing development version 1.5.2-SNAPSHOT

2015-09-23 Thread pwendell
Preparing development version 1.5.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/3fb011a4 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/3fb011a4 Diff:

spark git commit: [SPARK-10403] Allow UnsafeRowSerializer to work with tungsten-sort ShuffleManager

2015-09-23 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.5 6c6cadb8f -> 64cc62cb5 [SPARK-10403] Allow UnsafeRowSerializer to work with tungsten-sort ShuffleManager This patch attempts to fix an issue where Spark SQL's UnsafeRowSerializer was incompatible with the `tungsten-sort`

spark git commit: [SPARK-10721] Log warning when file deletion fails

2015-09-23 Thread srowen
Repository: spark Updated Branches: refs/heads/master 50e463423 -> 27bfa9ab3 [SPARK-10721] Log warning when file deletion fails Author: tedyu Closes #8843 from tedyu/master. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-10224] [STREAMING] Fix the issue that blockIntervalTimer won't call updateCurrentBuffer when stopping

2015-09-23 Thread tdas
Repository: spark Updated Branches: refs/heads/master 5548a2547 -> 44c28abf1 [SPARK-10224] [STREAMING] Fix the issue that blockIntervalTimer won't call updateCurrentBuffer when stopping `blockIntervalTimer.stop(interruptTimer = false)` doesn't guarantee calling `updateCurrentBuffer`. So

spark git commit: [SPARK-10769] [STREAMING] [TESTS] Fix o.a.s.streaming.CheckpointSuite.maintains rate controller

2015-09-23 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.5 6a616d0d0 -> 4174b94f0 [SPARK-10769] [STREAMING] [TESTS] Fix o.a.s.streaming.CheckpointSuite.maintains rate controller Fixed the following failure in

spark git commit: [SPARK-10224] [STREAMING] Fix the issue that blockIntervalTimer won't call updateCurrentBuffer when stopping

2015-09-23 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.5 8a23ef59b -> 6a616d0d0 [SPARK-10224] [STREAMING] Fix the issue that blockIntervalTimer won't call updateCurrentBuffer when stopping `blockIntervalTimer.stop(interruptTimer = false)` doesn't guarantee calling `updateCurrentBuffer`. So

spark git commit: [SPARK-10769] [STREAMING] [TESTS] Fix o.a.s.streaming.CheckpointSuite.maintains rate controller

2015-09-23 Thread tdas
Repository: spark Updated Branches: refs/heads/master 44c28abf1 -> 50e463423 [SPARK-10769] [STREAMING] [TESTS] Fix o.a.s.streaming.CheckpointSuite.maintains rate controller Fixed the following failure in

spark git commit: [SPARK-9715] [ML] Store numFeatures in all ML PredictionModel types

2015-09-23 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master a18208047 -> 098be27ad [SPARK-9715] [ML] Store numFeatures in all ML PredictionModel types All prediction models should store `numFeatures` indicating the number of features the model was trained on. Default value of -1 added for

spark git commit: [SPARK-10403] Allow UnsafeRowSerializer to work with tungsten-sort ShuffleManager

2015-09-23 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 27bfa9ab3 -> a18208047 [SPARK-10403] Allow UnsafeRowSerializer to work with tungsten-sort ShuffleManager This patch attempts to fix an issue where Spark SQL's UnsafeRowSerializer was incompatible with the `tungsten-sort` ShuffleManager.

spark git commit: [SPARK-10686] [ML] Add quantilesCol to AFTSurvivalRegression

2015-09-23 Thread meng
Repository: spark Updated Branches: refs/heads/master 098be27ad -> ce2b056d3 [SPARK-10686] [ML] Add quantilesCol to AFTSurvivalRegression By default ```quantilesCol``` should be empty. If ```quantileProbabilities``` is set, we should append quantiles as a new column (of type Vector).

Git Push Summary

2015-09-23 Thread rxin
Repository: spark Updated Tags: refs/tags/v1.5.1-rc1 [deleted] 20db8186d - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[1/2] spark git commit: Preparing Spark release v1.5.1-rc1

2015-09-23 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.5 cdc4ac003 -> 179f36ed3 Preparing Spark release v1.5.1-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4f894dd6 Tree:

[2/2] spark git commit: Preparing development version 1.5.2-SNAPSHOT

2015-09-23 Thread pwendell
Preparing development version 1.5.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/179f36ed Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/179f36ed Diff:

Git Push Summary

2015-09-23 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.5.1-rc1 [created] 4f894dd69 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-10474] [SQL] Aggregation fails to allocate memory for pointer array (round 2)

2015-09-23 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 084e4e126 -> 83f6f54d1 [SPARK-10474] [SQL] Aggregation fails to allocate memory for pointer array (round 2) This patch reverts most of the changes in a previous fix #8827. The real cause of the issue is that in `TungstenAggregate`'s

spark git commit: [SPARK-10474] [SQL] Aggregation fails to allocate memory for pointer array (round 2)

2015-09-23 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.5 7564c2493 -> 1f47e68f5 [SPARK-10474] [SQL] Aggregation fails to allocate memory for pointer array (round 2) This patch reverts most of the changes in a previous fix #8827. The real cause of the issue is that in `TungstenAggregate`'s

spark git commit: Update branch-1.5 for 1.5.1 release.

2015-09-23 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.5 1f47e68f5 -> 1000b5d7e Update branch-1.5 for 1.5.1 release. Author: Reynold Xin Closes #8890 from rxin/release-1.5.1. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

[2/2] spark git commit: Preparing development version 1.4.3-SNAPSHOT

2015-09-23 Thread pwendell
Preparing development version 1.4.3-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d4a74a28 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d4a74a28 Diff:

[1/2] spark git commit: Preparing Spark release v1.4.2-rc1

2015-09-23 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 51d9eadbe -> d4a74a28f Preparing Spark release v1.4.2-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/0b22a3c7 Tree:

spark git commit: Bump R version to 1.4.2.

2015-09-23 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 8887abb06 -> 51d9eadbe Bump R version to 1.4.2. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/51d9eadb Tree:

Git Push Summary

2015-09-23 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.4.2-rc1 [created] 0b22a3c7a - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-10692] [STREAMING] Expose failureReasons in BatchInfo for streaming UI to clear failed batches

2015-09-23 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.5 1000b5d7e -> 4c48593bf [SPARK-10692] [STREAMING] Expose failureReasons in BatchInfo for streaming UI to clear failed batches Slightly modified version of #8818, all credit goes to zsxwing Author: zsxwing Author:

spark git commit: [SPARK-10692] [STREAMING] Expose failureReasons in BatchInfo for streaming UI to clear failed batches

2015-09-23 Thread rxin
Repository: spark Updated Branches: refs/heads/master 83f6f54d1 -> 758c9d25e [SPARK-10692] [STREAMING] Expose failureReasons in BatchInfo for streaming UI to clear failed batches Slightly modified version of #8818, all credit goes to zsxwing Author: zsxwing Author:

spark git commit: Update release notes.

2015-09-23 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.5 4c48593bf -> c8a3d6630 Update release notes. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c8a3d663 Tree:

[1/2] spark git commit: Preparing Spark release v1.5.1-rc1

2015-09-23 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.5 c8a3d6630 -> cdc4ac003 Preparing Spark release v1.5.1-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/20db8186 Tree:

[2/2] spark git commit: Preparing development version 1.5.2-SNAPSHOT

2015-09-23 Thread pwendell
Preparing development version 1.5.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/cdc4ac00 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/cdc4ac00 Diff:

Git Push Summary

2015-09-23 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.5.1-rc1 [created] 20db8186d - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-10699] [ML] Support checkpointInterval can be disabled

2015-09-23 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master ce2b056d3 -> 067afb4e9 [SPARK-10699] [ML] Support checkpointInterval can be disabled Currently use can set ```checkpointInterval``` to specify how often should the cache be check-pointed. But we also need the function that users can

spark git commit: [SPARK-10731] [SQL] Delegate to Scala's DataFrame.take implementation in Python DataFrame.

2015-09-23 Thread rxin
Repository: spark Updated Branches: refs/heads/master 067afb4e9 -> 995221774 [SPARK-10731] [SQL] Delegate to Scala's DataFrame.take implementation in Python DataFrame. Python DataFrame.head/take now requires scanning all the partitions. This pull request changes them to delegate the actual

spark git commit: [SPARK-10731] [SQL] Delegate to Scala's DataFrame.take implementation in Python DataFrame.

2015-09-23 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.5 64cc62cb5 -> 7564c2493 [SPARK-10731] [SQL] Delegate to Scala's DataFrame.take implementation in Python DataFrame. Python DataFrame.head/take now requires scanning all the partitions. This pull request changes them to delegate the

spark git commit: Update branch-1.3 for 1.3.2 release.

2015-09-23 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.3 e54525f4a -> 392875ad3 Update branch-1.3 for 1.3.2 release. Author: Reynold Xin Closes #8894 from rxin/branch-1.3. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: Update branch-1.4 for 1.4.2 release.

2015-09-23 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 df9e39470 -> 8887abb06 Update branch-1.4 for 1.4.2 release. Author: Reynold Xin Closes #8891 from rxin/release-1.4.2. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

[2/2] spark git commit: [SPARK-6028][Core]A new RPC implemetation based on the network module

2015-09-23 Thread rxin
[SPARK-6028][Core]A new RPC implemetation based on the network module Design doc: https://docs.google.com/document/d/1CF5G6rGVQMKSyV_QKo4D2M-x6rxz5x1Ew7aK3Uq6u8c/edit?usp=sharing Author: zsxwing Closes #6457 from zsxwing/new-rpc. Project:

[2/2] spark git commit: Preparing development version 1.3.3-SNAPSHOT

2015-09-23 Thread pwendell
Preparing development version 1.3.3-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/9f4b926d Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/9f4b926d Diff:

[1/2] spark git commit: [SPARK-6028][Core]A new RPC implemetation based on the network module

2015-09-23 Thread rxin
Repository: spark Updated Branches: refs/heads/master 995221774 -> 084e4e126 http://git-wip-us.apache.org/repos/asf/spark/blob/084e4e12/core/src/test/scala/org/apache/spark/rpc/netty/NettyRpcHandlerSuite.scala -- diff --git

[1/2] spark git commit: Preparing Spark release v1.3.2-rc1

2015-09-23 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.3 392875ad3 -> 9f4b926d4 Preparing Spark release v1.3.2-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/5a139750 Tree:

Git Push Summary

2015-09-23 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.3.2-rc1 [created] 5a139750b - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

2015-09-23 Thread rxin
Repository: spark Updated Tags: refs/tags/v1.5.1-rc1 [deleted] 4f894dd69 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org