spark git commit: [SPARK-100354] [MLLIB] fix some apparent memory issues in k-means|| initializaiton

2015-08-31 Thread meng
Repository: spark Updated Branches: refs/heads/master 8694c3ad7 -> f0f563a3c [SPARK-100354] [MLLIB] fix some apparent memory issues in k-means|| initializaiton * do not cache first cost RDD * change following cost RDD cache level to MEMORY_AND_DISK * remove Vector wrapper to save a object

spark git commit: [SPARK-100354] [MLLIB] fix some apparent memory issues in k-means|| initializaiton

2015-08-31 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.4 d6fd80570 -> 15beccb71 [SPARK-100354] [MLLIB] fix some apparent memory issues in k-means|| initializaiton * do not cache first cost RDD * change following cost RDD cache level to MEMORY_AND_DISK * remove Vector wrapper to save a

spark git commit: [SPARK-100354] [MLLIB] fix some apparent memory issues in k-means|| initializaiton

2015-08-31 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.3 e8b0564e7 -> a58c1afe8 [SPARK-100354] [MLLIB] fix some apparent memory issues in k-means|| initializaiton * do not cache first cost RDD * change following cost RDD cache level to MEMORY_AND_DISK * remove Vector wrapper to save a

spark git commit: [SPARK-8730] Fixes - Deser objects containing a primitive class attribute

2015-08-31 Thread irashid
Repository: spark Updated Branches: refs/heads/master f0f563a3c -> 72f6dbf7b [SPARK-8730] Fixes - Deser objects containing a primitive class attribute Author: EugenCepoi Closes #7122 from EugenCepoi/master. Project: http://git-wip-us.apache.org/repos/asf/spark/repo

spark git commit: [SPARK-10369] [STREAMING] Don't remove ReceiverTrackingInfo when deregisterReceivering since we may reuse it later

2015-08-31 Thread tdas
Repository: spark Updated Branches: refs/heads/master 72f6dbf7b -> 4a5fe0916 [SPARK-10369] [STREAMING] Don't remove ReceiverTrackingInfo when deregisterReceivering since we may reuse it later `deregisterReceiver` should not remove `ReceiverTrackingInfo`. Otherwise, it will throw

spark git commit: [SPARK-10369] [STREAMING] Don't remove ReceiverTrackingInfo when deregisterReceivering since we may reuse it later

2015-08-31 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.5 bf5b2f26b -> 33ce274cd [SPARK-10369] [STREAMING] Don't remove ReceiverTrackingInfo when deregisterReceivering since we may reuse it later `deregisterReceiver` should not remove `ReceiverTrackingInfo`. Otherwise, it will throw

spark git commit: [SPARK-10170] [SQL] Add DB2 JDBC dialect support.

2015-08-31 Thread rxin
Repository: spark Updated Branches: refs/heads/master 4a5fe0916 -> a2d5c7209 [SPARK-10170] [SQL] Add DB2 JDBC dialect support. Data frame write to DB2 database is failing because by default JDBC data source implementation is generating a table schema with DB2 unsupported data types TEXT for

spark git commit: [SPARK-9954] [MLLIB] use first 128 nonzeros to compute Vector.hashCode

2015-08-31 Thread meng
Repository: spark Updated Branches: refs/heads/master a2d5c7209 -> 23e39cc7b [SPARK-9954] [MLLIB] use first 128 nonzeros to compute Vector.hashCode This could help reduce hash collisions, e.g., in `RDD[Vector].repartition`. jkbradley Author: Xiangrui Meng Closes #8182

[1/2] spark git commit: Preparing Spark release v1.5.0-rc3

2015-08-31 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.5 1c752b8b5 -> 2b270a166 Preparing Spark release v1.5.0-rc3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/908e37bc Tree:

Git Push Summary

2015-08-31 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.5.0-rc3 [created] 908e37bcc - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 1.5.1-SNAPSHOT

2015-08-31 Thread pwendell
Preparing development version 1.5.1-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/2b270a16 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/2b270a16 Diff:

spark git commit: [SPARK-10355] [ML] [PySpark] Add Python API for SQLTransformer

2015-08-31 Thread meng
Repository: spark Updated Branches: refs/heads/master fe16fd0b8 -> 52ea399e6 [SPARK-10355] [ML] [PySpark] Add Python API for SQLTransformer Add Python API for SQLTransformer Author: Yanbo Liang Closes #8527 from yanboliang/spark-10355. Project:

spark git commit: [SPARK-10378][SQL][Test] Remove HashJoinCompatibilitySuite.

2015-08-31 Thread rxin
Repository: spark Updated Branches: refs/heads/master 52ea399e6 -> d65656c45 [SPARK-10378][SQL][Test] Remove HashJoinCompatibilitySuite. They don't bring much value since we now have better unit test coverage for hash joins. This will also help reduce the test time. Author: Reynold Xin