spark git commit: [SPARK-9439] [YARN] External shuffle service robust to NM restarts using leveldb

2015-08-21 Thread tgraves
Repository: spark Updated Branches: refs/heads/master bb220f657 - 708036c1d [SPARK-9439] [YARN] External shuffle service robust to NM restarts using leveldb https://issues.apache.org/jira/browse/SPARK-9439 In general, Yarn apps should be robust to NodeManager restarts. However, if you run

spark git commit: [SPARK-10130] [SQL] type coercion for IF should have children resolved first

2015-08-21 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.5 e5e601739 - 817c38a0a [SPARK-10130] [SQL] type coercion for IF should have children resolved first Type coercion for IF should have children resolved first, or we could meet unresolved exception. Author: Daoyuan Wang

spark git commit: [SPARK-10130] [SQL] type coercion for IF should have children resolved first

2015-08-21 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 708036c1d - 3c462f5d8 [SPARK-10130] [SQL] type coercion for IF should have children resolved first Type coercion for IF should have children resolved first, or we could meet unresolved exception. Author: Daoyuan Wang

spark git commit: [SPARK-10122] [PYSPARK] [STREAMING] Fix getOffsetRanges bug in PySpark-Streaming transform function

2015-08-21 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.5 817c38a0a - 4e72839b7 [SPARK-10122] [PYSPARK] [STREAMING] Fix getOffsetRanges bug in PySpark-Streaming transform function Details of the bug and explanations can be seen in

[3/3] spark git commit: [SPARK-9864] [DOC] [MLlib] [SQL] Replace since in scaladoc to Since annotation

2015-08-21 Thread meng
[SPARK-9864] [DOC] [MLlib] [SQL] Replace since in scaladoc to Since annotation Author: MechCoder manojkumarsivaraj...@gmail.com Closes #8352 from MechCoder/since. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f5b028ed

[2/3] spark git commit: Version update for Spark 1.5.0 and add CHANGES.txt file.

2015-08-21 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark/blob/f65759e3/CHANGES.txt -- diff --git a/CHANGES.txt b/CHANGES.txt new file mode 100644 index 000..95f80d8 --- /dev/null +++ b/CHANGES.txt @@ -0,0 +1,24649 @@ +Spark Change Log

[1/3] spark git commit: Version update for Spark 1.5.0 and add CHANGES.txt file.

2015-08-21 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.5 14c8c0c0d - f65759e3a http://git-wip-us.apache.org/repos/asf/spark/blob/f65759e3/core/src/main/scala/org/apache/spark/package.scala -- diff --git

[3/3] spark git commit: Version update for Spark 1.5.0 and add CHANGES.txt file.

2015-08-21 Thread rxin
Version update for Spark 1.5.0 and add CHANGES.txt file. Author: Reynold Xin r...@databricks.com Closes #8365 from rxin/1.5-update. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f65759e3 Tree:

spark git commit: [SPARK-10143] [SQL] Use parquet's block size (row group size) setting as the min split size if necessary.

2015-08-21 Thread yhuai
Repository: spark Updated Branches: refs/heads/master f5b028ed2 - e3355090d [SPARK-10143] [SQL] Use parquet's block size (row group size) setting as the min split size if necessary. https://issues.apache.org/jira/browse/SPARK-10143 With this PR, we will set min split size to parquet's block

spark git commit: [SPARK-10143] [SQL] Use parquet's block size (row group size) setting as the min split size if necessary.

2015-08-21 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.5 e7db8761b - 14c8c0c0d [SPARK-10143] [SQL] Use parquet's block size (row group size) setting as the min split size if necessary. https://issues.apache.org/jira/browse/SPARK-10143 With this PR, we will set min split size to parquet's

[1/2] spark git commit: Preparing Spark release v1.5.0-rc2

2015-08-21 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.5 f65759e3a - 914da3593 Preparing Spark release v1.5.0-rc2 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e2569282 Tree:

Git Push Summary

2015-08-21 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.5.0-rc2 [created] e2569282a - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 1.5.0-SNAPSHOT

2015-08-21 Thread pwendell
Preparing development version 1.5.0-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/914da359 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/914da359 Diff:

[1/3] spark git commit: [SPARK-9864] [DOC] [MLlib] [SQL] Replace since in scaladoc to Since annotation

2015-08-21 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.5 4e72839b7 - e7db8761b http://git-wip-us.apache.org/repos/asf/spark/blob/e7db8761/mllib/src/main/scala/org/apache/spark/mllib/regression/StreamingLinearAlgorithm.scala

[2/3] spark git commit: [SPARK-9864] [DOC] [MLlib] [SQL] Replace since in scaladoc to Since annotation

2015-08-21 Thread meng
http://git-wip-us.apache.org/repos/asf/spark/blob/f5b028ed/mllib/src/main/scala/org/apache/spark/mllib/fpm/AssociationRules.scala -- diff --git a/mllib/src/main/scala/org/apache/spark/mllib/fpm/AssociationRules.scala

spark git commit: [SPARK-9893] User guide with Java test suite for VectorSlicer

2015-08-21 Thread meng
Repository: spark Updated Branches: refs/heads/master f01c4220d - 630a994e6 [SPARK-9893] User guide with Java test suite for VectorSlicer Add user guide for `VectorSlicer`, with Java test suite and Python version VectorSlicer. Note that Python version does not support selecting by names

spark git commit: [SPARK-10163] [ML] Allow single-category features for GBT models

2015-08-21 Thread meng
Repository: spark Updated Branches: refs/heads/master e3355090d - f01c4220d [SPARK-10163] [ML] Allow single-category features for GBT models Removed categorical feature info validation since no longer needed This is needed to make the ML user guide examples work (in another current PR). CC:

spark git commit: [SPARK-10163] [ML] Allow single-category features for GBT models

2015-08-21 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.5 914da3593 - cb61c7b4e [SPARK-10163] [ML] Allow single-category features for GBT models Removed categorical feature info validation since no longer needed This is needed to make the ML user guide examples work (in another current PR).

spark git commit: [SPARK-10040] [SQL] Use batch insert for JDBC writing

2015-08-21 Thread rxin
Repository: spark Updated Branches: refs/heads/master dcfe0c5cd - bb220f657 [SPARK-10040] [SQL] Use batch insert for JDBC writing JIRA: https://issues.apache.org/jira/browse/SPARK-10040 We should use batch insert instead of single row in JDBC. Author: Liang-Chi Hsieh vii...@appier.com