spark git commit: [SPARK-6754] Remove unnecessary TaskContextHelper

2015-04-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master d138aa8ee -> 8d2a36c0f [SPARK-6754] Remove unnecessary TaskContextHelper The TaskContextHelper was originally necessary because TaskContext was written in Java, which does not have a way to specify that classes are package-private, so Tas

spark git commit: [SPARK-6705][MLLIB] Add fit intercept api to ml logisticregression

2015-04-07 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master c83e03948 -> d138aa8ee [SPARK-6705][MLLIB] Add fit intercept api to ml logisticregression I have the fit intercept enabled by default for logistic regression, I wonder what others think here. I understand that it enables allocation by defau

[1/2] spark git commit: Revert "Preparing development version 1.3.2-SNAPSHOT"

2015-04-07 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.3 277733b1d -> 00837ccd0 Revert "Preparing development version 1.3.2-SNAPSHOT" This reverts commit 728c1f927822eb6b12f04dc47109feb6fbe02ec2. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org

Git Push Summary

2015-04-07 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.3.1-rc2 [created] 7c4473aa5 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 1.3.2-SNAPSHOT

2015-04-07 Thread pwendell
Preparing development version 1.3.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/cdef7d08 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/cdef7d08 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/cde

[2/2] spark git commit: Revert "Preparing Spark release v1.3.1-rc1"

2015-04-07 Thread pwendell
Revert "Preparing Spark release v1.3.1-rc1" This reverts commit 0dcb5d9f31b713ed90bcec63ebc4e530cbb69851. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/00837ccd Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/00837c

[1/2] spark git commit: Preparing Spark release v1.3.1-rc2

2015-04-07 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.3 00837ccd0 -> cdef7d080 Preparing Spark release v1.3.1-rc2 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7c4473aa Tree: http://git-wip-us.apache.org/repos/asf/spar

spark git commit: [SPARK-6737] Fix memory leak in OutputCommitCoordinator

2015-04-07 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.3 ab1b8edb8 -> 277733b1d [SPARK-6737] Fix memory leak in OutputCommitCoordinator This patch fixes a memory leak in the DAGScheduler, which caused us to leak a map entry per submitted stage. The problem is that the OutputCommitCoordinato

spark git commit: [SPARK-6737] Fix memory leak in OutputCommitCoordinator

2015-04-07 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 77bcceb9f -> c83e03948 [SPARK-6737] Fix memory leak in OutputCommitCoordinator This patch fixes a memory leak in the DAGScheduler, which caused us to leak a map entry per submitted stage. The problem is that the OutputCommitCoordinator n

spark git commit: [SPARK-6748] [SQL] Makes QueryPlan.schema a lazy val

2015-04-07 Thread lian
Repository: spark Updated Branches: refs/heads/master fc957dc78 -> 77bcceb9f [SPARK-6748] [SQL] Makes QueryPlan.schema a lazy val `DataFrame.collect()` calls `SparkPlan.executeCollect()`, which consists of a single line: ```scala execute().map(ScalaReflection.convertRowToScala(_, schema)).co

spark git commit: [SPARK-6720][MLLIB] PySpark MultivariateStatisticalSummary unit test for normL1...

2015-04-07 Thread meng
Repository: spark Updated Branches: refs/heads/master e6f08fb42 -> fc957dc78 [SPARK-6720][MLLIB] PySpark MultivariateStatisticalSummary unit test for normL1... ... and normL2. Add test cases to insufficient unit test for `normL1` and `normL2`. Ref: https://github.com/apache/spark/pull/5359

spark git commit: Revert "[SPARK-6568] spark-shell.cmd --jars option does not accept the jar that has space in its path"

2015-04-07 Thread meng
Repository: spark Updated Branches: refs/heads/master 596ba77c5 -> e6f08fb42 Revert "[SPARK-6568] spark-shell.cmd --jars option does not accept the jar that has space in its path" This reverts commit 596ba77c5fdca79486396989e549632153055caf. Project: http://git-wip-us.apache.org/repos/asf/s

spark git commit: [SPARK-6568] spark-shell.cmd --jars option does not accept the jar that has space in its path

2015-04-07 Thread meng
Repository: spark Updated Branches: refs/heads/master 123221591 -> 596ba77c5 [SPARK-6568] spark-shell.cmd --jars option does not accept the jar that has space in its path escape spaces in the arguments. Author: Masayoshi TSUZUKI Closes #5347 from tsudukim/feature/SPARK-6568 and squashes th

spark git commit: [SPARK-6750] Upgrade ScalaStyle to 0.7.

2015-04-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master 2c32bef17 -> 123221591 [SPARK-6750] Upgrade ScalaStyle to 0.7. 0.7 fixes a bug that's pretty useful, i.e. inline functions no longer return explicit type definition. Author: Reynold Xin Closes #5399 from rxin/style0.7 and squashes the f

spark git commit: Replace use of .size with .length for Arrays

2015-04-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master 7162ecf88 -> 2c32bef17 Replace use of .size with .length for Arrays Invoking .size on arrays is valid, but requires an implicit conversion to SeqLike. This incurs a compile time overhead and more importantly a runtime overhead, as the Arr

spark git commit: [SPARK-6733][ Scheduler]Added scala.language.existentials

2015-04-07 Thread rxin
Repository: spark Updated Branches: refs/heads/master b65bad65c -> 7162ecf88 [SPARK-6733][ Scheduler]Added scala.language.existentials Author: Vinod K C Closes #5384 from vinodkc/Suppression_Scala_existential_code and squashes the following commits: 82a3a1f [Vinod K C] Added scala.language

spark git commit: [SPARK-3591][YARN]fire and forget for YARN cluster mode

2015-04-07 Thread tgraves
Repository: spark Updated Branches: refs/heads/master ae980eb41 -> b65bad65c [SPARK-3591][YARN]fire and forget for YARN cluster mode https://issues.apache.org/jira/browse/SPARK-3591 The output after this patch: >doggie153:/opt/oss/spark-1.3.0-bin-hadoop2.4/bin # ./spark-submit --class >org.

spark git commit: [SPARK-6736][GraphX][Doc]Example of Graph#aggregateMessages has error

2015-04-07 Thread ankurdave
Repository: spark Updated Branches: refs/heads/master 6f0d55d76 -> ae980eb41 [SPARK-6736][GraphX][Doc]Example of Graph#aggregateMessages has error Example of Graph#aggregateMessages has error. Since aggregateMessages is a method of Graph, It should be written "rawGraph.aggregateMessages" Aut