spark git commit: [Docs] Minor typo fixes

2014-12-22 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.2 58e37028a -> f86fe0897 [Docs] Minor typo fixes Author: Nicholas Chammas Closes #3772 from nchammas/patch-1 and squashes the following commits: b7d9083 [Nicholas Chammas] [Docs] Minor typo fixes (cherry picked from commit 0e532ccb2b2

spark git commit: [Docs] Minor typo fixes

2014-12-22 Thread pwendell
Repository: spark Updated Branches: refs/heads/master a96b72781 -> 0e532ccb2 [Docs] Minor typo fixes Author: Nicholas Chammas Closes #3772 from nchammas/patch-1 and squashes the following commits: b7d9083 [Nicholas Chammas] [Docs] Minor typo fixes Project: http://git-wip-us.apache.org/rep

spark git commit: [SPARK-4907][MLlib] Inconsistent loss and gradient in LeastSquaresGradient compared with R

2014-12-22 Thread meng
Repository: spark Updated Branches: refs/heads/master c233ab3d8 -> a96b72781 [SPARK-4907][MLlib] Inconsistent loss and gradient in LeastSquaresGradient compared with R In most of the academic paper and algorithm implementations, people use L = 1/2n ||A weights-y||^2 instead of L = 1/n ||A wei

spark git commit: [SPARK-4818][Core] Add 'iterator' to reduce memory consumed by join

2014-12-22 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.1 e5f27521d -> 3bce43f67 [SPARK-4818][Core] Add 'iterator' to reduce memory consumed by join In Scala, `map` and `flatMap` of `Iterable` will copy the contents of `Iterable` to a new `Seq`. Such as, ```Scala val iterable = Seq(1, 2, 3)

spark git commit: [SPARK-4818][Core] Add 'iterator' to reduce memory consumed by join

2014-12-22 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.2 a8a8e0e87 -> 58e37028a [SPARK-4818][Core] Add 'iterator' to reduce memory consumed by join In Scala, `map` and `flatMap` of `Iterable` will copy the contents of `Iterable` to a new `Seq`. Such as, ```Scala val iterable = Seq(1, 2, 3)

spark git commit: [SPARK-4818][Core] Add 'iterator' to reduce memory consumed by join

2014-12-22 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master de9d7d2b5 -> c233ab3d8 [SPARK-4818][Core] Add 'iterator' to reduce memory consumed by join In Scala, `map` and `flatMap` of `Iterable` will copy the contents of `Iterable` to a new `Seq`. Such as, ```Scala val iterable = Seq(1, 2, 3).map

spark git commit: [SPARK-4920][UI]:current spark version in UI is not striking.

2014-12-22 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.2 4b2bdedfa -> a8a8e0e87 [SPARK-4920][UI]:current spark version in UI is not striking. It is not convenient to see the Spark version. We can keep the same style with Spark website. ![spark_version](https://cloud.githubusercontent.com/as

spark git commit: [SPARK-4920][UI]:current spark version in UI is not striking.

2014-12-22 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master a61aa669a -> de9d7d2b5 [SPARK-4920][UI]:current spark version in UI is not striking. It is not convenient to see the Spark version. We can keep the same style with Spark website. ![spark_version](https://cloud.githubusercontent.com/assets

spark git commit: [Minor] Fix scala doc

2014-12-22 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master fbca6b6ce -> a61aa669a [Minor] Fix scala doc Minor fix for an obvious scala doc error. Author: Liang-Chi Hsieh Closes #3751 from viirya/fix_scaladoc and squashes the following commits: 03fddaa [Liang-Chi Hsieh] Fix scala doc. Project:

spark git commit: [SPARK-4864] Add documentation to Netty-based configs

2014-12-22 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 7c0ed13d2 -> fbca6b6ce [SPARK-4864] Add documentation to Netty-based configs Author: Aaron Davidson Closes #3713 from aarondav/netty-configs and squashes the following commits: 8a8b373 [Aaron Davidson] Address Patrick's comments 3b1f84e

spark git commit: [SPARK-4864] Add documentation to Netty-based configs

2014-12-22 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.2 c7396b588 -> 4b2bdedfa [SPARK-4864] Add documentation to Netty-based configs Author: Aaron Davidson Closes #3713 from aarondav/netty-configs and squashes the following commits: 8a8b373 [Aaron Davidson] Address Patrick's comments 3b1f

spark git commit: [SPARK-4079] [CORE] Consolidates Errors if a CompressionCodec is not available

2014-12-22 Thread pwendell
Repository: spark Updated Branches: refs/heads/master d62da642a -> 7c0ed13d2 [SPARK-4079] [CORE] Consolidates Errors if a CompressionCodec is not available This commit consolidates some of the exceptions thrown if compression codecs are not available. If a bad configuration string was passed

spark git commit: SPARK-4447. Remove layers of abstraction in YARN code no longer needed after dropping yarn-alpha

2014-12-22 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master fb8e85e80 -> d62da642a SPARK-4447. Remove layers of abstraction in YARN code no longer needed after dropping yarn-alpha Author: Sandy Ryza Closes #3652 from sryza/sandy-spark-4447 and squashes the following commits: 2791158 [Sandy Ryza]

spark git commit: [SPARK-4733] Add missing prameter comments in ShuffleDependency

2014-12-22 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 1d9788e42 -> fb8e85e80 [SPARK-4733] Add missing prameter comments in ShuffleDependency Add missing Javadoc comments in ShuffleDependency. Author: Takeshi Yamamuro Closes #3594 from maropu/DependencyJavadocFix and squashes the following

spark git commit: [Minor] Improve some code in BroadcastTest for short

2014-12-22 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.2 70e69ef7b -> c7396b588 [Minor] Improve some code in BroadcastTest for short Using val arr1 = (0 until num).toArray instead of val arr1 = new Array[Int](num) for (i <- 0 until arr1.length) { arr1(i) = i } for short.

spark git commit: [Minor] Improve some code in BroadcastTest for short

2014-12-22 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 8773705fd -> 1d9788e42 [Minor] Improve some code in BroadcastTest for short Using val arr1 = (0 until num).toArray instead of val arr1 = new Array[Int](num) for (i <- 0 until arr1.length) { arr1(i) = i } for short. Au

spark git commit: [SPARK-4883][Shuffle] Add a name to the directoryCleaner thread

2014-12-22 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.2 31d42c4d8 -> 70e69ef7b [SPARK-4883][Shuffle] Add a name to the directoryCleaner thread Author: zsxwing Closes #3734 from zsxwing/SPARK-4883 and squashes the following commits: e6f2b61 [zsxwing] Fix the name cc74727 [zsxwing] Add a na

spark git commit: [SPARK-4883][Shuffle] Add a name to the directoryCleaner thread

2014-12-22 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 39272c8cd -> 8773705fd [SPARK-4883][Shuffle] Add a name to the directoryCleaner thread Author: zsxwing Closes #3734 from zsxwing/SPARK-4883 and squashes the following commits: e6f2b61 [zsxwing] Fix the name cc74727 [zsxwing] Add a name t

spark git commit: [SPARK-4870] Add spark version to driver log

2014-12-22 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 96606f69b -> 39272c8cd [SPARK-4870] Add spark version to driver log Author: Zhang, Liye Closes #3717 from liyezhang556520/version2Log and squashes the following commits: ccd30d7 [Zhang, Liye] delete log in sparkConf 330f70c [Zhang, Liye

spark git commit: [SPARK-4915][YARN] Fix classname to be specified for external shuffle service.

2014-12-22 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.2 b89696372 -> 31d42c4d8 [SPARK-4915][YARN] Fix classname to be specified for external shuffle service. Author: Tsuyoshi Ozawa Closes #3757 from oza/SPARK-4915 and squashes the following commits: 3b0d6d6 [Tsuyoshi Ozawa] Fix classname

spark git commit: [SPARK-4915][YARN] Fix classname to be specified for external shuffle service.

2014-12-22 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 93b2f3a88 -> 96606f69b [SPARK-4915][YARN] Fix classname to be specified for external shuffle service. Author: Tsuyoshi Ozawa Closes #3757 from oza/SPARK-4915 and squashes the following commits: 3b0d6d6 [Tsuyoshi Ozawa] Fix classname to b

spark git commit: [SPARK-4918][Core] Reuse Text in saveAsTextFile

2014-12-22 Thread rxin
Repository: spark Updated Branches: refs/heads/master 6ee6aa70b -> 93b2f3a88 [SPARK-4918][Core] Reuse Text in saveAsTextFile Reuse Text in saveAsTextFile to reduce GC. /cc rxin Author: zsxwing Closes #3762 from zsxwing/SPARK-4918 and squashes the following commits: 59f03eb [zsxwing] Reuse

spark git commit: [SPARK-2075][Core] backport for branch-1.2

2014-12-22 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.2 665653d24 -> b89696372 [SPARK-2075][Core] backport for branch-1.2 backport #3740 for branch-1.2 Author: zsxwing Closes #3758 from zsxwing/SPARK-2075-branch-1.2 and squashes the following commits: b57d440 [zsxwing] SPARK-2075 backpo