spark git commit: [SPARK-6372] [core] Propagate --conf to child processes.

2015-03-18 Thread srowen
Repository: spark Updated Branches: refs/heads/master 357900311 - 6205a255a [SPARK-6372] [core] Propagate --conf to child processes. And add unit test. Author: Marcelo Vanzin van...@cloudera.com Closes #5057 from vanzin/SPARK-6372 and squashes the following commits: b33728b [Marcelo

spark git commit: [SPARK-6325] [core, yarn] Do not change target executor count when killing executors.

2015-03-18 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 ff0a7f400 - 1723f0591 [SPARK-6325] [core,yarn] Do not change target executor count when killing executors. The dynamic execution code has two ways to reduce the number of executors: one where it reduces the total number of executors

spark git commit: [SPARK-6286][minor] Handle missing Mesos case TASK_ERROR.

2015-03-18 Thread srowen
Repository: spark Updated Branches: refs/heads/master e09c852d6 - 9d112a958 [SPARK-6286][minor] Handle missing Mesos case TASK_ERROR. Author: Iulian Dragos jagua...@gmail.com Closes #5000 from dragos/issue/task-error-case and squashes the following commits: e063627 [Iulian Dragos] Handle

spark git commit: SPARK-6389 YARN app diagnostics report doesn't report NPEs

2015-03-18 Thread srowen
Repository: spark Updated Branches: refs/heads/master 6205a255a - e09c852d6 SPARK-6389 YARN app diagnostics report doesn't report NPEs Trivial patch to implicitly call `Exception.toString()` over `Exception.getMessage()` —this defaults to including the exception class any non-null

spark git commit: [SPARK-6286][minor] Handle missing Mesos case TASK_ERROR.

2015-03-18 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 ba8352c76 - ff0a7f400 [SPARK-6286][minor] Handle missing Mesos case TASK_ERROR. Author: Iulian Dragos jagua...@gmail.com Closes #5000 from dragos/issue/task-error-case and squashes the following commits: e063627 [Iulian Dragos]

spark git commit: [SPARK-6394][Core] cleanup BlockManager companion object and improve the getCacheLocs method in DAGScheduler

2015-03-18 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 3db138742 - 540b2a4ea [SPARK-6394][Core] cleanup BlockManager companion object and improve the getCacheLocs method in DAGScheduler The current implementation include searching a HashMap many times, we can avoid this. Actually if you look

spark git commit: [SPARK-6374] [MLlib] add get for GeneralizedLinearAlgo

2015-03-18 Thread meng
Repository: spark Updated Branches: refs/heads/master 981fbafa2 - a95ee242b [SPARK-6374] [MLlib] add get for GeneralizedLinearAlgo I find it's better to have getter for NumFeatures and addIntercept within GeneralizedLinearAlgorithm during actual usage, otherwise I 'll have to get the value