spark git commit: [SPARK-15703][SCHEDULER][CORE][WEBUI] Make ListenerBus event queue size configurable (branch 2.0)

2016-09-23 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.0 5bc5b49fa -> 9e91a1009 [SPARK-15703][SCHEDULER][CORE][WEBUI] Make ListenerBus event queue size configurable (branch 2.0) ## What changes were proposed in this pull request? Backport #14269 to 2.0. ## How was this patch tested?

[1/2] spark git commit: Preparing Spark release v2.0.1-rc3

2016-09-23 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-2.0 b111a81f2 -> 5bc5b49fa Preparing Spark release v2.0.1-rc3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/9d28cc10 Tree:

[spark] Git Push Summary

2016-09-23 Thread pwendell
Repository: spark Updated Tags: refs/tags/v2.0.1-rc3 [created] 9d28cc103 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 2.0.2-SNAPSHOT

2016-09-23 Thread pwendell
Preparing development version 2.0.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/5bc5b49f Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/5bc5b49f Diff:

spark git commit: [SPARK-17651][SPARKR] Set R package version number along with mvn

2016-09-23 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 452e468f2 -> b111a81f2 [SPARK-17651][SPARKR] Set R package version number along with mvn This PR sets the R package version while tagging releases. Note that since R doesn't accept `-SNAPSHOT` in version number field, we remove that

spark git commit: [SPARK-17651][SPARKR] Set R package version number along with mvn

2016-09-23 Thread rxin
Repository: spark Updated Branches: refs/heads/master 90a30f463 -> 7c382524a [SPARK-17651][SPARKR] Set R package version number along with mvn ## What changes were proposed in this pull request? This PR sets the R package version while tagging releases. Note that since R doesn't accept

[1/2] spark git commit: [SPARK-12221] add cpu time to metrics

2016-09-23 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 988c71457 -> 90a30f463 http://git-wip-us.apache.org/repos/asf/spark/blob/90a30f46/core/src/test/scala/org/apache/spark/util/JsonProtocolSuite.scala -- diff --git

[2/2] spark git commit: [SPARK-12221] add cpu time to metrics

2016-09-23 Thread vanzin
[SPARK-12221] add cpu time to metrics Currently task metrics don't support executor CPU time, so there's no way to calculate how much CPU time a stage/task took from History Server metrics. This PR enables reporting CPU time. Author: jisookim Closes #10212 from

spark git commit: [SPARK-17577][CORE][2.0 BACKPORT] Update SparkContext.addFile to make it work well on Windows

2016-09-23 Thread sarutak
Repository: spark Updated Branches: refs/heads/branch-2.0 1a8ea000e -> 452e468f2 [SPARK-17577][CORE][2.0 BACKPORT] Update SparkContext.addFile to make it work well on Windows ## What changes were proposed in this pull request? Update ```SparkContext.addFile``` to correct the use of ```URI```

spark git commit: [SPARK-17643] Remove comparable requirement from Offset

2016-09-23 Thread tdas
Repository: spark Updated Branches: refs/heads/master f62ddc598 -> 988c71457 [SPARK-17643] Remove comparable requirement from Offset For some sources, it is difficult to provide a global ordering based only on the data in the offset. Since we don't use comparison for correctness, lets

spark git commit: [SPARK-17210][SPARKR] sparkr.zip is not distributed to executors when running sparkr in RStudio

2016-09-23 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.0 d3f90e71a -> 1a8ea000e [SPARK-17210][SPARKR] sparkr.zip is not distributed to executors when running sparkr in RStudio ## What changes were proposed in this pull request? Spark will add sparkr.zip to archive only when it is yarn mode

spark git commit: [SPARK-17210][SPARKR] sparkr.zip is not distributed to executors when running sparkr in RStudio

2016-09-23 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master f89808b0f -> f62ddc598 [SPARK-17210][SPARKR] sparkr.zip is not distributed to executors when running sparkr in RStudio ## What changes were proposed in this pull request? Spark will add sparkr.zip to archive only when it is yarn mode

spark git commit: [SPARK-17499][SPARKR][ML][MLLIB] make the default params in sparkR spark.mlp consistent with MultilayerPerceptronClassifier

2016-09-23 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 90d575421 -> f89808b0f [SPARK-17499][SPARKR][ML][MLLIB] make the default params in sparkR spark.mlp consistent with MultilayerPerceptronClassifier ## What changes were proposed in this pull request? update

spark git commit: [SPARK-16861][PYSPARK][CORE] Refactor PySpark accumulator API on top of Accumulator V2

2016-09-23 Thread srowen
Repository: spark Updated Branches: refs/heads/master 5c5396cb4 -> 90d575421 [SPARK-16861][PYSPARK][CORE] Refactor PySpark accumulator API on top of Accumulator V2 ## What changes were proposed in this pull request? Move the internals of the PySpark accumulator API from the old deprecated

spark git commit: [BUILD] Closes some stale PRs

2016-09-23 Thread srowen
Repository: spark Updated Branches: refs/heads/master 62ccf27ab -> 5c5396cb4 [BUILD] Closes some stale PRs ## What changes were proposed in this pull request? This PR proposes to close some stale PRs and ones suggested to be closed by committer(s) Closes #12415 Closes #14765 Closes #15118

spark git commit: [SPARK-17640][SQL] Avoid using -1 as the default batchId for FileStreamSource.FileEntry

2016-09-23 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.0 54d4eee51 -> d3f90e71a [SPARK-17640][SQL] Avoid using -1 as the default batchId for FileStreamSource.FileEntry ## What changes were proposed in this pull request? Avoid using -1 as the default batchId for FileStreamSource.FileEntry

spark git commit: [SPARK-17640][SQL] Avoid using -1 as the default batchId for FileStreamSource.FileEntry

2016-09-23 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 947b8c6e3 -> 62ccf27ab [SPARK-17640][SQL] Avoid using -1 as the default batchId for FileStreamSource.FileEntry ## What changes were proposed in this pull request? Avoid using -1 as the default batchId for FileStreamSource.FileEntry so