GitHub user androidbestcoder opened a pull request:
https://github.com/apache/spark/pull/21062
Branch 1.2
## What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
## How was this patch tested?
(Please explain how this patch was tested. E.g. unit tests, integration
tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise,
remove this)
Please review http://spark.apache.org/contributing.html before opening a
pull request.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/apache/spark branch-1.2
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21062.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21062
commit e7f9dd5cd10d18d0b712916750ac1643df169b4f
Author: Ernest <earneyzxl@...>
Date: 2014-12-18T23:42:26Z
[SPARK-4880] remove spark.locality.wait in Analytics
spark.locality.wait set to 10 in examples/graphx/Analytics.scala.
Should be left to the user.
Author: Ernest <earney...@gmail.com>
Closes #3730 from Earne/SPARK-4880 and squashes the following commits:
d79ed04 [Ernest] remove spark.locality.wait in Analytics
(cherry picked from commit a7ed6f3cc537f57de87d28e8466ca88fbfff53b5)
Signed-off-by: Reynold Xin <r...@databricks.com>
commit 61c9b89d84c868e9ecf5cffb9718c46753c9996e
Author: Madhu Siddalingaiah <madhu@...>
Date: 2014-12-19T00:00:53Z
[SPARK-4884]: Improve Partition docs
Rewording was based on this discussion:
http://apache-spark-developers-list.1001551.n3.nabble.com/RDD-data-flow-td9804.html
This is the associated JIRA ticket:
https://issues.apache.org/jira/browse/SPARK-4884
Author: Madhu Siddalingaiah <ma...@madhu.com>
Closes #3722 from msiddalingaiah/master and squashes the following commits:
79e679f [Madhu Siddalingaiah] [DOC]: improve documentation
51d14b9 [Madhu Siddalingaiah] Merge remote-tracking branch 'upstream/master'
38faca4 [Madhu Siddalingaiah] Merge remote-tracking branch 'upstream/master'
cbccbfe [Madhu Siddalingaiah] Documentation: replace with (again)
332f7a2 [Madhu Siddalingaiah] Documentation: replace with
cd2b05a [Madhu Siddalingaiah] Merge remote-tracking branch 'upstream/master'
0fc12d7 [Madhu Siddalingaiah] Documentation: add description for
repartitionAndSortWithinPartitions
(cherry picked from commit d5a596d4188bfa85ff49ee85039f54255c19a4de)
Signed-off-by: Josh Rosen <joshro...@databricks.com>
commit 075b399c59b508251f4fb259e7b0c13b79ff5883
Author: Aaron Davidson <aaron@...>
Date: 2014-12-19T00:43:16Z
[SPARK-4837] NettyBlockTransferService should use spark.blockManager.port
config
This is used in NioBlockTransferService here:
https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/network/nio/NioBlockTransferService.scala#L66
Author: Aaron Davidson <aa...@databricks.com>
Closes #3688 from aarondav/SPARK-4837 and squashes the following commits:
ebd2007 [Aaron Davidson] [SPARK-4837] NettyBlockTransferService should use
spark.blockManager.port config
(cherry picked from commit 105293a7d06b26e7b179a0447eb802074ee9c218)
Signed-off-by: Josh Rosen <joshro...@databricks.com>
commit ca37639aa1b537d0f9b56bf1362bf293635e235c
Author: Andrew Or <andrew@...>
Date: 2014-12-19T01:37:42Z
[SPARK-4754] Refactor SparkContext into ExecutorAllocationClient
This is such that the `ExecutorAllocationManager` does not take in the
`SparkContext` with all of its dependencies as an argument. This prevents
future developers of this class to tie down this class further with the
`SparkContext`, which has really become quite a monstrous object.
cc'ing pwendell who originally suggested this, and JoshRosen who may have
thoughts about the trait mix-in style of `SparkContext`.
Author: Andrew Or <and...@databricks.com>
Closes #3614 from andrewor14/dynamic-allocation-sc and squashes the
following commits:
187070d [Andrew Or] Merge branch 'master' of github.com:apache/spark into
dynamic-allocation-sc
59baf6c [Andrew Or] Merge branch 'master' of github.com:apache/spark into
dynamic-allocation-sc
347a348 [Andrew Or] Refactor SparkContext into ExecutorAllocationClient
(cherry picked from commit 9804a759b68f56eceb8a2f4ea90f76a92b5f9f67)
Signed-off-by: Andrew Or <and...@databricks.com>
Conflicts:
core/src/main/scala/org/apache/spark/SparkContext.scala
commit fd7bb9d9728fa2b4fc6f26ae6a31cfa60d560ad4
Author: Sandy Ryza <sandy@...>
Date: 2014-12-
