GitHub user huitseeker opened a pull request: https://github.com/apache/spark/pull/9200
[SPARK-8835] Provide pluggable Congestion Strategies for Receiver-based Streams The new (destructive) strategies avoid leaving elements in the TCP buffer, leading to breakages at the sender level when this buffer finally drops them. You can merge this pull request into a Git repository by running: $ git pull https://github.com/huitseeker/spark feature/CongestionStrategies Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/9200.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #9200 ---- commit df1d1a6af6be0f0c9bf24c3b9496d220954afaf2 Author: François Garillot <franc...@garillot.net> Date: 2015-10-20T14:18:38Z [SPARK-8835] Removes variable-less interpolation. commit 013ac377eed81385b40af6753f5ba4a834c38144 Author: François Garillot <franc...@garillot.net> Date: 2015-10-20T15:18:06Z [SPARK-8835] Make no-update of rate limiter with 0 explicit. commit 6268c2cf89a4ce1cda0650b184e6d85826f2af7c Author: François Garillot <franc...@garillot.net> Date: 2015-10-21T13:56:53Z [SPARK-8835] Adds strategies for dealing with congestion on Receiver-based streams commit 8cbadacb3b492ebbdd8283379fe99ce8534ad896 Author: François Garillot <franc...@garillot.net> Date: 2015-10-21T15:12:42Z [SPARK-8835] Adds tests for congestion strategies Folds in the block generator throttling test from ReceiverSuite commit 2e8e5deeacdca0bce3c24ea62c85811fef70a9b4 Author: François Garillot <franc...@garillot.net> Date: 2015-10-21T15:15:36Z [SPARK-8835] TUrn off block generator throttling tests for long runtime THe previous commit (with tests) should pass PR validation though ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org