GitHub user EmergentOrder opened a pull request: https://github.com/apache/spark/pull/20478
[SPARK-8835][Streaming] Provide pluggable Congestion Strategies for Receiver-based Streams. Take 2 / Spark 2.X merge ## What changes were proposed in this pull request? Looks like the [PR](https://github.com/apache/spark/pull/9200) for this ([SPARK-8835](https://issues.apache.org/jira/browse/SPARK-8835)) got dropped quite some time ago, due to build failures. I've merged up to the current master and am re-submitting it (to be clear, I am not the original author). ## How was this patch tested? Built and tested locally. You can merge this pull request into a Git repository by running: $ git pull https://github.com/EmergentOrder/spark feature/CongestionStrategiesTake2 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/20478.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #20478 ---- commit df1d1a6af6be0f0c9bf24c3b9496d220954afaf2 Author: François Garillot <francois@...> Date: 2015-10-20T14:18:38Z [SPARK-8835] Removes variable-less interpolation. commit 013ac377eed81385b40af6753f5ba4a834c38144 Author: François Garillot <francois@...> Date: 2015-10-20T15:18:06Z [SPARK-8835] Make no-update of rate limiter with 0 explicit. commit 7ee7f3aded65da728214faddae15888fa905743b Author: François Garillot <francois@...> Date: 2015-10-21T13:56:53Z [SPARK-8835] Adds strategies for dealing with congestion on Receiver-based streams commit 50954a60cc2f7cfb83c706c39c2e714c0c9dc628 Author: François Garillot <francois@...> Date: 2015-10-21T15:12:42Z [SPARK-8835] Adds tests for congestion strategies Folds in the block generator throttling test from ReceiverSuite commit b2dd6b87865eed5519d8ad278e09ba17c1334c6c Author: François Garillot <francois@...> Date: 2015-10-21T15:15:36Z [SPARK-8835] TUrn off block generator throttling tests for long runtime THe previous commit (with tests) should pass PR validation though commit cfbf29dae54caaae3f261525926b54a7e6f6a99a Author: Alex Merritt <lecaran@...> Date: 2018-02-01T16:43:05Z [SPARK-8835][Streaming] Provide pluggable Congestion Strategies for Receiver-based Streams. Take 2 / Spark 2.X merge ---- --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org