Liwei Lin created SPARK-13799:
---------------------------------
Summary: Add memory back pressure for Spark Streaming
Key: SPARK-13799
URL: https://issues.apache.org/jira/browse/SPARK-13799
Project: Spark
Issue Type: Improvement
Components: Streaming
Affects Versions: 2.0.0
Reporter: Liwei Lin
The back pressure mechanism added in Spark 1.5.0 is great in keeping the whole
application in a stable state. But even with back pressure enabled, we have,
for some times, experienced Receiver side’s OOME when facing sudden data burst.
This proposes to add memory back pressure at the Receiver side, as a complement
to the current back pressure mechanism, to better keep the application in a
stable state.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
