Tathagata Das created SPARK-1400: ------------------------------------ Summary: Spark Streaming's received data is not cleaned up from BlockManagers when not needed any more Key: SPARK-1400 URL: https://issues.apache.org/jira/browse/SPARK-1400 Project: Spark Issue Type: Bug Components: Streaming Affects Versions: 0.9.0 Reporter: Tathagata Das
Spark Streaming generates BlockRDDs with the data received over the network. These data blocks are not automatically cleared, they spill over from memory based on LRU, which slows down processing. -- This message was sent by Atlassian JIRA (v6.2#6252)