Reynold Xin created SPARK-3018: ---------------------------------- Summary: Release all BlockFetcherIterator upon task completion/failure Key: SPARK-3018 URL: https://issues.apache.org/jira/browse/SPARK-3018 Project: Spark Issue Type: Sub-task Reporter: Reynold Xin
BlockFetcherIterator retains ReferenceCountedBuffers returned by client.fetchBlocks. Those buffers are released when the iterators are traversed fully. In the case of task failures or completion without depleting the iterator, this could lead to memory leak. -- This message was sent by Atlassian JIRA (v6.2#6252) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org