wuyi created SPARK-27568: ---------------------------- Summary: readLock leaked when method take() called on a cached rdd Key: SPARK-27568 URL: https://issues.apache.org/jira/browse/SPARK-27568 Project: Spark Issue Type: Improvement Components: Spark Core Affects Versions: 2.4.0, 2.3.0, 2.2.0, 2.1.0, 2.0.0 Reporter: wuyi
{code:java} sc.parallelize(Range(0, 10), 1).cache().take(1){code} if execute the above code in Spark, we'll see the line below in log: *19/04/25 23:48:54 INFO Executor: 1 block locks were not released by TID = 0:* *[rdd_0_0]* and, If we set "spark.storage.exceptionOnPinLeak"=true, job will fail. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org