Github user maryannxue commented on a diff in the pull request: https://github.com/apache/spark/pull/21602#discussion_r197017717 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DatasetCacheSuite.scala --- @@ -132,4 +132,19 @@ class DatasetCacheSuite extends QueryTest with SharedSQLContext with TimeLimits df.unpersist() assert(df.storageLevel == StorageLevel.NONE) } + + test("SPARK-24613 Cache with UDF could not be matched with subsequent dependent caches") { + val expensiveUDF = udf({x: Int => Thread.sleep(10000); x}) --- End diff -- Accumulators probably wouldn't work. I'll do verify plan though.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org