[ https://issues.apache.org/jira/browse/SPARK-21512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16097565#comment-16097565 ]
Kazuaki Ishizaki edited comment on SPARK-21512 at 7/24/17 4:53 AM: ------------------------------------------------------------------- When {{DatasetCacheSuite}} is executed, the following warning messages appear. Unpersistent dataset is made persistent in the second test case {{"persist and then rebind right encoder when join 2 datasets"}} after the first test case {{"get storage level"}} made it persistent. Thus, we run these test cases, the second case does not perform to make dataset persistent. This is because in When we run only the second case, it performs to make dataset persistent. It is not good to change behavior of the second test suite. The first test case should correctly make dataset unpersistent. {code} 01:52:48.595 WARN org.apache.spark.sql.execution.CacheManager: Asked to cache already cached data. 01:52:48.692 WARN org.apache.spark.sql.execution.CacheManager: Asked to cache already cached data. {code} was (Author: kiszk): When {DatasetCacheSuite} is executed, the following warning messages appear. Unpersistent dataset is made persistent in the second test case {{"persist and then rebind right encoder when join 2 datasets"}} after the first test case {{"get storage level"}} made it persistent. Thus, we run these test cases, the second case does not perform to make dataset persistent. This is because in When we run only the second case, it performs to make dataset persistent. It is not good to change behavior of the second test suite. The first test case should correctly make dataset unpersistent. {code} 01:52:48.595 WARN org.apache.spark.sql.execution.CacheManager: Asked to cache already cached data. 01:52:48.692 WARN org.apache.spark.sql.execution.CacheManager: Asked to cache already cached data. {code} > DatasetCacheSuite needs to execute unpersistent after executing peristent > ------------------------------------------------------------------------- > > Key: SPARK-21512 > URL: https://issues.apache.org/jira/browse/SPARK-21512 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 2.3.0 > Reporter: Kazuaki Ishizaki > Assignee: Kazuaki Ishizaki > Fix For: 2.3.0 > > -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org