[ https://issues.apache.org/jira/browse/SPARK-33981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17259377#comment-17259377 ]
Maple edited comment on SPARK-33981 at 1/6/21, 5:30 AM: -------------------------------------------------------- I know what's the problem. On spark history server UI,defaultĀ 18080 port, the storage page is empty.even though the application is running. And on yarn ui, default 8088, [http://localhost:8088/proxy/application_1609225827199_0004/storage/] the storage page is not empty when application is running,if the application complete,storage page becomes empty. was (Author: 995582386): I try in Spark 2.4.7,it still exists. !image-2021-01-06-11-20-49-804.png! !screenshot-1.png!!image-2021-01-06-11-19-09-849.png! > SparkUI: Storage page is empty even if cached > --------------------------------------------- > > Key: SPARK-33981 > URL: https://issues.apache.org/jira/browse/SPARK-33981 > Project: Spark > Issue Type: Question > Components: Web UI > Affects Versions: 2.3.3 > Environment: spark 2.3.3 > Reporter: Maple > Priority: Major > Attachments: ba5a987152c6270f34b968bd89ca36a.png, > image-2021-01-06-11-19-09-849.png, image-2021-01-06-11-20-49-804.png, > screenshot-1.png > > > scala> import org.apache.spark.storage.StorageLevel > import org.apache.spark.storage.StorageLevel > scala> val rdd = sc.parallelize(1 to 10, > 1).persist(StorageLevel.MEMORY_ONLY_2) > rdd: org.apache.spark.rdd.RDD[Int] = ParallelCollectionRDD[0] at parallelize > at <console>:25 > scala> rdd.count > res0: Long = 10 > but SparkUI storage page is empty -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org