[jira] [Comment Edited] (SPARK-33981) SparkUI: Storage page is empty even if cached
[ https://issues.apache.org/jira/browse/SPARK-33981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259377#comment-17259377 ] Maple edited comment on SPARK-33981 at 1/6/21, 5:48 AM: I know what's the problem. On spark history server UI,default 18080 port, the storage page is empty,even though the application is running. And on yarn ui, default 8088 port, [http://localhost:8088/proxy/application_1609225827199_0004/storage/] the storage page is not empty when application is running,if the application completes,storage page becomes empty. was (Author: 995582386): I know what's the problem. On spark history server UI,default 18080 port, the storage page is empty,even though the application is running. And on yarn ui, default 8088, [http://localhost:8088/proxy/application_1609225827199_0004/storage/] the storage page is not empty when application is running,if the application completes,storage page becomes empty. > SparkUI: Storage page is empty even if cached > - > > Key: SPARK-33981 > URL: https://issues.apache.org/jira/browse/SPARK-33981 > Project: Spark > Issue Type: Question > Components: Web UI >Affects Versions: 2.3.3 > Environment: spark 2.3.3 >Reporter: Maple >Priority: Major > Attachments: ba5a987152c6270f34b968bd89ca36a.png > > > scala> import org.apache.spark.storage.StorageLevel > import org.apache.spark.storage.StorageLevel > scala> val rdd = sc.parallelize(1 to 10, > 1).persist(StorageLevel.MEMORY_ONLY_2) > rdd: org.apache.spark.rdd.RDD[Int] = ParallelCollectionRDD[0] at parallelize > at :25 > scala> rdd.count > res0: Long = 10 > but SparkUI storage page is empty -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Comment Edited] (SPARK-33981) SparkUI: Storage page is empty even if cached
[ https://issues.apache.org/jira/browse/SPARK-33981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259377#comment-17259377 ] Maple edited comment on SPARK-33981 at 1/6/21, 5:33 AM: I know what's the problem. On spark history server UI,default 18080 port, the storage page is empty,even though the application is running. And on yarn ui, default 8088, [http://localhost:8088/proxy/application_1609225827199_0004/storage/] the storage page is not empty when application is running,if the application completes,storage page becomes empty. was (Author: 995582386): I know what's the problem. On spark history server UI,default 18080 port, the storage page is empty.even though the application is running. And on yarn ui, default 8088, [http://localhost:8088/proxy/application_1609225827199_0004/storage/] the storage page is not empty when application is running,if the application completes,storage page becomes empty. > SparkUI: Storage page is empty even if cached > - > > Key: SPARK-33981 > URL: https://issues.apache.org/jira/browse/SPARK-33981 > Project: Spark > Issue Type: Question > Components: Web UI >Affects Versions: 2.3.3 > Environment: spark 2.3.3 >Reporter: Maple >Priority: Major > Attachments: ba5a987152c6270f34b968bd89ca36a.png > > > scala> import org.apache.spark.storage.StorageLevel > import org.apache.spark.storage.StorageLevel > scala> val rdd = sc.parallelize(1 to 10, > 1).persist(StorageLevel.MEMORY_ONLY_2) > rdd: org.apache.spark.rdd.RDD[Int] = ParallelCollectionRDD[0] at parallelize > at :25 > scala> rdd.count > res0: Long = 10 > but SparkUI storage page is empty -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Comment Edited] (SPARK-33981) SparkUI: Storage page is empty even if cached
[ https://issues.apache.org/jira/browse/SPARK-33981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259377#comment-17259377 ] Maple edited comment on SPARK-33981 at 1/6/21, 5:31 AM: I know what's the problem. On spark history server UI,default 18080 port, the storage page is empty.even though the application is running. And on yarn ui, default 8088, [http://localhost:8088/proxy/application_1609225827199_0004/storage/] the storage page is not empty when application is running,if the application completes,storage page becomes empty. was (Author: 995582386): I know what's the problem. On spark history server UI,default 18080 port, the storage page is empty.even though the application is running. And on yarn ui, default 8088, [http://localhost:8088/proxy/application_1609225827199_0004/storage/] the storage page is not empty when application is running,if the application complete,storage page becomes empty. > SparkUI: Storage page is empty even if cached > - > > Key: SPARK-33981 > URL: https://issues.apache.org/jira/browse/SPARK-33981 > Project: Spark > Issue Type: Question > Components: Web UI >Affects Versions: 2.3.3 > Environment: spark 2.3.3 >Reporter: Maple >Priority: Major > Attachments: ba5a987152c6270f34b968bd89ca36a.png, > image-2021-01-06-11-19-09-849.png, image-2021-01-06-11-20-49-804.png, > screenshot-1.png > > > scala> import org.apache.spark.storage.StorageLevel > import org.apache.spark.storage.StorageLevel > scala> val rdd = sc.parallelize(1 to 10, > 1).persist(StorageLevel.MEMORY_ONLY_2) > rdd: org.apache.spark.rdd.RDD[Int] = ParallelCollectionRDD[0] at parallelize > at :25 > scala> rdd.count > res0: Long = 10 > but SparkUI storage page is empty -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Comment Edited] (SPARK-33981) SparkUI: Storage page is empty even if cached
[ https://issues.apache.org/jira/browse/SPARK-33981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259377#comment-17259377 ] Maple edited comment on SPARK-33981 at 1/6/21, 5:30 AM: I know what's the problem. On spark history server UI,default 18080 port, the storage page is empty.even though the application is running. And on yarn ui, default 8088, [http://localhost:8088/proxy/application_1609225827199_0004/storage/] the storage page is not empty when application is running,if the application complete,storage page becomes empty. was (Author: 995582386): I try in Spark 2.4.7,it still exists. !image-2021-01-06-11-20-49-804.png! !screenshot-1.png!!image-2021-01-06-11-19-09-849.png! > SparkUI: Storage page is empty even if cached > - > > Key: SPARK-33981 > URL: https://issues.apache.org/jira/browse/SPARK-33981 > Project: Spark > Issue Type: Question > Components: Web UI >Affects Versions: 2.3.3 > Environment: spark 2.3.3 >Reporter: Maple >Priority: Major > Attachments: ba5a987152c6270f34b968bd89ca36a.png, > image-2021-01-06-11-19-09-849.png, image-2021-01-06-11-20-49-804.png, > screenshot-1.png > > > scala> import org.apache.spark.storage.StorageLevel > import org.apache.spark.storage.StorageLevel > scala> val rdd = sc.parallelize(1 to 10, > 1).persist(StorageLevel.MEMORY_ONLY_2) > rdd: org.apache.spark.rdd.RDD[Int] = ParallelCollectionRDD[0] at parallelize > at :25 > scala> rdd.count > res0: Long = 10 > but SparkUI storage page is empty -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Comment Edited] (SPARK-33981) SparkUI: Storage page is empty even if cached
[ https://issues.apache.org/jira/browse/SPARK-33981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259377#comment-17259377 ] maple edited comment on SPARK-33981 at 1/6/21, 3:20 AM: I try in Spark 2.4.7,it still exists. !image-2021-01-06-11-20-49-804.png! !screenshot-1.png!!image-2021-01-06-11-19-09-849.png! was (Author: 995582386): I try in Spark 2.4.7,it still exists. !screenshot-1.png!!image-2021-01-06-11-19-09-849.png! > SparkUI: Storage page is empty even if cached > - > > Key: SPARK-33981 > URL: https://issues.apache.org/jira/browse/SPARK-33981 > Project: Spark > Issue Type: Question > Components: Web UI >Affects Versions: 2.3.3 > Environment: spark 2.3.3 >Reporter: maple >Priority: Major > Attachments: ba5a987152c6270f34b968bd89ca36a.png, > image-2021-01-06-11-19-09-849.png, image-2021-01-06-11-20-49-804.png, > screenshot-1.png > > > scala> import org.apache.spark.storage.StorageLevel > import org.apache.spark.storage.StorageLevel > scala> val rdd = sc.parallelize(1 to 10, > 1).persist(StorageLevel.MEMORY_ONLY_2) > rdd: org.apache.spark.rdd.RDD[Int] = ParallelCollectionRDD[0] at parallelize > at :25 > scala> rdd.count > res0: Long = 10 > but SparkUI storage page is empty -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
