Re: Can't see any thing one the storage panel of application UI

2014-08-05 Thread Akhil Das
with Airmail -- View this message in context: Re: Can't see any thing one the storage panel of application UI http://apache-spark-user-list.1001560.n3.nabble.com/Can-t-see-any-thing-one-the-storage-panel-of-application-UI-tp10296p11403.html Sent from the Apache Spark User

Re: Can't see any thing one the storage panel of application UI

2014-08-05 Thread Andrew Or
can't see the rdd from the web gui. I have changed the code and gained a 10x speed up. -- binbinbin915 Sent with Airmail -- View this message in context: Re: Can't see any thing one the storage panel of application UI http://apache-spark-user-list.1001560.n3

Re: Can't see any thing one the storage panel of application UI

2014-08-04 Thread anthonyjschu...@gmail.com
I am (not) seeing this also... No items in the storage UI page. using 1.0 with HDFS... -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Can-t-see-any-thing-one-the-storage-panel-of-application-UI-tp10296p11361.html Sent from the Apache Spark User List

Re: Can't see any thing one the storage panel of application UI

2014-08-04 Thread Andrew Or
Hi all, Could you check with `sc.getExecutorStorageStatus` to see if the blocks are in fact present? This returns a list of StorageStatus objects, and you can check whether each status' `blocks` is non-empty. If the blocks do exist, then this is likely a bug in the UI. There have been a couple of

Re: Can't see any thing one the storage panel of application UI

2014-08-04 Thread anthonyjschu...@gmail.com
.html To unsubscribe from Can't see any thing one the storage panel of application UI, click here http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=10296code=YW50aG9ueWpzY2h1bHRlQGdtYWlsLmNvbXwxMDI5Nnw2ODA5NTUxMDA= . NAML http://apache

Re: Can't see any thing one the storage panel of application UI

2014-08-04 Thread binbinbin915
Actually, if you don’t use method like persist or cache, it even not store the rdd to the disk. Every time you use this rdd, they just compute it from the original one. In logistic regression from mllib, they don't persist the changed input , so I can't see the rdd from the web gui. I have

Can't see any thing one the storage panel of application UI

2014-07-21 Thread binbinbin915
Hi, I'm running LogisticRegression of mllib. But I can't see the rdd information from storage panel. http://apache-spark-user-list.1001560.n3.nabble.com/file/n10296/a.png http://apache-spark-user-list.1001560.n3.nabble.com/file/n10296/b.png -- View this message in context:

Re: Can't see any thing one the storage panel of application UI

2014-07-21 Thread Preeti Khurana
Am getting the same issue . Spark version : 1.0 On 21/07/14 4:16 PM, binbinbin915 binbinbin...@live.cn wrote: Hi, I'm running LogisticRegression of mllib. But I can't see the rdd information from storage panel. http://apache-spark-user-list.1001560.n3.nabble.com/file/n10296/a.png