Re: rdd.cache() not working ?

2015-04-01 Thread Taotao.Li
rerun person.count and you will see the performance of cache. person.cache would not cache it right now. It'll actually cache this RDD after one action[person.count here] - 原始邮件 - 发件人: fightf...@163.com 收件人: user user@spark.apache.org 发送时间: 星期三, 2015年 4 月 01日 下午 1:21:25 主题:

Re: Re: rdd.cache() not working ?

2015-04-01 Thread Sean Owen
performance showed from web ui storage. Thanks, Sun. fightf...@163.com From: Taotao.Li Date: 2015-04-01 14:02 To: fightfate CC: user Subject: Re: rdd.cache() not working ? rerun person.count and you will see the performance of cache. person.cache would

Re: Re: rdd.cache() not working ?

2015-04-01 Thread Yuri Makhno
. -- fightf...@163.com *From:* Taotao.Li taotao...@datayes.com *Date:* 2015-04-01 14:02 *To:* fightfate fightf...@163.com *CC:* user user@spark.apache.org *Subject:* Re: rdd.cache() not working ? rerun person.count and you will see the performance of cache. person.cache would not cache it right now

Re: Re: rdd.cache() not working ?

2015-04-01 Thread fightf...@163.com
Hi Still no good luck with your guide. Best. Sun. fightf...@163.com From: Yuri Makhno Date: 2015-04-01 15:26 To: fightf...@163.com CC: Taotao.Li; user Subject: Re: Re: rdd.cache() not working ? cache() method returns new RDD so you have to use something like this: val person

Re: Re: rdd.cache() not working ?

2015-04-01 Thread fightf...@163.com
Hi That is just the issue. After running person.cache we then run person.count however, there still not be any cache performance showed from web ui storage. Thanks, Sun. fightf...@163.com From: Taotao.Li Date: 2015-04-01 14:02 To: fightfate CC: user Subject: Re: rdd.cache() not working

Re: Re: rdd.cache() not working ?

2015-04-01 Thread fightf...@163.com
not be any cache performance showed from web ui storage. Thanks, Sun. fightf...@163.com From: Taotao.Li Date: 2015-04-01 14:02 To: fightfate CC: user Subject: Re: rdd.cache() not working ? rerun person.count and you will see the performance of cache