Re: How to decrease the time of storing block in memory

2015-06-09 Thread Akhil Das
May be you should check in your driver UI and see if there's any GC time involved etc. Thanks Best Regards On Mon, Jun 8, 2015 at 5:45 PM, wrote: > hi there > > I am trying to descrease my app's running time in worker node. I > checked the log and found the most time-wasting part is below

Re: Re: How to decrease the time of storing block in memory

2015-06-09 Thread Akhil Das
Best Regards On Tue, Jun 9, 2015 at 2:09 PM, wrote: > Only 1 minor GC, 0.07s. > > > > > Thanks&Best regards! > San.Luo > > - 原始邮件 - > 发件人:Akhil Das > 收件人:罗辉 > 抄送人:user > 主题:Re: How to decrease the time of storing

回复:Re: How to decrease the time of storing block in memory

2015-06-09 Thread luohui20001
Only 1 minor GC, 0.07s. Thanks&Best regards! San.Luo - 原始邮件 - 发件人:Akhil Das 收件人:罗辉 抄送人:user 主题:Re: How to decrease the time of storing block in memory 日期:2015年06月09日 15点02分 May be you should check in your driver UI and see if there's an

Re: Re: Re: How to decrease the time of storing block in memory

2015-06-09 Thread Akhil Das
> /opt/data/shellcompare/data/user" + j + "/pgs/intermediateResult/result" + > i + ".txt 600") > > pipeModify2.collect() > > sc.stop() > } > } > > > > > Thanks&Best regards! > San.Luo

回复:Re: Re: How to decrease the time of storing block in memory

2015-06-09 Thread luohui20001
llcompare/data/user" + j + "/pgs/intermediateResult/result" + i + ".txt 600") pipeModify2.collect()sc.stop() } } -------------------- Thanks&Best regards! San.Luo - 原始邮件 - 发件人:Akhil Das 收件人:罗辉 抄送人:user 主题:Re: Re: How to decrease the time of storing block i

回复:Re: Re: Re: How to decrease the time of storing block in memory

2015-06-10 Thread luohui20001
i + ".txt 600") pipeModify2.collect() sc.stop() } } -------------------- Thanks&Best regards! San.Luo - 原始邮件 - 发件人:Akhil Das 收件人:罗辉 抄送人:user 主题:Re: Re: How to decrease the time of storing block in memory 日期:2015年06月09日 16点51分 Is it that task taking 1