Re: RDD generated on every query

[twinkle sachdeva]

Hi,

If you have the same spark context, then you can cache the query result via
caching the table ( sqlContext.cacheTable("tableName") ).

Maybe you can have a look at OOyola server also.



On Tue, Apr 14, 2015 at 11:36 AM, Akhil Das 
wrote:

> You can use a tachyon based storage for that and everytime the client
> queries, you just get it from there.
>
> Thanks
> Best Regards
>
> On Mon, Apr 6, 2015 at 6:01 PM, Siddharth Ubale <
> siddharth.ub...@syncoms.com> wrote:
>
>>  Hi ,
>>
>>
>>
>> In Spark Web Application the RDD is generating every time client is
>> sending a query request. Is there any way where the RDD is compiled once
>> and run query again and again on active SparkContext?
>>
>>
>>
>> Thanks,
>>
>> Siddharth Ubale,
>>
>> *Synchronized Communications *
>>
>> *#43, Velankani Tech Park, Block No. II, *
>>
>> *3rd Floor, Electronic City Phase I,*
>>
>> *Bangalore – 560 100*
>>
>> *Tel : +91 80 3202 4060*
>>
>> *Web:* *www.syncoms.com* 
>>
>> *[image: LogoNEWmohLARGE]*
>>
>> *London*|*Bangalore*|*Orlando*
>>
>>
>>
>> *we innovate, plan, execute, and transform the business​*
>>
>>
>>
>
>

Re: RDD generated on every query

[Akhil Das]

You can use a tachyon based storage for that and everytime the client
queries, you just get it from there.

Thanks
Best Regards

On Mon, Apr 6, 2015 at 6:01 PM, Siddharth Ubale  wrote:

>  Hi ,
>
>
>
> In Spark Web Application the RDD is generating every time client is
> sending a query request. Is there any way where the RDD is compiled once
> and run query again and again on active SparkContext?
>
>
>
> Thanks,
>
> Siddharth Ubale,
>
> *Synchronized Communications *
>
> *#43, Velankani Tech Park, Block No. II, *
>
> *3rd Floor, Electronic City Phase I,*
>
> *Bangalore – 560 100*
>
> *Tel : +91 80 3202 4060*
>
> *Web:* *www.syncoms.com* 
>
> *[image: LogoNEWmohLARGE]*
>
> *London*|*Bangalore*|*Orlando*
>
>
>
> *we innovate, plan, execute, and transform the business​*
>
>
>