Re: Sharing Spark RDDs with Ignite

2016-02-02 Thread vkulichenko
Hi Dmitry,

Ignite provides better data distribution and better performance if there are
more partitions than nodes in topology. 1024 is the default number of
partitions, but you can change it by providing custom affinity function
configuration:

CacheConfiguration cfg = new CacheConfiguration("hello-world-cache").
setAffinity(new RendezvousAffinityFunction(false, 32)); // 32 partitions
instead of 1024.
final IgniteRDD igniteRDD = igniteContext.fromCache(cfg);

You can try this and see if it gets better.

Actually, I think that methods like isEmpty should be overridden in
IgniteRDD to use native IgniteCache API, it will be much faster. I created a
ticket for this task [1], feel free to provide your comments there. Are
there any other methods that should be optimized?

[1] https://issues.apache.org/jira/browse/IGNITE-2538

-Val



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/Sharing-Spark-RDDs-with-Ignite-tp2805p2808.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.


Re: How to restrict the "Get" operation in local node

2016-02-02 Thread ght230
I got it. Thank you!



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/How-to-restrict-the-Get-operation-in-local-node-tp2785p2809.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.


Set time limit for particular cache

2016-02-02 Thread Ravi
How to set time limit or see time limits of a particular cache??



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/Set-time-limit-for-particular-cache-tp2810.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.


Re: Loading objects saved as BinaryObject.

2016-02-02 Thread Dmitriy Setrakyan
On Tue, Feb 2, 2016 at 8:26 AM, ghostler  wrote:

> *Problem solved.*
> Forgot set BinaryTypeConfiguration for my classes.
> Will be better, if add support work without this configuration when you set
> types using CacheConfiguration.setTypes, add more information in exception.
>

Glad the issue is resolved. Do you mind filing a ticket in Ignite Jira
 describing your suggestion
and a better error message in exception?


>
>
> --
> View this message in context:
> http://apache-ignite-users.70518.x6.nabble.com/Loading-objects-saved-as-BinaryObject-tp2804p2806.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>


Re: Set time limit for particular cache

2016-02-02 Thread Denis Magda
Hi Ravi,

Seems that expire policy is what you needed
https://apacheignite.readme.io/docs/expiry-policies

--
Denis

On Wed, Feb 3, 2016 at 9:06 AM, Ravi  wrote:

> How to set time limit or see time limits of a particular cache??
>
>
>
> --
> View this message in context:
> http://apache-ignite-users.70518.x6.nabble.com/Set-time-limit-for-particular-cache-tp2810.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>