Re: Set time limit for particular cache

[Denis Magda]

Hi Ravi,

Seems that expire policy is what you needed
https://apacheignite.readme.io/docs/expiry-policies

--
Denis

On Wed, Feb 3, 2016 at 9:06 AM, Ravi  wrote:

> How to set time limit or see time limits of a particular cache??
>
>
>
> --
> View this message in context:
> http://apache-ignite-users.70518.x6.nabble.com/Set-time-limit-for-particular-cache-tp2810.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>

Set time limit for particular cache

[Ravi]

How to set time limit or see time limits of a particular cache??



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/Set-time-limit-for-particular-cache-tp2810.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: How to restrict the "Get" operation in local node

[ght230]

I got it. Thank you!



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/How-to-restrict-the-Get-operation-in-local-node-tp2785p2809.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Sharing Spark RDDs with Ignite

[vkulichenko]

Hi Dmitry,

Ignite provides better data distribution and better performance if there are
more partitions than nodes in topology. 1024 is the default number of
partitions, but you can change it by providing custom affinity function
configuration:

CacheConfiguration cfg = new CacheConfiguration("hello-world-cache").
setAffinity(new RendezvousAffinityFunction(false, 32)); // 32 partitions
instead of 1024.
final IgniteRDD igniteRDD = igniteContext.fromCache(cfg);

You can try this and see if it gets better.

Actually, I think that methods like isEmpty should be overridden in
IgniteRDD to use native IgniteCache API, it will be much faster. I created a
ticket for this task [1], feel free to provide your comments there. Are
there any other methods that should be optimized?

[1] https://issues.apache.org/jira/browse/IGNITE-2538

-Val



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/Sharing-Spark-RDDs-with-Ignite-tp2805p2808.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Loading objects saved as BinaryObject.

[Dmitriy Setrakyan]

On Tue, Feb 2, 2016 at 8:26 AM, ghostler  wrote:

> *Problem solved.*
> Forgot set BinaryTypeConfiguration for my classes.
> Will be better, if add support work without this configuration when you set
> types using CacheConfiguration.setTypes, add more information in exception.
>

Glad the issue is resolved. Do you mind filing a ticket in Ignite Jira
 describing your suggestion
and a better error message in exception?


>
>
> --
> View this message in context:
> http://apache-ignite-users.70518.x6.nabble.com/Loading-objects-saved-as-BinaryObject-tp2804p2806.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>

Re: Loading objects saved as BinaryObject.

[ghostler]

*Problem solved.*
Forgot set BinaryTypeConfiguration for my classes.
Will be better, if add support work without this configuration when you set
types using CacheConfiguration.setTypes, add more information in exception.



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/Loading-objects-saved-as-BinaryObject-tp2804p2806.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Sharing Spark RDDs with Ignite

[Dmitriy Morozov]

Hello everyone!

I'm new to Ignite and currently assessing Ignite's ability to share Spark
RDD's.
What I'm trying to test if Ignite can cache Spark RDD and make it available
to multiple applications until this cache gets invalidated.

Following is a very limited test that I used to see what happens when I
save IgniteRDD.

public class SharedRddExample {
public static void main(String[] args) {
final SparkConf sparkConf = new SparkConf()
.setAppName("shared-rdd-example")
.setMaster("local");

final JavaSparkContext sparkContext = new JavaSparkContext(sparkConf);

final IgniteContext igniteContext = new
IgniteContext(sparkContext.sc(), "ignite/client-default-config.xml",
true);
final IgniteRDD igniteRDD =
igniteContext.fromCache("hello-world-cache");

final JavaRDD javaRDD = igniteRDD.toJavaRDD();
if (javaRDD.isEmpty()) {
final JavaRDD rdd =
sparkContext.parallelize(Collections.singletonList("Hello World"));
igniteRDD.saveValues(rdd.rdd());
} else {
javaRDD.collect().forEach(System.out::println);
}
}
}

Ignite configuration for client node:











127.0.0.1:47500..47509








Server node uses the same configuration as above but with clientMode set to
false.

The code above creates IgniteRDD with 1024 partitions which results in
Spark creating 1024 tasks just to execute *javaRDD.isEmpty()*.

My question is how do I make it faster?

Why does Ignite use 1024 for IgniteRDD by default?

Do I need a special Ignite config?

I'm using Ignite 1.5.0-final.

Thanks,
Dima

Loading objects saved as BinaryObject.

[Александр Малышев]

Hello.
I have service wtich save some data as BinaryObject in cache. Service and
ignite nodes don't have classes, but service know classes names.
Can I load this objects on client with normal classes? Client contains
needed classes.
I tried do it on one node, but got exception java.io.FileNotFound:
\.classname. When I put .classname with
right class name, all work fine.
Saved BinaryObjects loaded from cache without problems with all fields.
-- 
Aleksandr

Re: How to restrict the "Get" operation in local node

[Denis Magda]

The next Ignite version that will be released is 1.6.

To my knowledge there is no any concrete release date negotiated by 
community members.


In any case if it's critical for you it's always possible to assemble 
binaries on your own.


Regards,
Denis

On 2/2/2016 10:13 AM, ght230 wrote:

Thank you for your reply.

BTW, do you know when version 1.5.5 will be released?



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/How-to-restrict-the-Get-operation-in-local-node-tp2785p2800.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Exception in Kerberos Yarn cluster

[Denis Magda]

Hi,

No one has picked up this ticket yet [1].

If you're interested you can take over it and contribute to Ignite. Are you?

[1] https://issues.apache.org/jira/browse/IGNITE-2525

Regards,
Denis

On 2/2/2016 10:41 AM, lrea.sys wrote:

Hi,
is there any progress about ignite running long time applications on yarn
cluster with kerberos authentication?



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/Exception-in-Kerberos-Yarn-cluster-tp1950p2801.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.