How to configure Ignite sink connector to use key-value?

Hi, I have 2 connector and 2 worker configuration. The purpose of worker 1 and connector 1 is to fetch data from oracle table and insert it into a Kafka topic in JSON format. The purpose of worker 2 and connector 2 is to fetch data from Kafka topic and insert it into Ignite cache. Below you can see

Correct Way to Store Data

Hello, Right now I have a couple of caches associated with the kind of objects I store. For instance I have one cache for products, one for sales, one for stats, etc. I use the id of the product as the affinity key in all cases. Some questions I have regarding this approach... *1.* I get the imp

Re: MyBatis Ignite L2 cache Integration does not work with Ignite 2.0

Hi Roman, I tried that but after looking at it a bit i realized that the way that the config/default-config.xml is looked up depends on which directory from which one launches the application JVM..for example below are two console logs one launched from the server directory & one launched a few di

Re: IgniteCache.containsKey does not acquire Transaction lock

Hi, cache.containsKey() never locking key (I checked it in Ignite version 1.7 till 2.0), but you can use simple cache.get(). This method (cache.get) will got a lock for particular key, even if returns null. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/IgniteC

How to implement StreamSingleTupleExtractor in Kafka connect Ignite sink?

Hi, I am using Kafka connect Igniite sink. I have JSON records in kafka like; I would like to make a tuple extractor, so that the **BUS_ID** will act as key in Ignite. From the documentation, I have noted that "If you need to create an Ignite key from a Kafka value, implement StreamSingleTupleE

Fwd: Write behind using Grid Gain

-- Forwarded message -- From: Chetan D Date: Fri, May 26, 2017 at 4:51 PM Subject: Fwd: Write behind using Grid Gain To: user@ignite.apache.org Cc: ptupit...@apache.org ++ User List any help much appreciated. Thanks And Regards Chetan D -- Forwarded message -- F

Fwd: Write behind using Grid Gain

++ User List any help much appreciated. Thanks And Regards Chetan D -- Forwarded message -- From: Pavel Tupitsyn Date: Fri, May 26, 2017 at 4:38 PM Subject: Re: Write behind using Grid Gain To: Chetan D Hi Chetan, can you please write this to our user list, user@ignite.apache.

Re: Write behind using Grid Gain

To give everyone context, this is not about GridGain, but about Apache Ignite. The blog post in question is https://ptupitsyn.github.io/Entity-Framework-Cache-Store/ Chetan, I'll prepare an example with Ignite 2.0 / ado.net and post it some time later. Pavel On Fri, May 26, 2017 at 2:32 PM, Chet

Re: Write behind using Grid Gain

Thank you Pavel. waiting for your response. On Fri, May 26, 2017 at 6:03 PM, Pavel Tupitsyn wrote: > To give everyone context, this is not about GridGain, but about Apache > Ignite. > The blog post in question is https://ptupitsyn.github. > io/Entity-Framework-Cache-Store/ > > Chetan, I'll prep

Re: Correct Way to Store Data

Hi Matt, >From what I've seen, the most commonly used approach is the one you took: have caches associated with object classes. This approach is efficient and completely corresponds to "the Ignite way". Having a separate cache for each product is definitely not a good idea, especially if you have

Re: Write behind using Grid Gain

I've decided to write a blog post, since this topic seems to be in demand: https://ptupitsyn.github.io/Ado-Net-Cache-Store/ Code: https://github.com/ptupitsyn/ignite-net-examples/tree/master/AdoNetCacheStore Let me know if this helps! On Fri, May 26, 2017 at 3:50 PM, Chetan D wrote: > Thank yo

New blog post: ADO.NET Ignite Cache Store

Short writeup with example code, inspired by user questions: ADO.NET + Binary Mode Cache Store https://ptupitsyn.github.io/Ado-Net-Cache-Store/

Re: Correct Way to Store Data

Interesting, so #3 is not the way to go. What about #2? That would be the "relational database way of doing it", which is what Ignite uses behind the scene (H2). What's the disadvantage compared to #1? Thanks for sharing your insight. On Fri, May 26, 2017 at 11:28 AM, Ilya Lantukh wrote: > Hi

Re: Correct Way to Store Data

Hi Matt, Ignite cache more or less corresponds to table from relational world. As for caches number: Both ways are possible. In relational world, by the way, you also can place different business objects into one table, but you will have to introduce additional type field. Similar for the

Re: Correct Way to Store Data

I don't think that's correct. As far as I know, on Ignite it's fine to put more than one type on the same cache, because a cache is like a schema (in the relational db world) and not a table. So for each type on a cache, a different table on H2 is created. There's no need for additional logic to f

Re: Correct Way to Store Data

Err, I meant "[...] a different memory policy for different classes", not for "different products". On Fri, May 26, 2017 at 6:00 PM, Matt wrote: > I don't think that's correct. > > As far as I know, on Ignite it's fine to put more than one type on the > same cache, because a cache is like a sche

Re: New blog post: ADO.NET Ignite Cache Store

Great, Pavel! You rock! Prachi, could you send the post to DZone and publish on Ignite’s page? — Denis > On May 26, 2017, at 10:06 AM, Pavel Tupitsyn wrote: > > Short writeup with example code, inspired by user questions: > > ADO.NET + Binary Mode Cache Store > https://ptupi

Re: MyBatis Ignite L2 cache Integration does not work with Ignite 2.0

Hi Roman, I have more updates..the weird issue with the hanging went away after i ran the same jar from another VM...no clue why it is hanging in my original VM. As you mentioned once i physically place config/default-config.xml in my server/ directory it works fine. But this is still a problem i