Support for Java records in cache

2024-04-11 Thread Victor
lear which Ignite API this code should be using. Thanks, Victor

Cache put event new value type

2024-04-11 Thread Victor
Hi In Ignite 2.16, I seeing that newVal method of cache event returns a BinaryObjectImpl. Is it possible to make it return actual user-defined type contained in cache, by some config value? Wasn't able to find relevant info in docs. Thanks, Victor

Re: Odd behavior/bug with DataRegion

2020-07-23 Thread Victor
Update, Interestingly, i took the value to the wire, setting 'emptyPagesPoolSize' to 510 (< 512) and that seems to have done the trick. Atleast in my past 5 test run's the preload has gone through fine. Right now i have set it to pretty much the max value, since there is no good way to identify w

Re: Checking dataregion limits

2020-07-23 Thread Victor
Correction, max size is indeed in MB, 'offHeapSize' is in bytes, which maps to max size. I was looking for similar attribute for initial size in bytes. But i didn't find one. That is ok i guess. MB value works too. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Odd behavior/bug with DataRegion

2020-07-23 Thread Victor
On further reading around DataRegionConfiguration. I see 'setEmptyPagesPoolSize', it says, "Increase this parameter if cache can contain very big entries (total size of pages in this pool should be enough to contain largest cache entry). Increase this parameter if IgniteOutOfMemoryException occurr

Re: Checking dataregion limits

2020-07-23 Thread Victor
Thanks Evgenii, this helps get some perspective. It's confusing with maxSize being shown in bytes and the initialSize being shown in MB. Enabling metrics, does it entail any performance drop or can it be enabled in production as well. I'll run my tests anyway. -- Sent from: http://apache-igni

Odd behavior/bug with DataRegion

2020-07-23 Thread Victor
gnite-core-2.8.1.jar:2.8.1] at org.apache.ignite.internal.processors.cache.persistence.RowStore.addRow(RowStore.java:108) [ignite-core-2.8.1.jar:2.8.1] ... Not sure why is the expiration policy not kicking in. Is this a bug? Any inputs appreciated. Victor -- Sent from: http://apache-ig

Checking dataregion limits

2020-07-21 Thread Victor
atedSize already at 8 mb, even before data was added to the cache. 5. Finally if "TotalAllocatedSize" is indeed the attribute to track the size increment, i should expect eviction to kick in when its value reaches 90% of the max size. Is this understanding correct? I'll run some more t

Re: Setting Cache Size using Max Records

2020-07-13 Thread Victor
>From what i have read so far, seems like if i have 2 caches each to be configured with 50MB, then i need to define 2 identical regions with unique names and apply to each of the caches. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Setting Cache Size using Max Records

2020-07-12 Thread Victor
Thanks Denis this helps. Btw, one thing to check, if you create a 25MB region and multiple cache's are associated to that region, do all the caches share the region capacity or just share the configuration but each cache will be allocated a 25MB capacity? -- Sent from: http://apache-ignite-user

Re: Setting Cache Size using Max Records

2020-06-30 Thread Victor
), be able to inspect the capacity a row can hold based on the column datatypes? 2. Can the Dataregion be set post the cache is created? Thanks, Victor -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Setting Cache Size using Max Records

2020-06-25 Thread Victor
Iiya/ Denis, I am aware of the Data Region with max size as bytes. I was looking for way to do this via number of records. Anyway, seems there is no way in Ignite to do this today. I am looking at couple of other options to achieve this, for that same i am looking at a way to calculate the stora

Re: Setting Cache Size using Max Records

2020-06-24 Thread Victor
Hi Denis, For our product we are using an in-house solution where we expose the size in records. Now we are looking at replacing it with Ignite. So we wanted to make the experience seamless and let the end user's continue to set the same configuration they are familiar with, rather than adding a n

Setting Cache Size using Max Records

2020-06-24 Thread Victor
Hi, I am looking to set the cache size for off-heap via number of max records instead of max bytes. Similar to how LRU eviction policy for on-heap can set it. Haven't found anything around that. Is that doable, if yes, how do i go about it? Thanks, Vic -- Sent from: http://apache-ignite-users

Re: Client Vs Server Configuration

2020-01-21 Thread Victor
then i will have to implement the server nodes as well, right? Regards, Victor -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Client Vs Server Configuration

2020-01-20 Thread Victor
any pros/con's with not having the config on the sever end, performance, n/w hops, etc? Thanks, Victor -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: PutAll Behavior Single vs Multiple Servers

2019-12-12 Thread Victor
Denis, i get that about when to scale. And with my test, these are fairly large boxes with lots of head room. Hardly doing 10% or less CPU wise. But why do i see a performance difference when i put data into 1 node vs 3 node with PRIMARY_SYNC turned on. Shouldn't the behavior and workflow be the

Re: PutAll Behavior Single vs Multiple Servers

2019-12-11 Thread Victor
I am aware of those nuances around distributed systems. What i am trying to understand is, with Sync mode as PRIMARY_SYNC, where the response does not wait for updates to backups, so long as primary node is updated. With this setting why should 1 node vs 3 node matter? -- Sent from: http://apa

Re: PutAll Behavior Single vs Multiple Servers

2019-12-09 Thread Victor
Any pointers to understand this behavior? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

PutAll Behavior Single vs Multiple Servers

2019-12-05 Thread Victor
Hi Folks, I am doing a putAll test with a simple Employee Pojo, stored as binary. The cache is configured with, Atomicity Mode = Transactional Write Sync Mode = Full Sync Backup Count - 1 Deployment config is, 2 large linux boxes, Box 1 - 3 server nodes Box 2 - 1 client node 500k load with batc

Re: Improving Get operation performance

2019-12-05 Thread Victor
Update, 1. So there were 2 issues, there was old batch processing app that periodically ran, that loaded lot of data in memory. Which i think was causing some memory contention. So i shut that down for me tests. 2. Thread dumps showed some odd wait times between 2 get calls. I had overtly complic

Re: Improving Get operation performance

2019-11-28 Thread Victor
Not sure i follow. The data is on server node/s. Even for a single/multiple requests, 'get' from a client will need to make a n/w round trip if server and client are on different boxes vs both being on the same box. So n/w latency becomes quite relevant. -- Sent from: http://apache-ignite-users.

Re: Improving Get operation performance

2019-11-27 Thread Victor
Performed one more test. Moved the client on the same box, and changed the off & on heap values. The Employee record is barely about 75-100bytes. So 500k records would just range between 40-50mb + 1 backup, so another 40-50mb, so about 100mb worth of data. I set the off-heap to 1GB and -Xmx to 1G

Re: Improving Get operation performance

2019-11-27 Thread Victor
Yes, ran Cassandra on the same box. Similar config, 3 nodes on one box and client on another. Have about 75G on both boxes. However for now, i am keeping Cassandra aside, since my primary goal around evaluating Ignite is to see similar performance numbers for "get" as seen in the benchmark. --

Re: Improving Get operation performance

2019-11-27 Thread Victor
Thanks Denis for confirming the benchmarks are real. I am using the latest ignite version i.e. 2.6.7. I tried with Atomic as well, don't see much variation. Marginal changes. So currently, in my test, I am using /examples/config/persistentstore/example-persistent-store.xml, with persistence dis

Re: Improving Get operation performance

2019-11-26 Thread Victor
It's 500k unique gets, spread across multiple threads. Max i tried with 30 threads. I cant use getAll for this usecase, since it is user driven and the user will load one record at a time. In any case i expected event the single gets to be pretty fast as well. Given the benchmark reference - https

Improving Get operation performance

2019-11-26 Thread Victor
I am running some comparison tests (ignite vs cassandra) to check how to improve the performance of 'get' operation. The data is fairly straightforward. A simple Employee Object(10 odd fields), being stored as BinaryObject in the cache as IgniteCache empCache; The cache is configured with, Write

Re: Ignite JDBC Driver -> JDBC Connection Pool

2016-11-09 Thread Victor Chan
When C3P0 attempts to create a new connection pool, it first tries to set the isolation level for each transaction through the connection provided by the JDBC driver. At this point, when the method getTransactionIsolation() is called on the Connection, the Ignite driver throws the SQLFeatureNotSup

Ignite JDBC Driver -> JDBC Connection Pool

2016-11-09 Thread Victor Chan
Hi Ignite community, I'm making the switch from SparkSQL to Ignite, but I noticed the Ignite JDBC driver doesn't seem to support any transactions at all. As a result, I've been having some difficulty setting up a connection pool. I've tried with C3P0 and HikariCP, but again due to the driver not