Re: Continuous Query on Multiple caches

Hi, In our case data is coming from 2 kafka streams. We want to compare current data from 2 streams and take some action(e.g. raise alert). We want to make this processing event based i.e. as soon as data comes from 2 streams, we should take action associated with this event. For example,

Configure Apache-Ignite as Out-Proc instead of in-Proc

Hi , Is there any configuration to make Apache-Ignite to run as Out-Proc instead of in-Proc thanks -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Configure-Apache-Ignite-as-Out-Proc-instead-of-in-Proc-tp16471.html Sent from the Apache Ignite Users mailing

Re: We want to configure near cache on client so that we can handle high TPS items and avoid network call to server

Point 5. According to documentation "utilizing Ignite with affinity colocation, near caches should not be used". -- View this message in context:

Re: Retrieving multiple keys with filtering

Andrey, I am not sure I understand. According to EntryProcessor API [1] you can chose to return nothing. Also, to my knowledge, you can still do parallel reads while executing the EntryProcessor. Perhaps other community members can elaborate on this. [1]

Reusing CacheStores connections?

Hi, Following the documentation I came up with the following code, but now I wonder if this is really the way to go with CacheStores. https://gist.github.com/fdc613759d4d7a845631e0b71aafa559 Using a profiler I found out openConnection() is executed more than 1000 times, on this method alone my

Re: DataStreamer operation failed

Hello Pranas, We had similar issues when having client node and server. If you find out how to fix it, would appreciate if you could post the solution here. Jessie On Mon, Aug 28, 2017 at 4:57 PM, Pranas Baliuka wrote: > Thanks Konstantin in looking at it, > > The issue

Why DataStreamer.flush() is not flushing?

I'm trying to add 100M time series measurements in chunks of BLOCK = 4_500 per value using structure: Key: public class Key { private int securityId; private long date; Value: public class OHLC { private long date; private int securityId; private int size; private long[] time;

Re: DataStreamer operation failed

Thanks Konstantin in looking at it, The issue was what server node and client node serialization was not compatible. Moved to and using single server type node for further testing. -- View this message in context:

Re: Cluster segmentation

Hi Val, Did you get a chance to look at the code snippet I shared? If I understand correctly then when I do get() on cache, it creates a copy of the value and return that copy. Do you think turning off that behavior will help? Thanks, Biren On 8/24/17, 2:16 PM, "vkulichenko"

We want to configure near cache on client so that we can handle high TPS items and avoid network call to server

Below are the questions related to near cache on client side: 1. Is the below configuration is the correct way - 1000 items per client and evict the entries if not accessed in 5 seconds? NearCacheConfiguration nearConf = new NearCacheConfiguration<>();

Ignite 2.0 transaction timeout not holding up

Hi, I am using Ignite 2.0 and working with transactions with a 60 seconds timeout. In the logs I see Ignite timeout exceptions with timeout less than 60 seconds in the exception message. The transaction concurrency has been set to PESSIMISTIC and the transaction isolation level is

Ignite 2.0 server node shutdown

Hi, Does a Ignite server node shutdown automatically after a period of inactivity? I am using Ignite 2.0 and found one of my node shutdown with the following logs (below). The last 6 hours of logs just have the node metrics, essentially no application activity. Will the node shutdown under such

Re: Testing Ignite Applications Locally

Yakov, ok. I'll do that On Mon, Aug 28, 2017 at 6:19 PM, Yakov Zhdanov wrote: > >As far as Maven archetype, Yakov, is the only purpose of it to load a > project, so users can add tests to it? > > Yes, but not just add. We will also be providing test examples, data > loading

NullPointerException at unwrapBinariesIfNeeded(GridCacheContext.java:1719)

Dear All, I was wondering if this is a know issue (I am using 2.0) and if I could prevent it somehow. I has happened only twice and is not reproducible and was generated when iterating query cursor: try (QueryCursor> cursor = cache.query(sqlQuery)) { for (List row :

Re: Equally distributing Kafka topics within the cluster

Thank you Slava, I am testing some solutions and if this yields something to be proud of then I will share definitely... regards, zbyszek -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Equally-distributing-Kafka-topics-within-the-cluster-tp16377p16458.html

Re: Retrieving multiple keys with filtering

Dmitriy, It's good to be back!  Glad to find Ignite community as vibrant and thriving as ever! Speaking of invokeAll(), even if we ignore for a moment the overhead associated with locking/unlocking a cache entry prior to passing it to the EntryProcessor as well as the overhead associated

Re: Cache.destroy() & close() does not delete SwapFile Ignite 2.0

Hi, Deletion happens on next startup of the node. Kind regards, Alex. On Thu, Aug 24, 2017 at 7:13 PM, Ramzinator [via Apache Ignite Users] < ml+s70518n16401...@n6.nabble.com> wrote: > Hi > > It appears that even when the ignite node shuts down, it does not delete > the created cache files. >

Re: SqlFieldsQuery NPE on my schema

Hello, I tried the code you provided with Apache Ignite 2.1.0 and it works without errors. Could you check your code with the latest Apache Ignite version? If the issue is still reproducible, could you provide a simple reproducer (for instance maven project on github)? Thanks. -- View this

Re: Testing Ignite Applications Locally

>As far as Maven archetype, Yakov, is the only purpose of it to load a project, so users can add tests to it? Yes, but not just add. We will also be providing test examples, data loading application sample, shell scripts, etc. This can be pretty handy thing to create project with all dependencies

Re: Testing Ignite Applications Locally

Sergey, can you please elaborate? --Yakov 2017-08-26 23:51 GMT+03:00 Sergey Kozlov : > The idea is great! > > Also I would suggest an ability to run new (modified) tests 100 times in > loop on the CI server to make sure that they don't cause no sporadic > failures (we can

Re: CacheMode - REPLICATED related questions

Answers for all your questions (except of 4th) here depend on cache write synchronization mode. In case of FULL_SYNC mode the exception will be thrown on the client and you will be able to catch and process it. For PRIMARY_SYNC and FULL_ASYNC modes the client will get successful result and it's

Re: CacheMode - REPLICATED related questions

Hi Agura, For QUESTION4 related to replication, I meant the following scenarios. What does it mean for the clients which have done putAll operations 1) While replicating from M1 to M2, there is a network glitch for say more than joinTimeOutConfigured ? 2) M2 is shut down for some reason. 3)

Re: Continuous Query on Multiple caches

Hi Rishikesh, ContinuosQuery is designed to work with single cache only. So, there is no way to use it with multiple caches. Could you please share your use case in more details? Thanks. -- View this message in context:

Re: Scalebility of Inite Threads

Hi, Please properly subscribe to the mailing list so that the community can receive email notifications for your messages. To subscribe, send an empty email to user-subscr...@ignite.apache.org and follow simple instructions in the reply. I've some questions to clarify: 1. What do you mean by

Re: DataStreamer operation failed

Hi, Could you please create a reproducer project fails this way? This will help to find a bug. Thanks! -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/DataStreamer-operation-failed-tp16439p16448.html Sent from the Apache Ignite Users mailing list archive at

Re: Is the following statement true in all cases for REPLICATED mode ?

Hi, When persistence store is enabled the data pages that can't be stored in the memory will be evicted to the persistence store. But capacity of your disks is still limit your data set size. So the statement is still correct. -- View this message in context:

Re: CacheMode - REPLICATED related questions

Hi, please see my answers (inlined) userx wrote > QUESTION 1: > Is there a way, we can identify which out of the three machines will be > the PRIMARY mode ? And does it change w.r.t different clients, say if C1 > is doing put, the primary is M1 and if C2 is doing put the primary is M2. > The

History, multiple source systems, Data Vault using Ignite...

Hello,               We have typical task: we need to implement application, which will receive data (and updates) from multiple source systems. Also there will be default (our) data source, which can be updated by our application. Only the last version of data should be "actual" one, which

Continuous Query on Multiple caches

Hi, In documentation https://apacheignite.readme.io/v2.1/docs/continuous-queries , continuous query is mentioned for single cache only. In our case I want to use it for multiple caches, how can we use continuous query for

Re: fetching all the tasks already scheduled and to know the status of the task

Hello Alex, Thanks a lot for a quick reply . Have one more query regarding the above point 2 mentioned in the earlier post , we have a way to get using ComputeTaskFuture is what was said but if i have to use SchedulerFuture for getting the below information , then how do we go about it. 1.

Re: Equally distributing Kafka topics within the cluster

Hi Zbyszek, I don't think there is a way that can be used out of the box. It seems, your approach based on topology events and some shared state looks workable. Another option that can be used here is trying to implement your own affinity function, but it's not a simple way I think. In any way,

Re: Failed to run reduce query locally

Hi, Looks like the problem has been fixed in ignite-2.1. Please take a look at the ticket IGNITE-5190. [1] [1] https://issues.apache.org/jira/browse/IGNITE-5190 On 24.08.2017 19:23, igor.tanackovic wrote: I have a query which can be executed in H2 console but fails on Ignite's

Re: Kerberos installation

Hi Evgenii, Thanks for the reply. We wanted to use ignite on top of the existing kerberized hadoop/hive deployment with out any code change(Means used HDFS as secondary file system and refer ignite specific config files while accessing hdfs and not writing any java code). In this case can you

DataStreamer operation failed

Im am prototyping Apache Ignite to store some simple data grid with simple objects: Key: private final int securityId; private final long time; OHLC: private final int securityId; private final long time; private final double open; private final double high; private final double

Re: Kerberos installation

Hi, take a look for a KerberosHadoopFileSystemFactory,it can be used in kerberized hadoop env: KerberosHadoopFileSystemFactory delegate = new KerberosHadoopFileSystemFactory(); delegate.setKeyTab("foo.keytab"); delegate.setKeyTabPrincipal("foo"); delegate.setReloginInterval(0); Evgenii