Re: One failing node stalling the whole cluster

We're also seeing this total hang of our replicated cache cluster when a single node goes totally lethargic due to too heavy memory load. The culprit node typically does not respond to "jstack" due to either excessive memory load or missing safepoints. Sometimes we need to do kill -9 to get the nod

Re: Persistent storage with Ignite C++

Hi Denis/Igor, many thanks for the info, I'll give this a try. Graham On 3 June 2016 at 16:34, Igor Sapego wrote: > Hi Guys, > > As far as I understand, yes, this is going to work as long as all > necessary user Java classes are available for the C++ node. > > Best Regards, > Igor > > On Fri,

Re: Ignite : IgniteDataStreamer question about units/valid ranges for perNodeBufferSize, autoFlushFrequency

Hello, 1) perNodeBufferSize - is the number of entries in the buffer. 2) autoFlushFrequency - in milliseconds On Sun, Jun 5, 2016 at 8:14 PM, M Singh wrote: > Hi: > > I was looking at the javadoc for some of the methods in this interface and > am not sure of units as well as the ranges for thes

Re: ignite in-memory sql query performance issue

Hi Kevin, Could you please provide the source code of SelectedClass and estimate number of entries in the cache? As Vladislav mentioned, most probably this is a matter of setting indexes on relevant fields. If you provide the source code, we will be able to give you exact example on how to do that

Re: Ignite : IgniteDataStreamer question about units/valid ranges for perNodeBufferSize, autoFlushFrequency

Thanks Vladislav for the clarification. On Monday, June 6, 2016 12:45 AM, Vladislav Pyatkov wrote: Hello, 1) perNodeBufferSize - is the number of entries in the buffer.2)  autoFlushFrequency - in milliseconds On Sun, Jun 5, 2016 at 8:14 PM, M Singh wrote: Hi: I was looking at the java

Re: Ignite : IgniteDataStreamer question about units/valid ranges for perNodeBufferSize, autoFlushFrequency

Is there any valid range for these attributes ? On Monday, June 6, 2016 1:31 AM, M Singh wrote: Thanks Vladislav for the clarification. On Monday, June 6, 2016 12:45 AM, Vladislav Pyatkov wrote: Hello, 1) perNodeBufferSize - is the number of entries in the buffer.2)  autoFlus

re: ignite in-memory sql query performance issue

Hi Vladimir, I did define group index using orderedgroups annotations. My real query string is : "select * from UniqueField where gId= ? and oId=?"; And there is no group index defined for gId and oId. I have 12Million(actually, 11,770,000 ) records in cache. My SelectedClass is defined as foll

re: ignite in-memory sql query performance issue

Hi Vladimir, I have tried to reset the group index definition. Using gId and oId as the group index, the time used to retrieve the query reduced to 16ms. In order to speed up the sql queries, do I need to set all the possible group indexes ? Best regards, Kevin 发件人: Vladimir Ozerov [mailto:voz

Ignite : Slow Client

Hi: I have a few questions about slow clients: 1. If a slow client is disconnected, what happens to it's event queue ?2. If there are multiple client using same query - do they share the same queue and if so, does each client get all the events or are the events shared across all clients of that

Self Join Query As An Alternative To IN clause

I am using apache ignite 1.6. Executing an in clause query on a cache containing 1 mil entries took around 1.5 seconds. As a performance optimization suggested here , I tried out a join clause query but query binding fails. SqlFieldsQuer

Re: How to connect/monitor ignite server through jmx client

Hi Denis, Setting an environment variable worked out when starting ignite from command line on a linux machine but when I set the environment variable on my windows desktop and start ignite programmatically, it doesn't work. What are the alternatives? -- View this message in context: http://

Re: How to connect/monitor ignite server through jmx client

How do you set this variable on the windows machine? What does “echo %IGNITE_JMX_PORT%" return? If you set in the windows registry then don’t forget to restart your command line terminal. — Denis > On Jun 6, 2016, at 3:09 PM, pragmaticbigdata wrote: > > Hi Denis, > > Setting an environment

Re: How to connect/monitor ignite server through jmx client

echo %IGNITE_JMX_PORT% gives the port that I have set. I haven't set it through the registry. I have set it from the UI (Advanced Settings -> Environment Variables -> Add). -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-connect-monitor-ignite-server-throu

How to retrieve data from Collocated Cache with Simple Key

Hi, I've gone through the affinity collocation[1] example to understand how data gets collocated across caches. In my example, I found that I'm not able to retrieve data from collocated cache with simple key. I mean. Cache, Person> personCache = ..; personCache.get(new AffinityKey<>(key, af

Re: How to connect/monitor ignite server through jmx client

Start the node with “-v” flag like this “ignite.bat -v" and share the logs. — Denis > On Jun 6, 2016, at 3:18 PM, pragmaticbigdata wrote: > > echo %IGNITE_JMX_PORT% gives the port that I have set. I haven't set it > through the registry. I have set it from the UI (Advanced Settings -> > Environ

Re: How to connect/monitor ignite server through jmx client

How do you start ignite in verbose mode programmatically? I am starting ignite with Ignition.start("conf.xml"); -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-connect-monitor-ignite-server-through-jmx-client-tp5420p5454.html Sent from the Apache Ignite Us

Re: How to connect/monitor ignite server through jmx client

Got you, if you start the node this way (programmatically) then IGNITE_JMX_PORT won’t work regardless of the operating system kind. You need to pass the following system parameters to your Java process (that calls Ignition.start) -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.po

Re: How to connect/monitor ignite server through jmx client

Great. Works now. Thanks! -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-connect-monitor-ignite-server-through-jmx-client-tp5420p5456.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: listening for events on transactions

Hey Denis, Thank you for this suggestion. I plan to take a serious look at what you suggest to see if it will work for me and will let you know. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/listening-for-events-on-transactions-tp5346p5458.html Sent from the

Ignite faster with startup order

Hi, I have an application which embeds a Apache Ignite instance in a TCP server. I have another process which starts another ignite instance. All clients request to the TCP server, which starts an Ignite Transactions does some inserts. I have observed a peculiar thing, when I start the TCP proc

Re: listening for events on transactions

Hi Alexey, I did poke around on continuous queries before. Based on your recommendation I will take another look to see if they solve my architecture pattern. Transaction listeners/messages are a common pattern with other technologies. Here is a suggestion of how Ignite might evolve to be better

Is it possible to disable TcpRestProtocol?

Hi, I've recently started using apache ignite in a project and am looking to put it in to production in the next 4 weeks. Our production environment has tight constraints on port usage, so far following the manuals I have remapped the TcpDiscovery and TcpCommunication to allowed ports but I have n

Re: Ignite : IgniteDataStreamer question about units/valid ranges for perNodeBufferSize, autoFlushFrequency

Hello, I do not see any restrictions other than reasonable. perNodeBufferSize only positive value autoFlushFrequency only positive value and if auto flush disabled then 0 On Mon, Jun 6, 2016 at 11:33 AM, M Singh wrote: > Is there any valid range for these attributes ? > > > On Monday, June 6,

Re: Self Join Query As An Alternative To IN clause

Hello, You should pass array of values as a first argument: Object[] params = new Object[] { new Object[] {"p1", "p2", ...} }; 2016-06-06 13:19 GMT+03:00 pragmaticbigdata : > I am using apache ignite 1.6. Executing an in clause query on a cache > containing 1 mil entries took around 1.5 seconds

Re: Unexpected performance issue with SQL query followed by error

Of course you should. But have in mind what currently Ignite will download full result set to client node to produce final result set if query is executed in distributed mode (having setLocal(false)), and you have very large result set. You should consider adding something like limit clause to th

Ignite for Spark on YARN Deployment

Hi there, I would like to use "Ignite for Spark" to save the states of Spark jobs in memory and those states can be used for later jobs. For Shared Deployment, the document only offer two ways to deploy Ignite cluster. First is the standalone deployment, second is MESOS deployment. But Our Spark c

Re: Running an infinite job? (use case inside) or alternatives

Hi, What about the following solution: Create cache: IgniteCache, where key is growing integer. Asssign keys using IgniteAtomicSequence [1] Listen for cache put events When put is done and event group id is "next", process all entries from cache where id < event.key [1] https://apacheignite.read

Re: How to retrieve data from Collocated Cache with Simple Key

Hello Jamal, I think so, It not possible, because data store in particular partition, which determine only by affinityKey. More useful case, when you are not know fullKey, use ScanQuery(1) or use cache iterator. (1): https://apacheignite.readme.io/docs/cache-queries On Jun 6, 2016 3:34 PM, "Kama

Re: How to retrieve data from Collocated Cache with Simple Key

I am sorry for mistake Kamal... On Jun 6, 2016 3:34 PM, "Kamal" wrote: > Hi, > > I've gone through the affinity collocation[1] example to understand how > data gets collocated across caches. In my example, I found that I'm not > able > to retrieve data from collocated cache with simple key. >

cluster node attribute based authorization

All I implemented a ClusterNode.userAttributes() based authorization mechanism. I used a JWT Token to establish trust (passed via the userAttribute). This works fine. The problem I have is that the JWT Token expires shortly after initial use. Now, if the node leaves the cluster and joins it

Re: Ignite Write Behind performance

amitpa, We would be interested in learning how did this perform for you? We have implemented spring txn to insert in database for write-behind. Hoever, we see that sometiems write-behind is not even called for some objects that we are certain were just updated in the cache. have you noticed that?

Re: How to retrieve data from Collocated Cache with Simple Key

Thanks for your response Vladislav. Both ScanQuery and Iterator traverses the whole cache to find the value. It may not be suitable in my environment as there can be huge number of hits. I understand that for fast retrieval `key-to-partition` mapping is done. But, In AffinityKey documentation, it

Re: Self Join Query As An Alternative To IN clause

Great. The query worked now and it is 50% faster than the in clause query. Could you detail on the internals of why passing the object array directly didn't work and how did an [] inside an [] worked out? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Self-Join

Re: How to retrieve data from Collocated Cache with Simple Key

Hi Kamal, There is no need to use any workaround like ScanQueries or iterators. You just need to use a valid key to retrieve the data. The valid key in your example is new AffinityKey<>(key, affray). It means that every time you need to put or get a Person from the cache you need to use this ki

Re: Ignite Write Behind performance

I did test this...For us I think Write behind gets called fine. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-Write-Behind-performance-tp5385p5475.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.