Re: recoveryBallotBoxes in MvccProcessorImpl memory leak?

2019-11-07 Thread mvkarp
Let me know if these help or if you need anything more specific. recoveryBallotBoxes.zip ilya.kasnacheev wrote > Hello! > > Can you please check whether there are any especially large objects inside > recovery

Re: Kubernetes- Failed to retrieve Ignite pods IP addresses.

2019-11-07 Thread Gokulnath Chidambaram
Thanks Andrei. the solution described in https://apacheignite.readme.io/docs/rbac-authorization works with minorchange in Role access. If we have restricted access, Role and Rolebinding works. Thanks again for your help, -gokul On Thu, Nov 7, 2019 at 5:09 PM Andrei Aleksandrov wrote: > Hi, > >

Blocked Worker Thread

2019-11-07 Thread Conrad Mukai (cmukai)
We are running a cache in a 4 node cluster with atomicityMode set to ATOMIC and have persistence enabled. We repeatedly get a SYSTEM_WORKER_BLOCKED error on one node which is disabling the entire cluster. We were seeing a lot of sockets in TIME_WAIT state which was blocking clients from connecti

Re: resetLostPartitions is blocked inside event listener

2019-11-07 Thread Ilya Kasnacheev
Hello! Event listener is invoked synchronously from internal threads. If partition reset has to happen from the same thread, then obviously there will be a deadlock. Cache listeners have same property, i.e., you should avoid doing cache operations from them. This is tradeoff between performance

Re: Service grid webinar

2019-11-07 Thread Prasad Bhalerao
Can you please share the recording of webinar in case if you have it? On Wed 6 Nov, 2019, 3:30 AM Denis Mekhanikov Hi Igniters! > > I’ve been working on the Service Grid functionality in Apache Ignite for a > while, and at some point I've decided to make a webinar with a high-level > overview o

Re: resetLostPartitions is blocked inside event listener

2019-11-07 Thread Prasad Bhalerao
Do you mean to say, spawn a different thread from event listener and reset the lost partition in that thread? I tried this and it works. But wanted to understand the reason, why this call get blocked in event listener? Thanks, Prasad On Thu 7 Nov, 2019, 9:28 PM Ilya Kasnacheev Hello! > > It is

Re: resetLostPartitions is blocked inside event listener

2019-11-07 Thread Ilya Kasnacheev
Hello! It is not advisable to call any blocking methods from event listeners. Just fire resetLostPartitions from another thread. Regards, -- Ilya Kasnacheev чт, 7 нояб. 2019 г. в 15:17, Akash Shinde : > Hi, > I am trying to handle lost partition scenario. > I have written event listener liste

Re: Persistence store

2019-11-07 Thread slut_hunter
The problem was that instead StatefulSet I used Deployment Thanks for the help -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite singel instance

2019-11-07 Thread Ilya Kasnacheev
Hello! Have you tried collecting thread dumps from node under load, to identify any bottlenecks? What is the CPU usage by Ignite? Regards, -- Ilya Kasnacheev ср, 6 нояб. 2019 г. в 09:08, Siew Wai Yow : > Hi Stan > > The result will be the same without transaction, even with atomic mode. So >

Re: Cluster in AWS can not have more than 100 nodes?

2019-11-07 Thread Ilya Kasnacheev
Hello! List of hosts present in IP finder has very little bearing on list of nodes in cluster. Server node's host do not have to be present in IP finder in order for this node to function. Cluster will be operational until there exists at least one node which is a) alive, b) reachable, and c) lis

resetLostPartitions is blocked inside event listener

2019-11-07 Thread Akash Shinde
Hi, I am trying to handle lost partition scenario. I have written event listener listening to EventType.EVT_CACHE_REBALANCE_PART_DATA_LOST event. I want to reset lost partition state of cache after cache loading is done. *Issue:* ignite.resetLostPartitions(caheName) is getting blocked and not com

Re: Kubernetes- Failed to retrieve Ignite pods IP addresses.

2019-11-07 Thread Andrei Aleksandrov
Hi, Using the search I found that current issue was resolved in next thread: http://apache-ignite-users.70518.x6.nabble.com/Ignite-on-RBAC-enabled-K8s-cluster-td22165.html I guess that you should also read next article: https://apacheignite.readme.io/docs/rbac-authorization BR, Andrei 11/7/2

Re: Spring Data native Query support

2019-11-07 Thread Ilya Kasnacheev
Hello! Judging from stack trace, you ended up with Hibernate repository and not with Ignite repository. Regards, -- Ilya Kasnacheev ср, 30 окт. 2019 г. в 23:25, niamin : > Does Ignite provide native Query support using Spring Data? I am not able > to > bootstrap my application when I configur

Kubernetes- Failed to retrieve Ignite pods IP addresses.

2019-11-07 Thread Gokulnath Chidambaram
Hello, I am trying to install apache ignite:2.7.6 in kubernetes cluster (deployed in aws). I created 1.service account 2. role access 3.rolebinding 4.deployment. 4. added namesapce (bean property) in xml configuration file. I am getting the following error message. 11:18:39,724][INFO][main][Pa

Re: apache ignite installation fails in kubernetes

2019-11-07 Thread Gokulnath Chidambaram
thanks Andre. this works. unfortunately, i am getting to other famous issue which is Failed to retrieve Ignite pods IP addresses. will post as new issue. On Wed, Nov 6, 2019 at 7:06 PM Andrei Aleksandrov wrote: > Hi, > > As I know it should be fixed in Apache Ignite 2.7.6. Also as an option >

Re: recoveryBallotBoxes in MvccProcessorImpl memory leak?

2019-11-07 Thread Ilya Kasnacheev
Hello! Can you please check whether there are any especially large objects inside recoveryBallotBoxes object graph? Sorting by retained heap may help in determining this. It would be nice to know what is the type histogram of what's inside recoveryBallotBoxes and where the bulk of heap usage resid

Re: Persistence store

2019-11-07 Thread Ilya Kasnacheev
Hello! [2019-11-06 13:18:39,466][INFO ][main][GridCacheDatabaseSharedManager] Checking memory state [lastValidPos=FileWALPointer [idx=0, fileOff=0, len=0], lastMarked=FileWALPointer [idx=0, fileOff=0, len=0], lastCheckpointId=----] [2019-11-06 13:18:39,483][INFO ][m

Re: Data is lost during rebalance

2019-11-07 Thread novacean.alex
Upon further research it appears that disabling page eviction for the default data region is not something i should do. According to Apache Ignite Documentation if Ignite Native Persistence is off and page eviction is disabled for the default data region, OutOfMemory errors will be thrown. The 'pe

Re: Data is lost during rebalance

2019-11-07 Thread Вячеслав Коптилин
Hi Alex, I will take a look at log files. Thanks, S. ср, 6 нояб. 2019 г. в 17:51, novacean.alex : > This is the test i am performing: > > 1. I have an Ignite Cluster of 3 Server Nodes running in Kubernetes. (the > cluster is created using a StatefulSet) > 2. Once the cluster is up i use a Deplo