Re: SQL EXPLAIN ANALYZE
Hi, In general. I can see in server logs if any query executes longer, log shows Long running query with information about scan count and index usage. But if i execute from sql client EXPLAIN ANALYZE which returns two rows as per below link: https://apacheignite-sql.readme.io/docs/performance-and-debugging#using-explain-statement But i dont scan count returned in this. Is there any to enable it from ignite config? Thanks & Regards, Devakumar J -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
SQL EXPLAIN ANALYZE
Hi, I see the ANALYZE syntax doesn't show the scan count. Is this not supported in ignite? Thanks & Regards, Devakumar J -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Regarding ignite query result set limit
Hello Vladimir Pligin, Thanks for the response. Do we have any other document to understand in-depth how this lazy setting works internally. Let say if the query to return 1 million records but if there is no enough memory at the server side, how exactly the service which connects through thin client will get the whole data? Is it kind of streaming will be enabled if we use lazy=true? Thanks & Regards, Devakumar J -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Regarding ignite query result set limit
Hi, Is there a way in ignite to limit no of records returned with default limit. Let say if some one accidentally queries a huge cache without condition from SQL client, in order to prevent OOM's is there any configuration to control it. Thanks & Regards, Devakumar J -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Regarding CQ monitoring and alerting
Hi, We have wide usage of CQ listeners in the application registered from client nodes. But we observe randomly it stops working, i mean listener not notified on cache events, and it requires restarting the client node. Is there an easy way to alert immediately if CQ stops working? Thanks & Regards, Devakumar J -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
CPU soft lockup
Hi, We are running on 2.8.0 version with 3 server nodes and 2 client nodes. We notice CPU soft lockup issues and server node goes down with critical error detected. Do we have any document reference or checklist to investigate this issue? Thanks, Devakumar -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Question in Continuous Query Remote Filter
Hi, Thanks for the reply. Do we have any document reference for stopping/unsubscribing registered CQ listeners. Thanks & Regards, Devakumar J -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Question in Continuous Query Remote Filter
Hi All, We have a setup of 2 servers and 1 client Node. Client node registers CQ on set of caches. I just want to temporarily pause and resume CQ notifications based on certain action at client node. I was trying to achieve this through remote filter and ignite messaging. I mean client publish message to all the server nodes to flip the boolean flag. And remote filter will return true or false based on the flag. The behavior was inconsistent. Sometime it works and some time i dont see even the CQ registered properly and when i query SYS.CONTINUOUS_QUERIES, getting some invalid state exception. Is there any other way of pausing and resuming CQ notification based on client side event? Thanks & Regards, Devakumar J -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Load balanced CQ listener/Catch up missed events
Hi Denis, Thanks for the reply. I mean to ask, is it possible to create distributed queue at client node and if so where it will be persisted when native persistence enabled. Should it be under server folder's work folder? Thanks, Devakumar J -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Load balanced CQ listener/Catch up missed events
Any thoughts on this pls? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Load balanced CQ listener/Catch up missed events
Thanks Denis. I will explore further on this. Some more questions in distributed queue. 1. When i create a queue, should it be created at each server node separately or it should be created once cluster wide? 2) If cluster wide, can multiple server nodes publish to the same queue? 3) Also is there a way to create the queue at client side and store a part of client node itself? Thanks, Devakumar J -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Load balanced CQ listener/Catch up missed events
Thanks Denis. I will explore further on this. Some more questions in distributed queue. 1. When i create a queue, should it be created at each server node separately or it should be created once cluster wide? 2) If cluster wide, can multiple server nodes publish to the same queue? 3) Also is there a way to create the queue at client side and store a part of client node itself? Thanks, Devakumar J -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: ContinuousQueryWithTransformer with custom return type
Thanks Denis for the information. That works well for me. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
ContinuousQueryWithTransformer with custom return type
Hi,
I am trying to register CQ with transformer with keep binary option and
trying to return a cutom defined object. I see the transformer properly
creating custom object and returning properly.
But at the same time local listener is not receiving the custom object,
instead i think it received binary object. How can i ensure that local
listener is receiving custom object properly.
ContinuousQueryWithTransformer
continuousQueryWithTransformer = new ContinuousQueryWithTransformer<>();
I want local listener to receive ListenerEvent (Custom defined object) as
below:
continuousQueryWithTransformer.setLocalListener(cacheEntryEvents ->
cacheEntryEvents.forEach(listenerEvent -> {
LOG.info("Event Received : {}", listenerEvent);}
But local listener throws BinaryObject cant cast to ListenerEvent.
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Load balanced CQ listener/Catch up missed events
Hi Denis, Thanks for your reply. I will explore the custom implementation of remote filter for load balancing. Also currently we dont use kafka in our tech stack, so we dont want to introduce it just for this purpose. I was also checking ignite events and distributed message queue as an alternative for Continuous Queries. Can we define setup like, 1. Define distributed message queue across the cluster. 2. Each server node publish the selective cache events to the queue. 3. Client nodes consume the queue. So in this case as per my understanding on distributed queue, a. Client nodes will get events in load balanced way. b. If any one client node down then other node will start consuming all the events. c. If both client nodes down, queue will still have the entries that are not yet consumed as it is persisted. So if client nodes come up, it will resume from where it left. Is this feasible or do you see any issue in setup in case of server node failure/ server node re-balancing. Thanks, Devakumar J -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Load balanced CQ listener/Catch up missed events
Hi, We have a setup of 3 server nodes and 2 client nodes and 50 caches around. When we register CQ listener for cache operations from client node, both the client nodes are getting notified. 1. Is there way to achieve load balanced manner? For e.g) In case of 2 events, event-1 to be received by client-1 and event-2 to be received by client-2 and in-case of one client node down and other node should start receiving all the events? 2. In case of both node failure, is there a way to get only those missed events? Thanks, Devakumar J -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Durable Memory Setting(Off-Heap)
Hi, We have VM with 100GB memory and hosting 1 server node and 1 client node. 8GB heap seems to be optimal for our use case. But how we can decide for off-heap memory when native persistence is enabled. Setting up higher durable memory will cause any other issues?. Please provide if we have links to get more insight on durable memory. Thanks & Regards, Devakumar J -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Ignite Native Persistence With write behind additional store
Hi, Thanks for the reply. is there a reference to configure custom store along with native persistence enabled. Thanks & Regards, Devakumar J -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Ignite Native Persistence With write behind additional store
Hi, I am exploring ways to do data backup along with native persistence. Is it possible to achieve this using cache store implementation. So that data will be persisted in disk as well as replica copy. Thanks, Devakumar J -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
