Re: Scaling with SQL query

Hi Dmitry,   Another question. I am curious if I query via JDBC or new thin client, will the reduce happen on one of server nodes serving as a proxy?   Sent: Thursday, June 28, 2018 at 2:02 PM From: "Tom M" To: user@ignite.apache.org Subject: Re: Scaling with SQL query Hi Dmitry,  

Re: Scaling with SQL query

Hi Dmitry,   Thanks for the great explanation!   Looks like "reduce" hapenning on the client is the issue that can be solved with adding clients.   Sent: Wednesday, June 27, 2018 at 6:22 PM From: dkarachentsev To: user@ignite.apache.org Subject: Re: Scaling with SQL query Hi, Slight

RE: Best practice for class versioning: marshaller error

Hi Dmitry, Thanks for your response! I want to confirm my understanding - If I disable compact footer and add your POJOs in BinaryConfiguration, I will be deserialize back the serialized object after I stop grid and removed the local files that hold the marshaller cache (I believe they are

Re: NPE When joining grid

Hi Bryan, DiscoverySpi was slightly reworked in AI 2.5 Please take a look at this enhancement proposal: https://cwiki.apache.org/confluence/display/IGNITE/IEP-15%3A+Discovery+SPI+by+ZooKeeper And it looks like, the issue, that you mentioned, was resolved as part of

Re:

Hello, I think ContinuousQuery will be a good choice for your use-case [1] [1] https://apacheignite.readme.io/docs/continuous-queries Thanks! ср, 27 июн. 2018 г. в 18:51, James Dodson : > Hello. > > I am creating a Spring Boot application that gets objects from Kinesis and > uses

NPE When joining grid

Hey all, I was wondering if anyone else has seen NPEs while joining a grid w/ Ignite 2.4.0 (a quick search didn't show anything in Jira) This is happening in our K8s cluster where the grid is rolled for every CI deploy. 2018-06-27 18:00:59,869 INFO [exchange-worker-#42]

Re: Problems with unlocking multiply held cache locks.

Cross-posting to developers list. Guys, cache locks work inconsistently: if you take a lock twice, but release it only once, then *IgniteCache#isLocalLocked* will tell you, that you hold a lock, but another node will be able to acquire it. We should either make the lock non-reentrant, or not

Re: Apache Ignite Rest API JOIN with multiple Caches

Hi, Try to use qryfldexe: For example, I create next caches: ss1.java It creates two caches with the same structure. Now I am going to execute next command: SELECT * FROM "mycache1".Value V1 join "mycache2".Value V2 on

Re: Leftover Ignite threads after closing cache

Hi Matt, These threads are async callback thread pool, you shouldn't worry about them. This internal thread pool is not bound to a single cache and is being reused for all async callbacks for all continuous queries. Ignite will shutdown this pool only when you stop the node. -- Sent from:

[no subject]

Hello. I am creating a Spring Boot application that gets objects from Kinesis and uses ignite-spring-data to insert those objects into an Ignite cluster. As objects are inserted, I want to take some action - specifically, inspect the object being inserted, query Ignite for a related object and

Re: Cache size in offheap mem in bytes

Hi, I have written a test program to find the cache size in bytes. I am using this tool (memory-measurer) to find the object sizes and its foot prints. I tried to use this tool to find the cache size in bytes. I am using on heap cache. Am I using

Re: ClassCastException in Hibernate QueryCache

Hi, I think that the problem is that next code doesn't work in java: public static class SerializableObject implements Serializable {} and Object[] array = new Object[1]; array[0] = new SerializableObject(); Serializable[] serializableArr = (Serializable[])

Leftover Ignite threads after closing cache

Hi, I'm using an Ignite ContinuousQuery for processing local cache events: continuousQuery.setLocalListener(new CacheEntryListener<>(myHandler)); I have a "job" that modifies the cache (insert/updates/deletes) and the code in the callback essentially takes items and enqueues them for further

Re: Question on Ignite and Spark Structured Streaming Integration.

Hi, As I know there is no any special sink function for streaming to Ignite. Also, I don't see "jdbc" format in official documentation of spark (only file, kafka, console, memory and foreach): https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#output-sinks However,

Problems with unlocking multiply held cache locks.

It appears that cache locks are intended to support re-entrancy. The debugger shows a count variable and the lock can be taken several times by the same node and then unlocked an equal number of times. If a node has taken a lock several times a second node attempts to take the same lock then,

Re: Igfs - questions and optimal configuration settings

Thanks Denis! That helps a lot. I'll dig into those settings and see if I get my head around it all. I did notice that the default/max memory settings are based off of system settings/resources, so I'll try the defaults too and see what happens. - Matt -- Sent from:

Re: Ignite YARN Kerberos - Delegation Ticket renewal

Hello together, I have also logged this issue in issues.apache.org. Kindly requesting your support. Thanks -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

RE: Information regarding Ignite Web Console

Thanks Denis…Will try this and revert to you. Thanks & Regards, Sriveena From: Denis Mekhanikov [mailto:dmekhani...@gmail.com] Sent: Wednesday, June 27, 2018 6:37 PM To: user@ignite.apache.org Subject: Re: Information regarding Ignite Web Console Sriveena, You can have objects of different

Re: Information regarding Ignite Web Console

Sriveena, You can have objects of different types in one cache, but querying it will be tricky. You will have to configure QueryEntities for your data, that will describe, which fields are

Re: Best practice for class versioning: marshaller error

Hi Calvin, BinaryMarshaller can solve that issue with involving a few more. First of all, you will need to disable compact footer to let each BinaryObject has it's schema in footer. If you need just put/get POJOs everything will be fine. But you need to enlist your POJO in BinaryConfiguration

Ignite YARN Kerberos - Delegation Ticket renewal

Ignite YARN not having a facility to renew HDFS_DELEGATION_TOKEN. As Ignite-YARN is a long running application in YARN environment it should have a mechanism to renew the delegation token. Version : 2.3.0 Module : Ignite-YARN Class : ApplicationMaster In Ignite-YARN, when the

RE: Information regarding Ignite Web Console

Thank you so much for the quicker responses unlike any other forums..I really appreciate that. One last question Denis, we have plan to load all the mongodb collections to ignite cache and perform complex aggregations and join in memory. But Unlike any RDBMS data stores we cannot have fixed

Re: Scaling with SQL query

Hi Jose, 1. Yep, I would say, you'll get more profit in persistence. Because if you split between real machines, each may keep more hot data in memory and each has separate hard drive. The more data you can fit into RAM and more hard drive could work in parallel, the better performance you get.

Re: Information regarding Ignite Web Console

Sriveena, CacheStore extends the CacheWriter interface, which has delete

RE: Information regarding Ignite Web Console

Thanks Denis for the pointers. But the case explained in https://www.youtube.com/watch?v=XBtI2Z01kAA - Using Ignite Web Console for Automatic RDBMS Integration with Apache Ignite - Part 3. shows that any deletions happening on ignite cache are getting reflected in the mysql database. Which I

Re: Information regarding Ignite Web Console

Sriveena, Web Console can generate schema in Ignite based on an existing schema in a relational database. But you can do it yourself, without use of Web Console. Web Console only makes it easier to wire-up stuff, i.e. generate required data classes and configuration. Unfortunately, this feature

Re: Scaling with SQL query

Hi Dmitry, This is a fantastic explanation to better understand scaling strategies for SQL - Thanks. A couple of questions: 1. Do these mechanisms apply equally for persistent caches? 2. Regarding your point (2.) - How would one achieve this? (more clients?) (more connections to node?) Are

RE: Information regarding Ignite Web Console

Hi Denis, Thank you so much for the quick turn around Could you also confirm if there is a similar integration from ignite to NoSQL database like MongoDB ? Our requirement also has mongo db changes to be automatically synced up to Ignite? Please help. Thanks & Regards, Sriveena From: Denis

Re: Cache size in offheap mem in bytes

1) This applicable to Ignite. As it grown from GridGain sometimes it may appear in docs, because missed fro removal. 2) Yes, and I would say overhead could be even bigger. But anyway I cannot say definitely how much, because Ignite doesn't store data sequentially, there a lot of nuances. 3) Ignite

Re: Information regarding Ignite Web Console

Sriveena, You can find sources of Web Console in the Ignite Git repository: https://github.com/apache/ignite/tree/master/modules/web-console If you want to run Web Console by yourself, you can use the following Docker image: https://hub.docker.com/r/apacheignite/web-console-standalone/ There is

Re: Scaling with SQL query

Hi, Slight degradation is expected in some cases. Let me explain how it works. 1) Client sends request to each node (if you have query parallelism > 1 than number of requests multiplied by that num). 2) Each node runs that query against it's local dataset. 3) Each node responses with 100 entries.

Re: Cache size in offheap mem in bytes

Hi, Thank you for the explanation. As per this link https://apacheignite.readme.io/docs/capacity-planning#section-calculating-memory-usage , "GridGain will typically add around 200 bytes overhead to each entry." 1) Why does it specifically say GridGain will add around 200 bytes overhead for

RE: Ignite Node failure - Node out of topology (SEGMENTED)

Naresh, GC logs show not only GC pause, but system pause as well. Try these parameters: -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+PrintGCApplicationStoppedTime Thanks! -Dmitry -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Scaling with SQL query

Hi Pavel,   Thank you for the reply. The cache is partitioned (with 3 copies).   [[SELECT     __Z0.ID AS __C0_0,     __Z0.CS AS __C0_1,     __Z0.TIME AS __C0_2,     __Z0.SID AS __C0_3,     __Z0.SCITY AS __C0_4,     __Z0.SADDRESS AS __C0_5,     __Z0.IID AS __C0_6,     __Z0.IURL AS __C0_7 FROM

Information regarding Ignite Web Console

Hi, I am interested to know if Ignite Webconsole is opensource as the document says Ignite can integrate with any relational database (RDBMS) that supports a JDBC driver - Oracle, PostgreSQL, Microsoft SQL Server, and MySQL Ignite supports automatic RDBMS integration via Ignite Web