Re: maxSize - per node or per cluster? - only 2k/sec in 11 node dedicated cluster

Hi Pavel, Thanks for your reply. Here's one of our configs: http://www.springframework.org/schema/beans"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; xmlns:util="http://www.springframework.org/schema/util"; xsi:schemaLocation="http://www.springframework.org/schema/beans http://www.sp

Re: partition-exchanger system-critical thread blocked

Hi Ilya, Please find attached entire log file. Regards, Gangaiah 18.zip - Thanks and Regards, Gangaiah -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: High availability of local listeners for ContinuousQuery or Events

Hi, It's true that currently you need to implement something for Continuous Queries failover in your application code. Continuous Queries have setInitialQuery API to help with that. How it's supposed to work is: you define an initial query (e.g. an SQL query) which fetches the data that's alrea

Re: XML Configuration issues

You have a couple of typos: Line 27. propery should be property Line 42. keyField should be keyFields On 13 Nov 2020, at 15:50, Wolfgang Meyerle wrote: > > Hi, > > I'm trying to change the xml configuration in apache ignite to support SQL > for data caches: > > see https://pastebin.com/4qte

XML Configuration issues

Hi, I'm trying to change the xml configuration in apache ignite to support SQL for data caches: see https://pastebin.com/4qtepp0A However this config file doesn't seem to work. If I comment out the cache configuration part it works. What's wrong with it? Can't I mix cache configuration and

Re: Ignite Client Node OOM Issue

Hi, SQL query may be potential cause of the OOM. Please check that: 1. Simple scan+filter queries (e.g. SELECT * FROM WHERE ) that may produce big results run in lazy mode (SqlFieldsQuery#setLazy); 2. Queries that requires not indexing sort or group aggregates don't produce  big result set (l

Re: Adding fields without adding to sql table DDL

Last question would this work with datastreamer? e.g. adding a field inside the transformation? Thanks! -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Adding fields without adding to sql table DDL

Hello! No, it would not appear in select and in table schema. The only way of adding a field to table schema is by invoking ALTER TABLE ADD COLUMN. Regards, -- Ilya Kasnacheev пт, 13 нояб. 2020 г. в 17:37, ssansoy : > Thanks for the tip! > Is there documentation anywhere about how this would

Re: Adding fields without adding to sql table DDL

Thanks for the tip! Is there documentation anywhere about how this would appear in a select? would the new field be added to the table schema as well? (we don't want this) -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Adding fields without adding to sql table DDL

Hello! I think you have just discovered that you can't add fields inside an entry processor. Try using a regular put for this. Then, you can also use these fields inside entry processor. Regards, -- Ilya Kasnacheev пт, 13 нояб. 2020 г. в 17:21, ssansoy : > Hi, we define our caches via a creat

Adding fields without adding to sql table DDL

Hi, we define our caches via a create table statement, and specify our various columns/fields. We would like to add some additional fields, that are not exposed as part of the DDL, so not visible in a select statement. Is this possible? If I try and get a BinaryObjectBuilder for my type, and add

Re: Large Heap with lots of BinaryMetaDataHolders

Hi, there are approx 6 server nodes, and only around 10 client nodes at the moment (there will eventually be several hundred client nodes once this is enabled in production if we can overcome these issues - and the cluster metric messages which are causing over 1mb of allocations per sec). Each cl

Re: Possible memory leak in Ignite 2.9

Hello! I think this is expected. Ignite needs to convert an entry (800G array) into packets to send to other nodes or put to persistence, where it will allocate another array (800G more). I don't think you can do anything here, short of chunking your data. Regards, -- Ilya Kasnacheev пт, 13 н

Re: SQL and Key Value usage in C++

Hello! The key_type and value_type are names of classes which may be put and get in this cache once you configure serialization properly. You can use INSERT/Put and SELECT/Get in any combinations. Please see https://ignite.apache.org/docs/latest/cpp-specific/cpp-serialization as an example. You

Re: Proper shutdown from C++ environment

Hello! I assume that JVM will install handlers of its own, which will trigger Java shutdown procedures and Ignite node will be stopped. Regards, -- Ilya Kasnacheev пт, 13 нояб. 2020 г. в 16:42, Lieuwe : > You would only get SIGINT if you run your application in a shell and ctrl-c > it right?

Re: Proper shutdown from C++ environment

You would only get SIGINT if you run your application in a shell and ctrl-c it right? Can you not 'wait' on a key press and stop ignite properly instead? I looked at the same issue recently and I wouldn't expect ignite to do anything that isn't documented - even if it does it now, it may not do i

Re: Live coding session next week

Hi Ilya! You can see the meeting link after RVSP on meetup.com https://www.meetup.com/Apache-Ignite-Virtual-Meetup/events/273935662/ This mailing list is open and to announce the zoom link is not the best thing to do. I can not understand why it's fun to interrupt zoom calls, but some people (and b

Proper shutdown from C++ environment

Another question according a proper shutdown of ignite. Do I have to catch the sigint signal to properly shutdown apache ignite in my environment and set the node to inactive or is the code in ignite catering for this itself? Is it safe to install signal handlers with the usage of the ignite f

SQL and Key Value usage in C++

Hi, I have a question where I'm currently struggling to find the answer in the Ignite Documentation and hopefully somebody of you can guide me in the right direction. According to the Ignite DDL Documentation of SQL I'm able upon Table creation to provide a cache name and I have a keyname an

Re: KafkaStreamer, how to manage (stop consumming, resume) on client disconnection

I forgot to mention, I'm starting the KafkaStreamer in a cluster service. Pretty similar to all the examples that are around. I saw the exception in the documentation, my concern here is where should I catch it given that I initialize and setup the streamer on the init() method and start it in th

Re: IgniteC++ throughput

Why are you using index type FULLTEXT for a Long data type? That should be SORTED I think. As I said - I used the example shipped with ignite as a starting point. I changed it to SORTED and it looks better indeed. Scenario 4 now runs at about 7K TPS. -- Sent from: http://apache-ignite-users

Re: Large Heap with lots of BinaryMetaDataHolders

Hello! Well, as I understand, you have a cluster with 50 caches and in each client, you have this situation with 220 MB of metadata? But what operations deploy your other clients? Maybe some continuous queries? Also please tell me, how many nodes have your cluster? --

Re: IgniteC++ throughput

Why are you using index type FULLTEXT for a Long data type? That should be SORTED I think. > On 13 Nov 2020, at 09:57, Lieuwe wrote: > > Gangaiah - this will reproduce what I am seeing: > > #pragma GCC diagnostic ignored "-Wdeprecated-declarations" > #include > #include > #include > > #de

Re: IgniteC++ throughput

Ilya: 0: jdbc:ignite:thin://127.0.0.1/> EXPLAIN SELECT A, B, C, D FROM TEST.TEST WHERE A = 1; ++ | PLAN | ++ | SELECT __Z0.A AS __C0_0, __Z0.B AS __C0_1, __Z0.C AS __C0_2, __Z0.D AS __C0_3 FRO

Re: IgniteC++ throughput

Gangaiah - this will reproduce what I am seeing: #pragma GCC diagnostic ignored "-Wdeprecated-declarations" #include #include #include #define CACHE_SIZE 10 #define CHRONO_MS std::chrono::duration_cast struct DataObject { int64_t A, B, C; ignite::Guid D; }; namespace ignite::bina

Re: IgniteC++ throughput

Hello! Can you please provide all rows&columns of "EXPLAIN SELECT ... WHERE A=?" query? Regards, -- Ilya Kasnacheev чт, 12 нояб. 2020 г. в 20:04, Lieuwe : > I wonder if anyone can shed some light on the Apache Ignite performance I > am > seeing. > > I am running a single node & have a very si

Re: partition-exchanger system-critical thread blocked

Hello! We need to see all the lines after the following (but before the next Thread): Line 41312: [2020-11-09T06:44:13,606][WARN ][tcp-disco-msg-worker-#2%EDIFCustomerCC%][G] Thread [name="exchange-worker-#344%EDIFCustomerCC%", id=391, state=TIMED_WAITING, blockCnt=16, waitCnt=246

Re: Too long JVM pause out of nowhere leading into shutdowns of ignite-servers

Hello! I'm afraid you're mostly on your own when it comes to ZooKeeper discovery. The recommendations usually apply to TCP/IP Discovery. for 3) I think it is correct to assume that ZooKeeper timeout (probably configurable separately) is the culprit here, not the failure detection timeout. Regard

Re: Ignite Cluster Issue on 2.7.6

Hello! Yes, you absolutely do need to add all nodes to BLT. Do you have steps to reproduce that behavior? The exception suggests that you have started a node, activated it, then shut it down, started other two nodes and activated them separately. Then tried to start all 3 nodes as a single cluste

Re: Unixodbc and Apache Ignite on OSX compilation

Hi Wolfgang, Make sure that LD_LIBRARY_PATH contains unixodbc libs. You may set the following: export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/unixODBC/lib Thanks, Pavel чт, 12 нояб. 2020 г. в 19:44, Wolfgang Meyerle < wolfgang.meye...@googlemail.com>: > Hi, > > I'm currently struggling a li