Re: CPU soft lockup

Hi Devakumar, Could you show the logs from server nodes. Thanks, Pavel пт, 13 нояб. 2020 г. в 04:22, Devakumar J : > Hi, > We are running on 2.8.0 version with 3 server nodes and 2 client nodes. We > notice CPU soft lockup issues and server node goes down with critical error > detected. > > Do

Re: maxSize - per node or per cluster? - only 2k/sec in 11 node dedicated cluster

Hi Devin, MaxSize is set per node for the specified data region. A few clarifying questions: What cache configuration are you using? The performance could depend on the type of a cache and the number of backups. How many clients and threads are writing to the cluster? Because it is a possible bott

maxSize - per node or per cluster? - only 2k/sec in 11 node dedicated cluster

We're trying to figure out how to get more throughput from our Ignite cluster. We have 11 dedicated Ignite VM nodes, each with 32 GB of RAM. Yet, we're only writing at 2k/sec max, even when we parallelize the writes to Ignite. We're using native persistence, but it just seems way slower than expect

Re: Live coding session next week

Hello Valentin! Could you provide a link for a meeting, please? - Ilya Kazakov пт, 13 нояб. 2020 г. в 07:07, Valentin Kulichenko < valentin.kuliche...@gmail.com>: > Igniters, > > On Tuesday next week (Nov 17), Denis Magda and I will conduct a live > coding session, where

CPU soft lockup

Hi, We are running on 2.8.0 version with 3 server nodes and 2 client nodes. We notice CPU soft lockup issues and server node goes down with critical error detected. Do we have any document reference or checklist to investigate this issue? Thanks, Devakumar -- Sent from: http://apache-ignite-us

Re: [2.9.0]Entryprocessor cannot be hot deployed properly via UriDeploymentSpi

Hi Ilya, https://issues.apache.org/jira/browse/IGNITE-13679 在 2020/11/12 下午9:41, Ilya Kasnacheev 写道: Hello! I suggest filing a feature request ticket against Apache Ignite JIRA. Best if you provide some reproducer project. https://issues.apache.org/jira/browse/IGNITE

Re: KafkaStreamer, how to manage (stop consumming, resume) on client disconnection

Hi, You can use disconnect events/exception, and then use KafkaStreamer.stop. see: https://ignite.apache.org/docs/latest/clustering/connect-client-nodes#client-disconnectedreconnected-events https://ignite.apache.org/docs/latest/clustering/connect-client-nodes Here look for: While a c

Nodes failed to join the cluster after restarting

Hi, I have a 3-node cluster with persistence enabled. All the three nodes are in the baseline topology. The ignite version is 2.8.1. When I restart the first node, it encounters an error and fails to join the cluster. The error message is "Caused by: org.apache. ignite.spi.IgniteSpiException: Att

Re: Ignite timeouts and trouble interpreting the logs

Hi, This looks weird but with the right logs we should figure it out. One thing that I don't like about these settings is the asymmetry of the server's and client's timeouts. The server will use clientFailureDetectionTimeout=30s when talking to the client. The client will use failureDetectionti

Re: tcp-disco-msg-worker system-critical error

Hi, This might be due a network error or a GC pause. Use this guide to collect GC logs and look for long gc pauses: https://ignite.apache.org/docs/latest/perf-and-troubleshooting/troubleshooting#detailed-gc-logs [threadName=tcp-comm-worker, *blockedFor=110s]* ][tcp-comm-worker-#1%EDIFCust

Live coding session next week

Igniters, On Tuesday next week (Nov 17), Denis Magda and I will conduct a live coding session, where we will implement a primitive Ignite-like distributed database from scratch. We will demonstrate major components required for such a system, show how they interact with each other and how they can

Re: WAL and WAL Archive volume size recommendation

Ok, will do that. It's not clear at least for me why. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

KafkaStreamer, how to manage (stop consumming, resume) on client disconnection

Hi all, I'm having some problems dealing with the KafkaStreamer. I have a deployment with a streamer (client node) that consumes records from a Kafka topic, and a data node (cache storage). If for any reason, the cache node crashes or simple restarts, the client node gets disconnected, but the Ka

Re: IgniteC++ throughput

Hi Lieuwe, To understand this in detail, please give more details like how you are calculating TPS and code snippet for each one where you are doing put/get/cursor.hasNext(). Regards, Gangaiah - Thanks and Regards, Gangaiah -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

.NET 5 and Ignite

Igniters, Here is a short note on recently released .NET 5: https://ptupitsyn.github.io/Ignite-on-NET-5/

IgniteC++ throughput

I wonder if anyone can shed some light on the Apache Ignite performance I am seeing. I am running a single node & have a very simple CacheConfiguration consisting of 4 fields. The program is very much like the put-get-example code shipped with Ignite & I am doing a few tests to see how fast (how

Re: partition-exchanger system-critical thread blocked

HI Ilya Kasnacheev, Below are log entries with the tread name 'partition-exchanger' Line 41311: [2020-11-09T06:44:13,605][ERROR][tcp-disco-msg-worker-#2%EDIFCustomerCC%][G] Blocked system-critical thread has been detected. This can lead to cluster-wide undefined beh

Unixodbc and Apache Ignite on OSX compilation

Hi, I'm currently struggling a little bit getting Ignite up and running with UnixOdbc on my OSX machine. I'm compiling the platform cpp files atm with cmake -DWITH_ODBC=ON -DWITH_THIN_CLIENT=ON -DWITH_TESTS=ON -DCMAKE_BUILD_TYPE=Debug -DCMAKE_INSTALL_PREFIX=/Users/user/ApacheIgnite .. and

Re: First two chapters of Ignite ML book

Thank you, Alexey! Such posts can really help those, who are just considering using Ignite. That kind of contribution is as significant as the code! чт, 12 нояб. 2020 г. в 14:42, Alexey Zinoviev : > Hi, dear community, today I published two first chapters of Ignite ML books > >1. Apache Ignit

Re: Inserting date into ignite with spark jdbc

Hi, It seems that a dataset internally uses built-in org.apache.spark.sql.execution.datasources.jdbc.JdbcRelationProvider instead of org.apache.ignite.spark.impl.IgniteRelationProvider in case you force it to use JDBC. The provider from spark obviously doesn't tolerate Ignite custom properties. To

Re: [2.9.0]Entryprocessor cannot be hot deployed properly via UriDeploymentSpi

Hello! I suggest filing a feature request ticket against Apache Ignite JIRA. Best if you provide some reproducer project. https://issues.apache.org/jira/browse/IGNITE You can also try some hybrid approach, such as firing a compute task from the entry processor, that would be hot redeployed prope

Re: [2.9.0]Entryprocessor cannot be hot deployed properly via UriDeploymentSpi

Hi Ilya, Updating the user version does not affect this issue. Adjusting the deploymentMode parameter also has no effect on this issue. 在 2020/11/12 下午7:39, Ilya Kasnacheev 写道: Hello! Did you try changing user version between deployments? https://ignite.apache.org/docs/latest/code-deployment

tcp-disco-msg-worker system-critical error

Hi Igniters, Sometimes below system-critical error printing in the production logs whenever restart the clients. [2020-11-09T02:31:24,733][ERROR][tcp-disco-msg-worker-#2%EDIFCustomerCC%][G] Blocked system-critical thread has been detected. This can lead to cluster-wide undefined behaviour [threa

Re: Ignite 2.9 one way client to server communication

Hello! This is correct, as long as you do not start any new caches, adding a thick client should be PME-less. Do you have logs from joining client and server node (coordinator, crd=true if possible)? Regards, -- Ilya Kasnacheev пн, 2 нояб. 2020 г. в 20:25, Hemambara : > Thank you for respons

First two chapters of Ignite ML book

Hi, dear community, today I published two first chapters of Ignite ML books 1. Apache Ignite ML: origins and development 2. Apache Ignite ML: possible use cases, racing with Spark ML, plans for the fut

Re: [2.9.0]Entryprocessor cannot be hot deployed properly via UriDeploymentSpi

Hello! Did you try changing user version between deployments? https://ignite.apache.org/docs/latest/code-deployment/peer-class-loading#un-deployment-and-user-versions Regards, -- Ilya Kasnacheev чт, 12 нояб. 2020 г. в 12:07, 18624049226 <18624049...@163.com>: > Hi Ilya, > > This issue exists

Re: L2-cache slow/not working as intended

Hello! Then it should survive restart while keeping cache content. I'm not an expert in Hibernate caching but that I would expect. Regards, -- Ilya Kasnacheev чт, 12 нояб. 2020 г. в 12:58, Bastien Durel : > Le mardi 10 novembre 2020 à 17:39 +0300, Ilya Kasnacheev a écrit : > > Hello! > > > >

Re: L2-cache slow/not working as intended

Le mardi 10 novembre 2020 à 17:39 +0300, Ilya Kasnacheev a écrit : > Hello! > > You can make it semi-persistent by changing the internal Ignite node > type inside Hibernate to client (property clientMode=true) and > starting a few stand-alone nodes (one per each VM?) > > This way, its client will

Re: Query on IgniteApplication running on java11

Hello! There may still be issues, such as showing -100% CPU load. It's better to have all the required JVM options. Regards, -- Ilya Kasnacheev чт, 12 нояб. 2020 г. в 05:42, vbm : > Hi, > > In my machine jdk 11 is installed and I am trying to write an Ignite > application to run on this envi

Re: [2.9.0]Entryprocessor cannot be hot deployed properly via UriDeploymentSpi

Hi Ilya, This issue exists in both versions 2.8 and 2.8.1. 在 2020/11/11 下午10:05, Ilya Kasnacheev 写道: Hello! Did that work under 2.8? Can you check If it wasn't, then maybe it is not implemented in the first place. If it is a regression, we could try to address that. Regards. -- Ilya Kasnac