CVE-2024-22243 - Spring Framework Vulnerability

Hi Team, Could you please advise if Ignite 2.14/2.15 is vulnerable to https://spring.io/security/cve-2024-22243 and if so whether a patch is planned? Thanks.

Fwd: Apache Ignite 3.0 Questions

for us). Thank you for answers David Bucek | Software Architect | MANTA -- *This email is intended solely for the addressee(s) and all its contents, including all attachments and files transmitted with it, represent confidential information. Unauthorized distribution, modification or disclosure

H2database dependency in Apache Ignite

-42392<https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2021-42392> and if so, do you have an ETA on when this would be available? Thank you. Kind regards, David Cussen Workday

Read through Write Through Example

We are trying to evaluate Ignite and could not find an example of the read through write through to a MS SQL Db. Is there one you can point to, preferably in .NET Code to show how this works? The information contained in this email message is being

Javamelody starting an Apache Ignite server node!

https://github.com/javamelody/javamelody/issues/962 "I am using the Apache Ignite thin client ( https://ignite.apache.org/docs/latest/thin-clients/java-thin-client). Somehow after my app has been running for a few minutes an Ignite server node suddenly starts up! This happens on a "javamelody"

Re: On disk compression

uot;holes" in a sparse file. To see the real amount of disk space occupied by > the file you should use "du" or "ls -s". > > > вт, 17 нояб. 2020 г. в 06:18, David Tinker : > >> I have enabled compression >> (pageSize=16384, diskPageCompression=ZST

On disk compression

. If I compress that file with zstd (default settings) it goes down to 106M. Is it possible to do better than this with Ignite? I need to be able to store a lot of data. Thanks David Relevant parts of my ignite config: ...

Re: ML stable and performance

g > > Mikael > > > Den 2019-09-06 kl. 11:50, skrev David Williams: > > > > > > I am evaluating ML framework for Java platform. I knew Ignite has ML > > package. > > But I like to know its stability and performance for production. Can > > Ignite

ML stable and performance

I am evaluating ML framework for Java platform. I knew Ignite has ML package. But I like to know its stability and performance for production. Can Ignite ML code run in distribute way? Except its own ML package, which ml packages are best options for Ignite?

Re: how does group by works in ignite

Hi Ilya, thx for helping me the column is collocated. Still I need around ~10+Servers to match one PG Server speed for a group by. What do you mean with use "collocated=true"? I thought it is only needed in case you dont have collocated data and still want to have full result set. and its not

how does group by works in ignite

Hi all, I need to analyze a performance bottleneck in a complex environment. So I decided to split down each component and split down the query to most simple level. *scenario:* - only 1 table "person" with 2 columns id (long), CURRENTCITYID(long) (both indexed) 10_000_000 rows *Task: * - make

Re: When to use REPLICATED vs PARTITIONED?

Hi Vladimir, thx for help. *Setup:* 2x server - one ignite node per server = 2 nodes city table size: 13_000 entries person table size: 10_000_000 entries *Execution times:* city table *PARTITIONED *+ person table PARTITIONED 0: jdbc:ignite:thin://127.0.0.1/> SELECT count(*) FROM

When to use REPLICATED vs PARTITIONED?

;template=REPLICATED, backups=0\""; query SELECT count(*) FROM "cachePerson".person AS p left join "cityCache".city AS c ON p.CURRENTCITYID=c.id where p.age <50; is faster when both tables are PARTITIONED. While my logic telles me it should faster if one is REPLICATED to avoid network trafic during joins. can someone help to understand. br David -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

How many Ignite nodes per Server + backup behavior

Hi all, Since Ignite uses only one thread/CPU for SQL reads per node. It is using only a very small part of the available Server resources. And so it is absolutly necessary to start multiple nodes per Server to improve read performance. Currently we testing Ignite with 4 Server each

select count () 20 times slower than select count(*)

Hi all, I have a simple Table on a one node cluster. Have filled it with 100mil lines of random data. but i dont understand why a select count(*) from people; is 20 times faster than a select count(id) from people; where id is indexed is there a reason for this? below table structure and

Re: How to create tables with JDBC, read with ODBC?

Hi, Here is my ODBC specification. The schema is specified as Public and this looks (identical?) like the example in the documentation: On Thu, Sep 6, 2018 at 11:06 AM Вячеслав Коптилин wrote: > Hi, > > > I have tried various things on the Java side to make the Public schema > explicit, such

Re: How to create tables with JDBC, read with ODBC?

I have no control over the format of the query coming through the ODBC driver. That is done automatically as far as I know by the[QLIK BI tool that is leveraging the ODBC driver to try to read data. Are you suggesting it is QLIK adding the extra quotes that is causing the problem with the H2

Re: Affinity calls in stream receiver

nested classes. On Tue, Jul 3, 2018, 4:20 AM Denis Mekhanikov wrote: > David, > > So, the problem is that the same class is loaded multiple times and it > wastes the metaspace, right? > Could you share a reproducer? > > Denis > > вт, 3 июл. 2018 г. в 0:58, David Harv

Affinity calls in stream receiver

We have a custom stream receiver that makes affinity calls. This all functions properly, but we see a very large number of the following messages for the same two classes. We also just tripped a 2GB limit on Metaspace size, which we came close to in the past.

Re: Deadlock during cache loading

Denis does have a point. When we were trying to run using GP2 storage, the cluster would simply lock up for an hour. Once we moved to local SSDs on i3 instances those issues went away (but we needed 2.5 to have the streaming rate hold for up as we had a lot of data loaded). The i3 instances

Re: Deadlock during cache loading

transactions are easy to use: see examples, org.apache.ignite. examples.datagrid.store.auto We use them in the stream receiver.You simply bracket the get/put in the transaction, but use a timeout, then bracket that with an "until done" while loop, perhaps added a sleep to backoff. We ended

Re: Deadlock during cache loading

You can start a transaction in the stream receiver to make it atomic. On Fri, Jun 29, 2018, 1:02 PM breischl wrote: > StreamTransformer does an invoke() pretty much exactly like what I'm doing, > so that would not seem to change anything. > > >

Re: Re-post: java.io.IOException: Too many open files

MYou must increase the Linux NOFILE ulimit when running Ignite. The documentation describes how to do this. On Sun, Jun 24, 2018, 12:47 PM 胡海麟 wrote: > Hi, > > Re-post message 'cause I failed to post my logs pasted. > > I have got repeated Too many open files exceptions since sometime. >

Re: Ignite 2.5 uncatched BufferUnderflowException while reading WAL on startup

Is https://issues.apache.org/jira/browse/IGNITE-8780 a regression in 2.5 ? On Thu, Jun 14, 2018 at 7:03 AM, Pavel Kovalenko wrote: > DocDVZ, > > Most probably you faced with the following issue https://issues.apache. > org/jira/browse/IGNITE-8780. > You can try to remove END file marker, in

Re: ignite peer class loading query

Certain kinds of requests (e.g., remote calls) carry enough information for the receiver of the message to do peer class loading. The main purpose of peer class loading is to avoid the need to restart the server to install software, and the peer class loading is therefore done by the server

Data Region Concurrency

We have a 2.4 ignite peristence cluster on AWS with 8 i3.xlarge nodes, where the default memory region size is 160GB.When loading a large amount of data through a custom StreamReceiver, over time we see the throughput decrease, as well as network and SSD I/O, and one node with higher CPU usage

Distribution of backups

We built a cluster with 8 nodes using Ignite persistence and 1 backup, and had two nodes fail at different times, the first being storage did not get mounted and ran out of space early, and the second an SSD failed. There are some things that we could have done better, but this event brings up

Re: Running Ignite/GridGain in AWS

The biggest thing for us using Ignite Persistence on AWS was finding that we needed to use i3 instances for the SSD write performance. Ignite persistences and GP2 was a poor experience. On Tue, May 15, 2018 at 2:43 AM, John Gardner wrote: > We've been running the

Re: slow restart of ignite (with persistence enabled)

You have deactivated the cluster, e.g., using visor? On Mon, May 7, 2018 at 9:08 PM, Randall Harmon wrote: > > What is the recommended way to signal Ignite to shutdown cleanly, so that > WAL file doesn't have to be replayed (?) when Ignite restarts? We are > loading

Re: IgniteDataStreamer.flush() returns before all futures are completed

an exception. -DH On Thu, Apr 26, 2018 at 10:23 AM, Andrey Kuznetsov <stku...@gmail.com> wrote: > Hi, David, > > As far as a can see from streamer implementation, flush() call > 1. won't return until all futures returned by addData() are (successfully) > finished > 2. wi

Re: IgniteDataStreamer.flush() returns before all futures are completed

On Wed, Apr 25, 2018 at 5:43 PM, Yakov Zhdanov <yzhda...@apache.org> wrote: > David, can you try adding all the futures to a collection and change > assert condition to check that for all futures in that collection > fut.isDone() is true? > > This should be a proper assertio

IgniteDataStreamer.flush() returns before all futures are completed

We had assumed that if we did, in one thread: IgniteFuture f = streamer.addData(...); f.listen(...) streamer.flush(); assert( all the prior futures have completed); << this triggered. I can't determine if this a bug, or just that the description could use

Re: Ignite visor command issue on K8s cluster

I've had problems with the visor cache command failing when a client is connected, which was related to TCP port firewalls. Visor was trying to make a connection that was blocked. I don't remember whether top failed. On Mon, Apr 9, 2018 at 7:10 AM, vbm wrote: > Hi Dave

Re: Ignite visor command issue on K8s cluster

You have 4 nodes running, but are they part of a single cluster? If you look at the log file for one of the server nodes, has it connected to 4 servers or only one? PS. I've found this avoids the need to look up the URL "bin/ignitevisor.sh -cfg=$CONFIG_URI". On Sat, Apr 7, 2018 at 8:40 AM,

Re: POC with DataStreamer (Kafka or Ignite - security question)

Assuming Ignite Persistence, you can create a cache in a specific Data Regions, but I'm unclear whether this properties can be set per region. We are setting them in org.apache.ignite.configuration.DataStorageConfiguration. What you seem to be asking for is to set these per Data Region.

Re: Broadcast method fails with DataStorage peristenceEnabled

rong here. > > On Tue, Apr 3, 2018 at 12:12 PM, David Harvey <dhar...@jobcase.com> wrote: > >> PS. I'm actually remembering it was due to a mismatch of Java7 vs 8, >> which does not make that much sense, because we have been running Java7 >> clients recently with

Re: Broadcast method fails with DataStorage peristenceEnabled

PS. I'm actually remembering it was due to a mismatch of Java7 vs 8, which does not make that much sense, because we have been running Java7 clients recently with no issues. On Tue, Apr 3, 2018 at 3:05 PM, David Harvey <dhar...@jobcase.com> wrote: > I had those "UNKNOWN PAIR

Re: Broadcast method fails with DataStorage peristenceEnabled

I had those "UNKNOWN PAIR" issues early on, and it seemed to be some kind of version problem, like the client was not running at the same rev. On Tue, Apr 3, 2018 at 2:15 PM, Supun Nakandala wrote: > Hi all, > > I am trying to setup Apache Ignite with persistence

Re: One time replicating of the cluster data for setting up a new cluster

When using Ignite Persistence, I have found that you can simply replicate the folders, if you deactivate the cluster first. You need the wal and store, as well as two folders under $IGNITE_HOME/work which are named something like marshaller* and binary* On Tue, Apr 3, 2018 at 2:52 AM, Naveen

Re: Slow data load in ignite from S3

When I did this, I found that with Ignite Persistence, there is a lot of write amplification (many times more bytes written to SSD than data bytes written) the during the checkpoints, which makes sense because ignite writes whole pages, and each record written dirties pieces of many pages. The

Re: Data Streamer not flushing data to cache

By default, DataStreamer will only send a full buffer, unless you explicitly flush or close it, or as suggested, implicitly close it. You can set a flush timer also. The last time I looked (2.3), flush timer is implemented to flush periodically, and this is unaffected by when data was last

Re: Determining BinaryObject field type

I had stopped at BinaryObject, and didn't follow the indirection though type() to BinaryType. I think I assumed that this had only information at the higher level, and wouldn't drill down into the fields. This also answers a question about how to enumerate the fields. Thanks. -DH On Wed, Mar

Re: Ingite deploy in AWS

As you already know, you cannot have the config file in the discovery bucket, because discovery enumerates the contents of the discovery bucket. But the credentials in the config bucket are not yet visible, so they cannot be used. You can make the config bucket public, but not with the key

Re: Basic terms in Ignite

1. You can call ignite.start() twice in the same JVM, and you get two Ignite nodes (there are some restrictions around the same cluster I don't understand). An ignite node may be a client or a server. I believe can have two client nodes in the same JVM connected to two different clusters.

Re: Issues trying to force redeployment in shared mode

1. I had created IGNITE-7905 for this interaction with userVersion and perhaps only ignite.Activate() issued from the client. I think it deals with the code for Activate() using nested classes. The server decided that it already had a version of the ignite code loaded, and wasn't

Re: Any references - Syncing Ignite and Oracle DB with Oracle GoldenGate - updates from DB to ignite

For MySql we are reading the binlog in row,format and sending the updates, with the LSN appended on a,data streamer with a custom Stream Reciever that uses the lsn to detect out of order cases. We get eventually consistent results only. On Fri, Mar 23, 2018, 3:48 AM Naveen

Re: Kubernetes - Access Ignite Cluster Externally

To access ignite from outside of kubernetes, you need to enable hostNetwork in the kubernetes cluster for your ignite server pods (this is not enabled with default permissions as it goes against many of the core principals of kubernetes). This will allow the ignite server to attach directly

Re: Affinity Key column to be always part of the Primary Key

Based this latest description, simply not specifying an affinity key here would be sufficient. But presumably you were specifying the affinity key to cause co-location. The reason a lookup on the K of the KV pair is fast is because it can hash to a node. If the affinity key was not

Re: Affinity Key column to be always part of the Primary Key

What is your goal? If you have a unique key that does not contain the affinity key, and the primary key contains both fields, you can create an index on that unique key, so that you could have fast node local lookups using SqlQuery().If you want to find an object only by that original unique

Re: New feature with 2.4 - Using 3rd Party Persistence With Native Persistence

IIgnite persistence is per data region https://apacheignite.readme.io/docs/memory-configuration#section-data-regions On Mon, Mar 19, 2018 at 10:11 AM, Naveen wrote: > Hi > > Looks like dual persistence - 3rd party (Oracle) and native persistence - > both are supported

Re: Affinity Key column to be always part of the Primary Key

Yes, the affinity key must be part of the primary key. Welcome to my world On Fri, Mar 16, 2018 at 3:23 AM, Naveen wrote: > Hi Mike > > I have created a table called CITY > > : jdbc:ignite:thin://127.0.0.1> CREATE TABLE City ( city_id LONG PRIMARY > KEY, name

SELECT Statement cancellation & memory sizing

I have a question about SQL query via JDBC cancellation, as well as a performance question. I've connected Ignite from SQL/Workbench using the Thin driver, however via ssh -L proxy and I issued "select count(*) from table1 where indexedField = x;" and that took 1:40 (m:ss) "select count(*) from

Re: NODE_SEGMENTED AND NODE_FAILED errors

When I hit something like this, the logs suggested increasing socketWriteTimeout, and that helped for me. On Fri, Mar 2, 2018 at 7:58 AM, KR Kumar wrote: > Hi - I have a three node cluster with c4.2xlarge machines with ignite > persistence enabled. While doing a load

Re: 2.4.0 Release

<ro...@gromtech.ru> wrote: > > Hi David, > > It looks like there are several tickets which need to be done [1]. Almost > all of them are related to documentation. I guess the Ignite 2.4 will be > released soon (most likely in March). > > If you want to try new version right no

2.4.0 Release

I’m looking for the 2.4.0 release and not seeing anything on the downloads page, but I do see that the pom.xml on master has been bumped to 2.5.0-SNAPSHOT. Is any work happening on the 2.4.0 release?

Re: Large durable caches

the instance, or a failure > of the underlying physical host? > > > > *From:* David Harvey [mailto:dhar...@jobcase.com] > *Sent:* Friday, February 23, 2018 10:03 AM > *To:* user@ignite.apache.org > *Subject:* Re: Large durable caches > > > > Using the local SSDs, whi

Re: Large durable caches

Using the local SSDs, which are radically faster than EBS. On Thu, Feb 22, 2018 at 10:34 AM, lawrencefinn wrote: > I could try a different AWS instance. Im running these tests on r4.8xlarge > boxes, which are pretty beefy and "ebs optimized". I tried the same tests > using

Re: Ignite Persistence performance issue

I have had more success with i3 instances On Feb 21, 2018 10:01 PM, "KR Kumar" wrote: Hi All - I am using Ignite Persistence ( 2.3) for storing events that we receive from different sources. Currently the write and read throughput is 2k to 4k per second on a t2.xlarge

Re: 20 minute 12x throughput drop using data streamer and Ignite persistence

We are pulling in a large number of records from an RDB, and reorganizing the data so that our analytics will be much faster. I'm running Sumo, and have looked at all of the log files from all the nodes, and the only things are checkpoints and GC logs. The checkpoints are fast, and occur at a

Re: Runtime.availableProcessors() returns hardware's CPU count whichis the issue with Ignite in Kubernetes

Older versions of the JVM are not aware of Linux cgroups used to limit memory and CPUs to containers. They look at the host information and get the wrong impression of their environment. Starting with 1.8u131 and in Java 9, the JVM has been updated, assuming you enable the additional

WAL size control

Hello all, I’m having an issue understanding how to control/limit the size of the WAL as well as why I’m consuming so much WAL space. I’m currently migrating a project from redis to ignite and as part of the first phase, its pretty much lift and shift without optimizing for ignite. In this

TcpDiscoveryVmIpFinder handle IP change

, and I want my client node can automatically reconnect itself to the server node. Any help are appreciated. Thank you. David 14 Aug

How to detect if Ignite server nodes are connectable

there and ignite will try to connect again every 5 minutes. Is it possible to let ignite fail immediately and return to my code, so I can handle the failure myself? BRs, David

Cannot create cache in EVT_CLIENT_NODE_RECONNECTED event

// if debug, program hangs here System.out.println("Initialised cache: " + CACHE_NAME); // never see this in output } return true; } } Appreciate any ideas. Thanks. BRs, David

Behaviour about extra or unknown property

wondering if there is any setting can change the behaviour, for example, if there is any unknown property, can make the retrieval fail or return null? My purpose is just to make sure outdated data wont be accidentally retrieved. BRs, David

Weird behaviour about enum with methods

pplicationType$2, hash code is 331596257 ApplicationType.API.hashCode() is 251520863 I tried an enum without any method definitions, then no issue. Any idea about this? BRs, David

Re: ignite-indexing IncompatibleClassChangeError

Thanks Andrey. I have the issue fixed with specifying the h2.version=1.4.191, it became 1.4.193 because of spring boot. On Wed, Apr 19, 2017 at 9:43 AM, Andrey Mashenkov < andrey.mashen...@gmail.com> wrote: > Hi David, > > Looks like your H2 version is not compatible with ignite

ignite-indexing IncompatibleClassChangeError

I have a working ignite cluster and clients. However, then I added the ignite-indexing to the project dependency, only add the dependency, not yet change anything else yet. I got the following error: Anyone got any idea? Caused by: class

Re: ScanQuery With BinaryObject

Hi Andrey, Your suggestion fixed my problem. Thank you. On Tue, Apr 4, 2017 at 1:08 AM, Andrey Mashenkov <andrey.mashen...@gmail.com > wrote: > Hi David, > > Scan query results are never cached. It looks like your IgniteBiPredicate > implementation is cached on server s

Re: ScanQuery With BinaryObject

Sorry, please ignore the previous email, it was sent by mistake. 1. I download apache-ignite-fabric-1.9.0-bin.zip, and unzip it. 2. In terminal, I start an ignite instance by *bin/ignite.sh examples/config/example-ignite.xml* 3. I create a Java application, source code as below: public static

Re: ScanQuery With BinaryObject

when I run this program first time, it will return two entries, their addresses are started with "jurong", which is correct. When I run the program again, with changed value, eg. changi, it should return one entry, somehow, it still return two entries with address started with "jurong&qu

Re: ScanQuery With BinaryObject

< andrey.mashen...@gmail.com> wrote: > Hi David, > > I've run your code and it works fine for me on ignite 1.7-1.9 versions and > master branch. > > On Thu, Mar 30, 2017 at 12:19 PM, David Li <david.li...@gmail.com> wrote: > >> Hello, >> >

ScanQuery With BinaryObject

ect>> result = binaryCache.query(scanQuery).getAll(); I expect it will return an empty result, somehow it always returns everything in the cache. Not sure what is wrong? BRs, David

Re: IGNITE-4029

I will, I'm trying to clean-up a test I built back when I opened the ticket. I may not be able to post it today, but I'll try to do so tomorrow. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/IGNITE-4029-tp10920p10922.html Sent from the Apache Ignite Users

IGNITE-4029

Hi, I have been experiencing an issue on local ContinousQueries (I opened a ticket a few monthes ago) for a while and I was wondering if anyone with a better knowledge (than me) of the inner workings of the ContinuousQueries would have a few minutes to take a look? Thanks -- View this

Re: listening for events on transactions

I can - but apparently not with a separate process that gets notifications - which is the design point I was seeking. Thanks again. On Wed, Jun 1, 2016 at 12:55 PM, Alexei Scherbakov < alexey.scherbak...@gmail.com> wrote: > You can easily implement such a thing as a part of transaction logic. >

Using SQL to query Object field stored in Cache ?

With Ignite 1.5.0: I have two caches. Cache 1 stores a Person object like this: personCache.put(id, PersonObj1); The Person class has only a single field in it declared like this: @QuerySqlField(index = true) private int personId; Cache 2 stores a Person Attribute object like this:

Re: Integration issue with enyimmecached client

request? Thank you David On 2/23/16, 1:57 AM, "vkulichenko" <valentin.kuliche...@gmail.com> wrote: >David, > >OK, now I get it. I will take a closer look at this. > >Do you by any chance know where I can find good description of Memcache >binary protocol? It sou

RE: Integration issue with enyimmecached client

you David From: vkulichenko [valentin.kuliche...@gmail.com] Sent: Monday, February 22, 2016 9:24 PM To: user@ignite.apache.org Subject: Re: Integration issue with enyimmecached client Hi David, Are you saying that the client sends the value