Hi Team,
Could you please advise if Ignite 2.14/2.15 is vulnerable to
https://spring.io/security/cve-2024-22243 and if so whether a patch is
planned?
Thanks.
us).
Thank you for answers
David Bucek | Software Architect | MANTA
--
*This email is intended solely for the addressee(s) and all its contents,
including all attachments and files transmitted with it, represent
confidential information. Unauthorized distribution, modification or
disclosure
-42392<https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2021-42392>
and if so, do you have an ETA on when this would be available?
Thank you.
Kind regards,
David Cussen
Workday
We are trying to evaluate Ignite and could not find an example of the read
through write through to a MS SQL Db.
Is there one you can point to, preferably in .NET Code to show how this works?
The information contained in this email message is being transmi
https://github.com/javamelody/javamelody/issues/962
"I am using the Apache Ignite thin client (
https://ignite.apache.org/docs/latest/thin-clients/java-thin-client).
Somehow after my app has been running for a few minutes an Ignite server
node suddenly starts up! This happens on a "javamelody" thr
bout
> "holes" in a sparse file. To see the real amount of disk space occupied by
> the file you should use "du" or "ls -s".
>
>
> вт, 17 нояб. 2020 г. в 06:18, David Tinker :
>
>> I have enabled compression
>> (pageSize=16384, diskPageCom
size. If I compress that file with zstd
(default settings) it goes down to 106M.
Is it possible to do better than this with Ignite? I need to be able to
store a lot of data.
Thanks
David
Relevant parts of my ignite config:
...
docs/machine-learning
>
> Mikael
>
>
> Den 2019-09-06 kl. 11:50, skrev David Williams:
> >
> >
> > I am evaluating ML framework for Java platform. I knew Ignite has ML
> > package.
> > But I like to know its stability and performance for production. C
I am evaluating ML framework for Java platform. I knew Ignite has ML
package.
But I like to know its stability and performance for production. Can Ignite
ML code run in distribute way?
Except its own ML package, which ml packages are best options for Ignite?
Hi Ilya,
thx for helping me
the column is collocated. Still I need around ~10+Servers to match one PG
Server speed for a group by.
What do you mean with use "collocated=true"?
I thought it is only needed in case you dont have collocated data and still
want to have full result set.
and its not ne
Hi all,
I need to analyze a performance bottleneck in a complex environment.
So I decided to split down each component and split down the query to most
simple level.
*scenario:*
- only 1 table "person" with 2 columns
id (long), CURRENTCITYID(long) (both indexed)
10_000_000 rows
*Task: *
- make
Hi Vladimir,
thx for help.
*Setup:*
2x server - one ignite node per server = 2 nodes
city table size: 13_000 entries
person table size: 10_000_000 entries
*Execution times:*
city table *PARTITIONED *+ person table PARTITIONED
0: jdbc:ignite:thin://127.0.0.1/> SELECT count(*) FROM "cachePerson
plate=REPLICATED, backups=0\"";
query
SELECT count(*) FROM "cachePerson".person AS p left join "cityCache".city AS
c ON p.CURRENTCITYID=c.id where p.age <50;
is faster when both tables are PARTITIONED.
While my logic telles me it should faster if one is REPLICATED to avoid
network trafic during joins.
can someone help to understand.
br
David
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi all,
Since Ignite uses only one thread/CPU for SQL reads per node.
It is using only a very small part of the available Server resources.
And so it is absolutly necessary to start multiple nodes per Server to
improve read performance.
Currently we testing Ignite with 4 Server each 8core/16threa
Hi all,
I have a simple Table on a one node cluster.
Have filled it with 100mil lines of random data.
but i dont understand why a
select count(*) from people; is 20 times faster than a
select count(id) from people; where id is indexed
is there a reason for this?
below table structure and explain
Hi,
Here is my ODBC specification.
The schema is specified as Public and this looks (identical?) like the
example in the documentation:
On Thu, Sep 6, 2018 at 11:06 AM Вячеслав Коптилин
wrote:
> Hi,
>
> > I have tried various things on the Java side to make the Public schema
> explicit, such a
I have no control over the format of the query coming through the ODBC
driver.
That is done automatically as far as I know by the[QLIK BI tool that is
leveraging the ODBC driver
to try to read data.
Are you suggesting it is QLIK adding the extra quotes that is causing the
problem with the H2 driv
nested classes.
On Tue, Jul 3, 2018, 4:20 AM Denis Mekhanikov wrote:
> David,
>
> So, the problem is that the same class is loaded multiple times and it
> wastes the metaspace, right?
> Could you share a reproducer?
>
> Denis
>
> вт, 3 июл. 2018 г. в 0:58, David Harv
We have a custom stream receiver that makes affinity calls. This all
functions properly, but we see a very large number of the following
messages for the same two classes. We also just tripped a 2GB limit on
Metaspace size, which we came close to in the past.
[18:41:50,365][INFO][pub-#6954%Grid
Denis does have a point. When we were trying to run using GP2 storage,
the cluster would simply lock up for an hour. Once we moved to local SSDs
on i3 instances those issues went away (but we needed 2.5 to have the
streaming rate hold for up as we had a lot of data loaded). The i3
instances a
transactions are easy to use: see examples, org.apache.ignite.
examples.datagrid.store.auto
We use them in the stream receiver.You simply bracket the get/put in
the transaction, but use a timeout, then bracket that with an "until done"
while loop, perhaps added a sleep to backoff.
We ended up
You can start a transaction in the stream receiver to make it atomic.
On Fri, Jun 29, 2018, 1:02 PM breischl wrote:
> StreamTransformer does an invoke() pretty much exactly like what I'm doing,
> so that would not seem to change anything.
>
>
> https://github.com/apache/ignite/blob/master/module
MYou must increase the Linux NOFILE ulimit when running Ignite. The
documentation describes how to do this.
On Sun, Jun 24, 2018, 12:47 PM 胡海麟 wrote:
> Hi,
>
> Re-post message 'cause I failed to post my logs pasted.
>
> I have got repeated Too many open files exceptions since sometime.
> ==
Are you enabling the extra flags required for the JVM work detect memory and
work properly?
Specifically adding the following options to the JVM options when starting
ignite
-XX:+UseCGroupMemoryLimitForHeap. The -XX:+UnlockExperimentalVMOptions
See:
https://blogs.oracle.com/java-platform-grou
Is https://issues.apache.org/jira/browse/IGNITE-8780 a regression in 2.5 ?
On Thu, Jun 14, 2018 at 7:03 AM, Pavel Kovalenko wrote:
> DocDVZ,
>
> Most probably you faced with the following issue https://issues.apache.
> org/jira/browse/IGNITE-8780.
> You can try to remove END file marker, in this
Certain kinds of requests (e.g., remote calls) carry enough information for
the receiver of the message to do peer class loading. The main purpose of
peer class loading is to avoid the need to restart the server to install
software, and the peer class loading is therefore done by the server
reque
We have a 2.4 ignite peristence cluster on AWS with 8 i3.xlarge nodes,
where the default memory region size is 160GB.When loading a large
amount of data through a custom StreamReceiver, over time we see the
throughput decrease, as well as network and SSD I/O, and one node with
higher CPU usage
We built a cluster with 8 nodes using Ignite persistence and 1 backup, and
had two nodes fail at different times, the first being storage did not get
mounted and ran out of space early, and the second an SSD failed. There
are some things that we could have done better, but this event brings up
th
The biggest thing for us using Ignite Persistence on AWS was finding that
we needed to use i3 instances for the SSD write performance. Ignite
persistences and GP2 was a poor experience.
On Tue, May 15, 2018 at 2:43 AM, John Gardner
wrote:
> We've been running the GridGain version of Ignite 8
Are you trying to stop the cluster or a node? If the former, then you can
use control.sh to deactivate the cluster before stopping the nodes.
On Tue, May 8, 2018, 7:39 PM Randall Harmon
wrote:
> @dharvey - no, cluster is not deactivated.
>
> @anton - 26gb of data is under ignite data directory
You have deactivated the cluster, e.g., using visor?
On Mon, May 7, 2018 at 9:08 PM, Randall Harmon
wrote:
>
> What is the recommended way to signal Ignite to shutdown cleanly, so that
> WAL file doesn't have to be replayed (?) when Ignite restarts? We are
> loading a large set of data from mul
owing an exception.
-DH
On Thu, Apr 26, 2018 at 10:23 AM, Andrey Kuznetsov
wrote:
> Hi, David,
>
> As far as a can see from streamer implementation, flush() call
> 1. won't return until all futures returned by addData() are (successfully)
> finished
> 2. will throw an
On Wed, Apr 25, 2018 at 5:43 PM, Yakov Zhdanov wrote:
> David, can you try adding all the futures to a collection and change
> assert condition to check that for all futures in that collection
> fut.isDone() is true?
>
> This should be a proper assertion. Please let me know if it w
We had assumed that if we did, in one thread:
IgniteFuture f = streamer.addData(...);
f.listen(...)
streamer.flush();
assert( all the prior futures have completed); << this triggered.
I can't determine if this a bug, or just that the description could use
improvement.
I've had problems with the visor cache command failing when a client is
connected, which was related to TCP port firewalls. Visor was trying to
make a connection that was blocked. I don't remember whether top failed.
On Mon, Apr 9, 2018 at 7:10 AM, vbm wrote:
> Hi Dave
>
> In the ignite pod
You have 4 nodes running, but are they part of a single cluster? If you
look at the log file for one of the server nodes, has it connected to 4
servers or only one?
PS. I've found this avoids the need to look up the URL "bin/ignitevisor.sh
-cfg=$CONFIG_URI".
On Sat, Apr 7, 2018 at 8:40 AM, vbm
Assuming Ignite Persistence, you can create a cache in a specific Data
Regions, but I'm unclear whether this properties can be set per region. We
are setting them in
org.apache.ignite.configuration.DataStorageConfiguration. What you seem
to be asking for is to set these per Data Region.
Nakandala
wrote:
> I verified the java version is the same.
>
> The interesting thing here is the code runs correctly if I disable
> persistence.
>
>
>
> I wonder whether there is an issue in enabling persistence or I am doing
> something wrong here.
>
> On Tue, A
PS. I'm actually remembering it was due to a mismatch of Java7 vs 8, which
does not make that much sense, because we have been running Java7 clients
recently with no issues.
On Tue, Apr 3, 2018 at 3:05 PM, David Harvey wrote:
> I had those "UNKNOWN PAIR" issues early on, a
I had those "UNKNOWN PAIR" issues early on, and it seemed to be some kind
of version problem, like the client was not running at the same rev.
On Tue, Apr 3, 2018 at 2:15 PM, Supun Nakandala
wrote:
> Hi all,
>
> I am trying to setup Apache Ignite with persistence enabled and facing a
> deseriali
When using Ignite Persistence, I have found that you can simply replicate
the folders, if you deactivate the cluster first.
You need the wal and store, as well as two folders under $IGNITE_HOME/work
which are named something like marshaller* and binary*
On Tue, Apr 3, 2018 at 2:52 AM, Naveen wro
When I did this, I found that with Ignite Persistence, there is a lot of
write amplification (many times more bytes written to SSD than data bytes
written) the during the checkpoints, which makes sense because ignite
writes whole pages, and each record written dirties pieces of many pages.
The SS
Note that 2.4 has significant improvements WRT rebalancing, including
baselines: https://apacheignite.readme.io/docs/cluster-activation
On Mon, Apr 2, 2018 at 7:39 AM, Raymond Wilson
wrote:
> I’ve been reading how Ignite manages rebalancing as a result of topology
> changes here: https://apache
By default, DataStreamer will only send a full buffer, unless you
explicitly flush or close it, or as suggested, implicitly close it. You
can set a flush timer also.
The last time I looked (2.3), flush timer is implemented to flush
periodically, and this is unaffected by when data was last added
I had stopped at BinaryObject, and didn't follow the indirection though
type() to BinaryType. I think I assumed that this had only information at
the higher level, and wouldn't drill down into the fields.
This also answers a question about how to enumerate the fields.
Thanks.
-DH
On Wed, Mar 28,
As you already know, you cannot have the config file in the discovery
bucket, because discovery enumerates the contents of the discovery bucket.
But the credentials in the config bucket are not yet visible, so they
cannot be used. You can make the config bucket public, but not with the
key stor
1. You can call ignite.start() twice in the same JVM, and you get two
Ignite nodes (there are some restrictions around the same cluster I don't
understand). An ignite node may be a client or a server. I believe
can have two client nodes in the same JVM connected to two different
clusters.
1. I had created IGNITE-7905 for this interaction with userVersion and
perhaps only ignite.Activate() issued from the client. I think it deals
with the code for Activate() using nested classes. The server decided that
it already had a version of the ignite code loaded, and wasn't goin
For MySql we are reading the binlog in row,format and sending the updates,
with the LSN appended on a,data streamer with a custom Stream Reciever that
uses the lsn to detect out of order cases. We get eventually consistent
results only.
On Fri, Mar 23, 2018, 3:48 AM Naveen wrote:
> Hi
>
> We a
To access ignite from outside of kubernetes, you need to enable hostNetwork in
the kubernetes cluster for your ignite server pods (this is not enabled with
default permissions as it goes against many of the core principals of
kubernetes). This will allow the ignite server to attach directly the
Based this latest description, simply not specifying an affinity key here
would be sufficient. But presumably you were specifying the affinity key
to cause co-location. The reason a lookup on the K of the KV pair is fast
is because it can hash to a node. If the affinity key was not included
What is your goal? If you have a unique key that does not contain the
affinity key, and the primary key contains both fields, you can create an
index on that unique key, so that you could have fast node local lookups
using SqlQuery().If you want to find an object only by that original
unique
IIgnite persistence is per data region
https://apacheignite.readme.io/docs/memory-configuration#section-data-regions
On Mon, Mar 19, 2018 at 10:11 AM, Naveen wrote:
> Hi
>
> Looks like dual persistence - 3rd party (Oracle) and native persistence -
> both are supported
>
> "*Starting with Apache
Yes, the affinity key must be part of the primary key. Welcome to my
world
On Fri, Mar 16, 2018 at 3:23 AM, Naveen wrote:
> Hi Mike
>
> I have created a table called CITY
>
> : jdbc:ignite:thin://127.0.0.1> CREATE TABLE City ( city_id LONG PRIMARY
> KEY, name VARCHAR) WITH "template=repl
You can give it a Map also, but that will not be substantially
faster. Because the data streamer routes by affinity key, has to process
each record, and route it to the buffer for the node with that key. The
data streamer will collect 8192 records on the client node for each server
node befo
I have a question about SQL query via JDBC cancellation, as well as a
performance question.
I've connected Ignite from SQL/Workbench using the Thin driver, however via
ssh -L proxy and I issued
"select count(*) from table1 where indexedField = x;" and that took 1:40
(m:ss)
"select count(*) from t
When I hit something like this, the logs suggested increasing
socketWriteTimeout, and that helped for me.
On Fri, Mar 2, 2018 at 7:58 AM, KR Kumar wrote:
> Hi - I have a three node cluster with c4.2xlarge machines with ignite
> persistence enabled. While doing a load testing of the cluster, afte
> Hi David,
>
> It looks like there are several tickets which need to be done [1]. Almost
> all of them are related to documentation. I guess the Ignite 2.4 will be
> released soon (most likely in March).
>
> If you want to try new version right now, you are able to build 2.
I’m looking for the 2.4.0 release and not seeing anything on the downloads
page, but I do see that the pom.xml on master has been bumped to 2.5.0-SNAPSHOT.
Is any work happening on the 2.4.0 release?
ElasticSearch has this feature (where you exclude a node) and we use it all
the time in production.
For example, if AWS has planned maintenance on instance with local SSDs, we
want to add a new node, and remove the old node, without a temporary
decrease in the number of backups. If you are runn
re
> of the underlying physical host?
>
>
>
> *From:* David Harvey [mailto:dhar...@jobcase.com]
> *Sent:* Friday, February 23, 2018 10:03 AM
> *To:* user@ignite.apache.org
> *Subject:* Re: Large durable caches
>
>
>
> Using the local SSDs, which are radically faster tha
Using the local SSDs, which are radically faster than EBS.
On Thu, Feb 22, 2018 at 10:34 AM, lawrencefinn wrote:
> I could try a different AWS instance. Im running these tests on r4.8xlarge
> boxes, which are pretty beefy and "ebs optimized". I tried the same tests
> using IO1 disks at 20,000
I have had more success with i3 instances
On Feb 21, 2018 10:01 PM, "KR Kumar" wrote:
Hi All - I am using Ignite Persistence ( 2.3) for storing events that we
receive from different sources. Currently the write and read throughput is
2k to 4k per second on a t2.xlarge and c4.2xlarge machines on
We are pulling in a large number of records from an RDB, and reorganizing
the data so that our analytics will be much faster.
I'm running Sumo, and have looked at all of the log files from all the
nodes, and the only things are checkpoints and GC logs. The checkpoints
are fast, and occur at a low
I have a 8 node cluster with 244GB/node, and I see a behavior I don't have
any insight into, and which doesn't make sense.
I'm using a custom StreamReceiver which starts a transaction that starts a
transaction and updates 4 partitioned caches, 2 of which should be local
updates. Ignite Persisten
Older versions of the JVM are not aware of Linux cgroups used to limit
memory and CPUs to containers. They look at the host information and get
the wrong impression of their environment. Starting with 1.8u131 and in
Java 9, the JVM has been updated, assuming you enable the additional
experimental
Hello all,
I’m having an issue understanding how to control/limit the size of the WAL as
well as why I’m consuming so much WAL space.
I’m currently migrating a project from redis to ignite and as part of the first
phase, its pretty much lift and shift without optimizing for ignite. In this
ca
rs.add(addr.getHostString());
}
super.setAddresses(addrs);
return super.getRegisteredAddresses();
}
I tested, it works fine. I am just not sure if there is any negative
impacts.
On Tue, Aug 15, 2017 at 2:40 AM, Nikolai Tikhonov
wrote:
> Hi David,
>
> JVM can cache a name service. Could
, and I want my client node can automatically reconnect itself to
the server node. Any help are appreciated. Thank you.
David
14 Aug
and ignite will try to connect again every 5
minutes. Is it possible to let ignite fail immediately and return to my code,
so I can handle the failure myself?
BRs,
David
System.out.println("Initialised cache: " + CACHE_NAME);
// never see this in output
}
return true;
}
}
Appreciate any ideas. Thanks.
BRs,
David
wondering if there is any setting can change the behaviour, for
example, if there is any unknown property, can make the retrieval fail or
return null? My purpose is just to make sure outdated data wont be
accidentally retrieved.
BRs,
David
sh
code is 331596257
ApplicationType.API.hashCode() is 251520863
I tried an enum without any method definitions, then no issue. Any
idea about this?
BRs,
David
Thanks Andrey.
I have the issue fixed with specifying the h2.version=1.4.191, it became
1.4.193 because of spring boot.
On Wed, Apr 19, 2017 at 9:43 AM, Andrey Mashenkov <
andrey.mashen...@gmail.com> wrote:
> Hi David,
>
> Looks like your H2 version is not compatible with ignite
I have a working ignite cluster and clients. However, then I added the
ignite-indexing to the project dependency, only add the dependency, not yet
change anything else yet. I got the following error:
Anyone got any idea?
Caused by: class
org.apache.ignite.internal.processors.query.IgniteSQLExcept
Hi Andrey,
Your suggestion fixed my problem. Thank you.
On Tue, Apr 4, 2017 at 1:08 AM, Andrey Mashenkov wrote:
> Hi David,
>
> Scan query results are never cached. It looks like your IgniteBiPredicate
> implementation is cached on server side.
> Try to move this class to uppe
Sorry, please ignore the previous email, it was sent by mistake.
1. I download apache-ignite-fabric-1.9.0-bin.zip, and unzip it.
2. In terminal, I start an ignite instance by *bin/ignite.sh
examples/config/example-ignite.xml*
3. I create a Java application, source code as below:
public static voi
put some data inside,
then try to run a scan query to find entries by its address.
The problem is when I run this program first time, it will return two
entries, their addresses are started with "jurong", which is correct.
When I run the program again, with changed value, eg. changi, i
<
andrey.mashen...@gmail.com> wrote:
> Hi David,
>
> I've run your code and it works fine for me on ignite 1.7-1.9 versions and
> master branch.
>
> On Thu, Mar 30, 2017 at 12:19 PM, David Li wrote:
>
>> Hello,
>>
>> I am having a little issue wi
ng?
BRs,
David
I will, I'm trying to clean-up a test I built back when I opened the ticket.
I may not be able to post it today, but I'll try to do so tomorrow.
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/IGNITE-4029-tp10920p10922.html
Sent from the Apache Ignite Users mail
Hi,
I have been experiencing an issue on local ContinousQueries (I opened a
ticket a few monthes ago) for a while and I was wondering if anyone with a
better knowledge (than me) of the inner workings of the ContinuousQueries
would have a few minutes to take a look?
Thanks
--
View this messag
I can - but apparently not with a separate process that gets notifications
- which is the design point I was seeking.
Thanks again.
On Wed, Jun 1, 2016 at 12:55 PM, Alexei Scherbakov <
alexey.scherbak...@gmail.com> wrote:
> You can easily implement such a thing as a part of transaction logic.
>
>
With Ignite 1.5.0:
I have two caches.
Cache 1 stores a Person object like this:
personCache.put(id, PersonObj1);
The Person class has only a single field in it declared like this:
@QuerySqlField(index = true)
private int personId;
Cache 2 stores a Person Attribute object like this:
AttributeC
request?
Thank you
David
On 2/23/16, 1:57 AM, "vkulichenko" wrote:
>David,
>
>OK, now I get it. I will take a closer look at this.
>
>Do you by any chance know where I can find good description of Memcache
>binary protocol? It sounds like you're quoting [1],
Thank you
David
From: vkulichenko [valentin.kuliche...@gmail.com]
Sent: Monday, February 22, 2016 9:24 PM
To: user@ignite.apache.org
Subject: Re: Integration issue with enyimmecached client
Hi David,
Are you saying that the client sends the value wit
nugget package version 2.13.0.0
Please let me know if more information is required.
Thank you
David
87 matches
Mail list logo
