Re: Ignite through Redis interface - Restarted node unable to join

2024-10-29 Thread Stephen Darlington
What do you mean "through the Redis interface"? I don't see anything obvious in your configuration or logs. The most suspicious thing is that you have a tiny amount of Java heap space and a large number of tables. On Mon, 28 Oct 2024 at 19:27, Ashu Pachauri wrote: > Hi folks, > > We have been f

Re: rejecting communication connection & Failed to processselector key

2024-10-25 Thread Stephen Darlington
You've not shared much information about your cluster (or Kubernetes) configuration, but from what I can gather you have TLS enabled. I would suggest you disable TLS and see if you get the same error. The most common problem here is your certificates not exactly matching your topology. On Thu, 10

Re: Ignite 2.10 error - java.net.SocketException: Software caused connection abort: socket write error

2024-10-09 Thread Stephen Darlington
t happening? for other client nodes which are there in the > same network. > > Regards, > > > On Tue, 8 Oct 2024 at 18:22, Stephen Darlington > wrote: > >> It's likely something to do with your network configuration. Firewall, >> routing, something like that. B

Re: Ignite 2.10 error - java.net.SocketException: Software caused connection abort: socket write error

2024-10-08 Thread Stephen Darlington
It's likely something to do with your network configuration. Firewall, routing, something like that. Basically, Ignite tried to write to a port and the OS wouldn't allow it. On Mon, 7 Oct 2024 at 12:55, Charlin S wrote: > Hi All, > I am having a requirement to start/add a new Ignite client node

Re: Rolling Update

2024-09-13 Thread Stephen Darlington
The baseline topology is still A Thing with memory--only clusters. The difference is that auto-adjust is enabled by default. But yes, in short you don't need to worry about the baseline if you don't use native persistence. On Thu, 12 Sept 2024 at 21:21, Humphrey wrote: > And about baseline topol

Re: Query regarding Apache ignite open source

2024-08-20 Thread Stephen Darlington
Ignite has the Apache 2.0 Licence ( https://github.com/apache/ignite/blob/master/LICENSE) which is an approved "open source" licence (https://opensource.org/license/apache-2-0). There are distributions of Ignite with more restrictive licences, and they may have additional features or different rel

Re: Ignite 2.16 entry processors sometimes execute twice

2024-07-10 Thread Stephen Darlington
Do you see the same behaviour with older versions of Ignite, or is this unique to 2.16? On Tue, 9 Jul 2024 at 21:34, Raymond Liu wrote: > Hi all, > > We're encountering an issue where entry processors execute twice. > Executing twice is a problem for us because, for easier optimization, we > wou

Re: Will Apache Ignite 3.0 be compliant with JSR107 sepc?

2024-06-04 Thread Stephen Darlington
The way that clients operate is quite different in AI3. You can't assume the same thick/thin distinction. There are two answers to your question: 1. Ignite 2 will continue to be available. Version 3 is a big update and it's unlikely that everyone will move over on day 1. So if you like AI2, it's

Re: Possible too long JVM pause - Ignite 2.10

2024-05-09 Thread Stephen Darlington
That's a great article, Ibrahim. Thanks for sharing! On Thu, 9 May 2024 at 18:00, Ibrahim Altun wrote: > Try this post > > https://medium.com/segmentify-tech/garbage-collection-g1gc-optimisation-on-apache-ignite-7217f2d9186e > > > İbrahim Halil AltunExpert R&D Develo

Re: Possible too long JVM pause - Ignite 2.10

2024-05-09 Thread Stephen Darlington
The documentation has some good suggestions: https://ignite.apache.org/docs/latest/perf-and-troubleshooting/memory-tuning#java-heap-and-gc-tuning On Thu, 9 May 2024 at 07:31, Charlin S wrote: > Hi All, > > I am getting Possible too long JVM pause: 6403 milliseconds. JVM options > used as below >

Re: ignitevisorcmd tool - alternate option

2024-04-22 Thread Stephen Darlington
tting with the following: >> >> ./control.sh —system-view CACHES > output.txt >> >> Then view output.txt with the any editor, disable wrap lines option. >> >> >> >> > 15 апр. 2024 г., в 19:25, Stephen Darlington >> написал(а): >> > >

Re: ignitevisorcmd tool - alternate option

2024-04-15 Thread Stephen Darlington
What tool are you using? If you're using sqlline, you could do "!set output vertical" or only select the columns you're interested in. On Mon, 15 Apr 2024 at 17:09, Charlin S wrote: > Hello Nizhikov, > Thanks for your email, able to get a list of caches like list . but the > result format is no

Re: Cache put event new value type

2024-04-12 Thread Stephen Darlington
You can always convert it back into a POJO using the deserialize method: var y = x.deserialize(); On Thu, 11 Apr 2024 at 19:09, Victor wrote: > Hi > > In Ignite 2.16, I seeing that newVal method of cache event returns a > BinaryObjectImpl. Is it possible to make it return actual user-defined >

Re: Failed to send TTL update request - Ignite 2.10

2024-04-03 Thread Stephen Darlington
Just a reminder that this list is run by volunteers, so we can't guarantee a response in a given time. Commercial options are available if you need that. As for your question: is this the problem? https://issues.apache.org/jira/browse/IGNITE-16118 On Wed, 3 Apr 2024 at 14:00, Charlin S wrote: >

Re: Turning off deadlock detection

2024-03-25 Thread Stephen Darlington
Just a reminder that this list is run by volunteers. If you need responses in a given time, commercial options are available. On Sat, 23 Mar 2024 at 17:50, Ronak Shah wrote: > Ping again. Can someone answer please? - Ronak > > On Mon, Mar 18, 2024 at 12:04 PM Ronak Shah > wrote: > >> Hi Ignite

Re: Performance Issue at Ignite Level

2024-03-11 Thread Stephen Darlington
+ user mailing list - developer mailing list This question would be better addressed to the user mailing list. There are a number of causes of "long JVM pauses,” so it’s difficult to be prescriptive. I’d start by logging more information about Java’s garbage collection. More information in the

Re: Control center open source

2024-02-29 Thread Stephen Darlington
You would need to test it to find out. On Thu, 29 Feb 2024 at 12:03, Dinakar Devineni wrote: > Does that even work with the newer versions of ignite? > > > > *From: *Stephen Darlington > *Sent: *Thursday, February 29, 2024 4:45 AM > *To: *user@ignite.apache.org >

Re:

2024-02-29 Thread Stephen Darlington
You can add a filter to your log exporter, so that only the metrics you're interested in are shared. "Expensive" might be the wrong word to explain the overhead in enabling metrics. Enabling metrics does use more resources than not, but it's usually worth it. In general, you can't put a system int

Re: Control center open source

2024-02-29 Thread Stephen Darlington
The community used to maintain Web Console. You might be able to get that running again? On Thu, 29 Feb 2024 at 04:08, Dinakar Devineni wrote: > Hi , > > Is there ant grid gain control center open source alternative. > Is there any other community project? > > Thanks > Dina >

Re: Performance

2024-02-29 Thread Stephen Darlington
There's not much overhead simply by enabling SQL, but there's obviously a cost to maintaining any indexes you create. Normally the cost of maintaining those indexes is more than offset by improvements in query performance. But the only real way to tell for your use case is to benchmark it. On Wed,

Re: Data loss in an Ignite application

2024-02-26 Thread Stephen Darlington
ir I decided to check all the components of the > application including Ignite. The good thing is that now I have better > knowledge of how to troubleshoot issues like this. > > My best, > Alex Avrutin > > > On Fri, Feb 23, 2024 at 10:38 AM Stephen Darlington < > sdarli

Re: Data loss in an Ignite application

2024-02-23 Thread Stephen Darlington
Is there a pattern to the lost records? Is it old records? Records for a particular customer? Records stored on a specific node or partition? On Thu, 22 Feb 2024 at 21:14, Aleksej Avrutin wrote: > Jeremy, > > Thank you for the response. I reviewed cache properties using GG Control > Center and t

Re: Question about REST/C++ client

2024-02-19 Thread Stephen Darlington
your answers Igor and Stephen. > Igor, to answer your question to the second point I used the same term as > used in the Rest API, but indeed it more or less what you said (even if > in this API we do not have to retrieve explicitely the base value). > Best regards, > Louis >

Re: Question about REST/C++ client

2024-02-13 Thread Stephen Darlington
The easy answer to the "50 gets in parallel" is to use GetAll. On Tue, 13 Feb 2024 at 09:54, Igor Sapego wrote: > 1. There is no such API. Seems like a weird error in documentation. We > will fix it. If you want to make 50 gets in parallel, I think it's better > to run 50 clients with the curren

Re: ignite + external database

2024-02-07 Thread Stephen Darlington
ude you please give the link to the documentation > > > > 5. Ignite seems to have to know which partitions are lost, and in theory > it doesn’t cost him anything to place these partitions on the remaining > nodes (rebalancing) and execute the loadCache for lost partitions. > > >

Re: ignite + external database

2024-02-06 Thread Stephen Darlington
1. With a memory-only cluster, Ignite does not store any persistent information. You'd need to save your table definitions somewhere yourself 2. If it saved data, it would be a database rather than an in-memory data grid! You can, actually, enable persistence and connect to a third-p

Re: Regarding client and server side metrics

2024-02-06 Thread Stephen Darlington
Most of the metrics are about the node you're talking about rather than the cluster as a whole. When you're talking about a distributed system, is a "get" a client or a server operation? A bit of both, right? On Mon, 29 Jan 2024 at 14:05, Godfather wrote: > Hi Community , > I have configured my

Re: Regarding Backup activity between ignite nodes

2024-01-23 Thread Stephen Darlington
Most of your questions are answered in the documentation: https://ignite.apache.org/docs/latest/configuring-caches/configuring-backups On Tue, 23 Jan 2024 at 10:52, Patil, Yashodhan wrote: > > > Hi All, > > > We have our application configured with ignite(2.16) in client mode which > allows us t

Re: Apache ignite 2.16

2024-01-22 Thread Stephen Darlington
process of being released. On Mon, 22 Jan 2024 at 16:35, Angelo Immediata wrote: > in my case i'm concerned to > https://nvd.nist.gov/vuln/detail/CVE-2024-20932 > > Il giorno lun 22 gen 2024 alle ore 16:11 Stephen Darlington < > sdarling...@apache.org> ha scritto: > &g

Re: Apache ignite 2.16

2024-01-22 Thread Stephen Darlington
What vulnerability is fixed in Java 21 but not 17? On Mon, 22 Jan 2024 at 14:30, Angelo Immediata wrote: > hello Stephen Darlington > Any news about ignite-ml-ext maven dependency? > For security reason we upgraded to the openJDK 21 but ignite master node > (version 2.15) failed to

Re: Regadring metrics export through jmx exporter

2024-01-18 Thread Stephen Darlington
e any other > workaround for this issue ? > > On Wed, Jan 17, 2024 at 3:23 PM Stephen Darlington > wrote: > >> I think the preference would be to use the OpenCensus exporter when using >> Prometheus, but the JMX converter should work. Do you have a lot of caches? >>

Re: Long-Term Java 8 support / Ignite 3 roadmap

2024-01-18 Thread Stephen Darlington
ext couple of years at least. > > > > *From:* Stephen Darlington > *Sent:* Wednesday, January 17, 2024 4:48 AM > *To:* user@ignite.apache.org > *Subject:* [EXTERNAL] Re: Long-Term Java 8 support / Ignite 3 roadmap > > > > Max, are you worried that Ignite will or won&#

Re: Regadring metrics export through jmx exporter

2024-01-17 Thread Stephen Darlington
I think the preference would be to use the OpenCensus exporter when using Prometheus, but the JMX converter should work. Do you have a lot of caches? I've seen lengthy "scrapes" when there are large numbers of caches. On Wed, 17 Jan 2024 at 05:14, Godfather wrote: > Hello Community , > I recentl

Re: Long-Term Java 8 support / Ignite 3 roadmap

2024-01-17 Thread Stephen Darlington
Max, are you worried that Ignite will or won't drop Java 8 support? On Tue, 16 Jan 2024 at 17:39, Roman Puchkovskiy wrote: > Hi Max. > > I'm working at GridGain, so I think the best thing I could do to help > you is to suggest contacting GridGain representatives, but you already > did it. > > вт

Re: Apache ignite 2.16

2024-01-11 Thread Stephen Darlington
Yes and no. As per the release notes, "The ignite-ml and cassandra modules have been migrated to the Ignite extensions." This means that you'll need to add the "ignite-ml-ext" dependency (rather than "ignite-ml"). However, it appears that the new module has not yet been released. In short, there wi

Re: Info about time series support

2024-01-05 Thread Stephen Darlington
Normally we recommend using thin-clients if you can. Though, in this case, using a thick-client makes your life easier. Thick clients can deploy Java code for you. There are a few different ways to do it. The "easy" option is to just deploy the JAR files to the server nodes "manually." You could a

Re: Extend DefaultReplicationPolicy for MirrorSourceConnector / MirrorMaker

2023-12-11 Thread Stephen Darlington
Hi, this is the user mailing list for the Apache Ignite project. This page shows the various Kafka email lists: https://kafka.apache.org/contact.html Regards, Stephen On Mon, 11 Dec 2023 at 15:11, astronaut37 wrote: > Hi Guys, > we have an already running Kakfa Connector Cluster. > I want to ad

Re: RE: Uneven offheap memory distribution among cluster server nodes

2023-12-04 Thread Stephen Darlington
There's a really nice blog on why this is the correct advice: https://www.gridgain.com/resources/blog/data-distribution-in-apache-ignite "To achieve optimal key and partition distribution across nodes, it is important to ensure that the number of partitions is significantly greater than the number

Re: Local node SEGMENTED help with logs

2023-11-08 Thread Stephen Darlington
The most common cause of a segmented cluster is not the network but your Java garbage collection configuration. Do you see any "Long JVM pause" warnings in your logs before the problem occurs? On Wed, 8 Nov 2023 at 08:48, Alan Rose wrote: > > I am hoping someone can help me understand some log e

Re: Why wpuld a client node error cause server node to shut off?

2023-11-01 Thread Stephen Darlington
it needs to try to force some huge > garbage collection. > > What 'i'm asking based on the config and stats I gave do you see anything > that sticks out in those configs not the logs? > > On Tue, Oct 31, 2023 at 10:42 AM Stephen Darlington < > sdarling...@apache.or

Re: Why wpuld a client node error cause server node to shut off?

2023-10-31 Thread Stephen Darlington
] ; then > JVM_OPTS="-Xms8g -Xmx8g -server -XX:MaxMetaspaceSize=256m" > fi > > # > # Uncomment the following GC settings if you see spikes in your throughput > due to Garbage Collection. > # > # JVM_OPTS="$JVM_OPTS -XX:+UseG1GC" > JVM_OPTS="$JVM_OPTS -XX:+AlwaysPreTouch -XX:+UseG1G

Re: Why wpuld a client node error cause server node to shut off?

2023-10-31 Thread Stephen Darlington
There's a lot going on in that log file. It makes it difficult to tell what *the* issue is. You have lots of nodes leaving (and joining) the cluster, including server nodes. You have lost partitions and long JVM pauses. I suspect the real cause of this node shutting down was that it became segmente

Re: Why wpuld a client node error cause server node to shut off?

2023-10-30 Thread Stephen Darlington
It wouldn't. We'd need to see more of the logs to determine what the problem was. On Mon, 30 Oct 2023 at 15:12, John Smith wrote: > Hi I see this error message on the server node... > > [21:37:20,310][SEVERE][query-#2884155%raange%][GridMapQueryExecutor] > Failed to send message. > class org.apa

Re: Re: Parallel execution CreateTable

2023-10-17 Thread Stephen Darlington
node log has many ‘Thread - WAITING’. That's not > normal, right? > > > > At 2023-10-17 15:19:33, "Stephen Darlington" > wrote: > > Can you share some more information about your cluster? There is no way > that creating a cache should take so long. > > On T

Re: Parallel execution CreateTable

2023-10-17 Thread Stephen Darlington
Can you share some more information about your cluster? There is no way that creating a cache should take so long. On Tue, 17 Oct 2023 at 03:51, y wrote: > Hello. > Everyone! > > Creating table statements is executed synchronously and will block other > DDL statements. There are serious perfo

Re: Different sizes of the same dataregion across multiple nodes?

2023-10-09 Thread Stephen Darlington
Yes. It's not a good idea in general, but as a temporary measure while upgrading it's not a problem. On Mon, 9 Oct 2023 at 09:08, kimec.ethome.sk wrote: > Hello, > > is it possible to configure different size of the same dataregion across > multiple nodes? We need to increase the region size in

Re: Ignite 2.12.0 Thick Client node filter issue

2023-10-05 Thread Stephen Darlington
Can you share your service configuration? The default node filter will only deploy services on server nodes. On Thu, 5 Oct 2023 at 15:03, Greg Sylvain wrote: > > This does not happen with thin clients. > > I switched our Ignite 2.12.0 service cluster to using Thick clients > instead of Thin as a

Re: Question about JDBC polymorphism

2023-09-06 Thread Stephen Darlington
The most straightforward answer might just be to create views in your source database. Out of the box, the cache store is really designed for a 1:1 mapping between table and cache. You *can* do more complex mappings, but it may require coding. On Wed, 6 Sept 2023 at 09:46, Bram Biesbrouck < bram.b

Re: Basic cache statistics for Ignite clusters deployed on Kubernetes

2023-09-06 Thread Stephen Darlington
A good place to start would be the monitoring section of the documentation: https://ignite.apache.org/docs/latest/monitoring-metrics/intro You can use JMX, OpenCensus, some of the system views; deploying on Kubernetes doesn't change any of that. Control.sh, as you suggest, can be used for *ad hoc

Re: An issue about the expiration time of item level cache

2023-08-31 Thread Stephen Darlington
In practice, I've not seen a use case where retrieving the TTL is required. Depending on what you want to do, there are likely to be workarounds. Regards, Stephen On Thu, 31 Aug 2023 at 01:51, Mengyu Jing wrote: > Hi, Stephen Darlington > > > > I don't have any use

Re: An issue about the expiration time of item level cache

2023-08-29 Thread Stephen Darlington
There is a ticket for this (https://issues.apache.org/jira/browse/IGNITE-7641) but there is currently no API. What’s your use case? > On 29 Aug 2023, at 13:20, Mengyu Jing wrote: > > Hi, igniters: > > I would like to ask some questions about Ignite. Is there a ready-made method > for Ignit

Re: Recomendations on stack config

2023-08-21 Thread Stephen Darlington
First, Calcite support is still considered beta-quality, so that might be a factor. However, more likely is your memory usage. A query like this would need a lot of Java heap space, so you would need to tune your garbage collector. > On 9 Aug 2023, at 15:48, Maxim Baglay wrote: > > Hi, > Expe

Re: Ignite Off Heap memory keeps growing

2023-08-04 Thread Stephen Darlington
There is no such thing as an on-heap-only cache. If you store data in Ignite, it’s off-heap. On-heap caches, if enabled, are in addition to the off-heap cache, a cache of a cache. Most use cases do not benefit from having an on-heap cache. > On 4 Aug 2023, at 03:06, Dinakar Devineni wrote: >

Re: Read Write through cache

2023-07-19 Thread Stephen Darlington
rds > > On Wed, 19 Jul, 2023, 2:14 pm Stephen Darlington, > mailto:stephen.darling...@gridgain.com>> > wrote: >> A more common approach would be that Ignite has all your data and Spark has >> a subset. Ignite SQL is generally faster than Spark SQL, since it can use >

Re: Read Write through cache

2023-07-19 Thread Stephen Darlington
On Tue, 18 Jul, 2023, 10:43 pm Stephen Darlington, > mailto:stephen.darling...@gridgain.com>> > wrote: >> Write through works regardless of how you insert data into Ignite. >> >> I’m not clear what you mean by federated query. Are the records in Spark a >> subs

Re: Ignite SQL

2023-07-19 Thread Stephen Darlington
y Ignite I want to write an Sql query to perform the same. > > Does option 1 still hold good? > > On Tue, 18 Jul, 2023, 10:40 pm Stephen Darlington, > mailto:stephen.darling...@gridgain.com>> > wrote: >> “Correct” is hard to quantify without knowing your use case, b

Re: Read Write through cache

2023-07-18 Thread Stephen Darlington
Write through works regardless of how you insert data into Ignite. I’m not clear what you mean by federated query. Are the records in Spark a subset of those in the cache? Assuming not, create a data frame with a SQL query against Ignite. Create a data frame with a SQL query against your Spark

Re: Ignite SQL

2023-07-18 Thread Stephen Darlington
“Correct” is hard to quantify without knowing your use case, but option 1 is probably what you want. Spark pushes down SQL execution to Ignite, so you get all the distribution, use of indexes, etc. > On 14 Jul 2023, at 16:12, Arunima Barik wrote: > > Hello team > > What is the correct way ou

Re: OOM

2023-07-12 Thread Stephen Darlington
https://ignite.apache.org/docs/latest/perf-and-troubleshooting/memory-tuning#java-heap-and-gc-tuning > On 12 Jul 2023, at 17:29, Arunima Barik wrote: > > java.lang.OutOfMemory > > On Wed, 12 Jul, 2023, 8:54 pm Stephen Darlington, > mailto:stephen.darling...@gridgain.com>

Re: OOM

2023-07-12 Thread Stephen Darlington
Is it java.lang.OutOfMemoryException or an IgniteOutOfMemoryException? > On 12 Jul 2023, at 16:19, Arunima Barik wrote: > > I have enabled Page eviction to Random-2-LRU for default region > > Still whenever I write a big Spark DataFrame to Ignite > Like spark_df.write.format("ignite") > It is

Re: Increase in chattiness among server Ignite nodes after upgrade from 2.8 to 2.14

2023-07-10 Thread Stephen Darlington
How are you defining “chatty”? > On 10 Jul 2023, at 13:33, kimec.ethome.sk wrote: > > Greetings, > > we have recently upgraded Ignite server nodes from 2.8 to 2.14 and we see a > ten fold increase in cluster chattiness. > Since 2.8 was quite old, I assume there may have been some announcement

Re: Concurrently update some keys

2023-07-05 Thread Stephen Darlington
ey-value API. >>>>>>> >>>>>>> [1] https://ignite.apache.org/docs/latest/sql-reference/transactions >>>>>>> [2] https://ignite.apache.org/docs/latest/transactions/mvcc >>>>>>> [3] https://ignite.apache.org/docs/

Re: Starting Ignite Nodes

2023-07-04 Thread Stephen Darlington
You probably don’t want an Ignite server node on each of your Spark workers. When you connect to Ignite in your Spark code, it will automatically start up an Ignite thick-client node. > On 3 Jul 2023, at 19:24, Arunima Barik wrote: > > Great > Thanks for the suggestion > > On Mon, 3 Jul, 2023

Re: Ignite for Parquet files

2023-07-04 Thread Stephen Darlington
ame as df > > I want to write some part of this data to ignite cache > > Assume I want to write df2 to the cache > > I used df2.write.format('ignite') > Is there a better way to do this or this is the only way?? > > Regards > Arunima >

Re: Ignite for Parquet files

2023-07-04 Thread Stephen Darlington
there a better way to do this or this is the only way?? >> >> Regards >> Arunima >> >> On Mon, 3 Jul, 2023, 1:19 pm Stephen Darlington, >> mailto:stephen.darling...@gridgain.com>> >> wrote: >>> Commercial options are availa

Re: Ignite Cache - Eviction policy

2023-07-03 Thread Stephen Darlington
https://ignite.apache.org/docs/2.11.1/memory-configuration/eviction-policies > On 3 Jul 2023, at 13:38, Arunima Barik wrote: > > I am reading a parquet file using spark into ignite > > 1. For every sql query, suppose I write a part of the data to the ignite cache > In this manner, the cache fil

Re: Kafka > Ignite via Kafka Connect

2023-07-03 Thread Stephen Darlington
Can you include the stack trace rather than a screenshot? We can’t see which class appears to be missing. > On 2 Jul 2023, at 17:04, Tama MA wrote: > > Hi Ignite community, > > Per instructed by Ignite documentation (Streaming Data via Kafka Connect) > https://ignite.apache.org/docs/latest/ext

Re: Apache Ignite Cache layer

2023-07-03 Thread Stephen Darlington
A quick search came up with this: https://www.arm64.ca/post/reading-parquet-files-java/ Data is generally bulk loaded in the loadCache implementation. Which data is loaded would depend on your implementation. > On 1 Jul 2023, at 13:11, Arunima Barik wrote: > > Hello Team > > I wish to create

Re: Ignite for Parquet files

2023-07-03 Thread Stephen Darlington
3 PM Arunima Barik > <mailto:arunimabari...@gmail.com>> wrote: >>> Which do you think would be a better option? >>> >>> Federated queries or CacheStore >>> >>> And is CacheStore supported in Python? >>> >>> On Fri, 30 Jun

Re: SetLoacl is not work for Calcite

2023-06-30 Thread Stephen Darlington
nsidering the feasibility of your > proposed solution. For complex business production environments, it is > difficult to distinguish whether the query requires setLocal or not. Anyway, > thank you for your help. > > > > > At 2023-06-30 15:18:07, "Stephen Dar

Re: Ignite for Parquet files

2023-06-30 Thread Stephen Darlington
You’d need to implement your own Cache Store. https://ignite.apache.org/docs/latest/persistence/custom-cache-store > On 30 Jun 2023, at 06:46, Arunima Barik wrote: > > > -- Forwarded message - > From: Arunima Barik > > Date: Fri, 30 Jun, 2023,

Re: SetLoacl is not work for Calcite

2023-06-30 Thread Stephen Darlington
If this is an important feature for you, the obvious solution would be to use the H2 SQL engine (which is still the default, since the Calcite engine is still considered beta). As noted in the documentation, you can even keep Calcite as the default engine in your cluster and only route these qu

Re: failureDetectionTimeout Timeout Issues

2023-06-20 Thread Stephen Darlington
C > > On Mon, 19 Jun 2023 at 21:23, Stephen Darlington > mailto:stephen.darling...@gridgain.com>> > wrote: >> Well, is it a garbage collection pause or is it a network glitch? The >> solutions for each are different. >> >> > On 19 Jun 2023, at 09:27

Re: failureDetectionTimeout Timeout Issues

2023-06-19 Thread Stephen Darlington
Well, is it a garbage collection pause or is it a network glitch? The solutions for each are different. > On 19 Jun 2023, at 09:27, Alan Rose wrote: > > We have been experiencing timeout lately possibly due to GC (or network) on > our Lynx pods. Our timeouts are at the standard default values

Re: How communication happens when using Multicast + Static IP finder

2023-06-19 Thread Stephen Darlington
Multicast is only used for node discovery. If you update a cache, run a SQL query or execute a compute task, that uses the “communications SPI” which is a direct TCP connection between nodes. > On 18 Jun 2023, at 15:24, Vikas Vishwakarma wrote: > > Hi All, > > I was wondering when using Multi

Re: Ignite compression not working on windows

2023-06-19 Thread Stephen Darlington
I would believe the error message. It’s pretty clear and explicit. Maybe you can leave some feedback on the documentation (there’s a button on the bottom right of each page). > On 19 Jun 2023, at 09:32, Rohan Sharma via user > wrote: > > I am trying to user apache ignite disk compression on w

Re: .NET Ignite server nodes not joining cluster using TcpDiscoveryStaticIpFinder

2023-05-09 Thread Stephen Darlington
Just a reminder that this is a community forum. People are very generous with their time, but it’s not fair to expect immediate responses to your questions. > On 9 May 2023, at 06:18, satyajit.mandal.barclays.com via user > wrote: > > Hi Team, > > Issue is fixed. There was issue with

Re: Failed to parse query SQL table not found issue

2023-04-26 Thread Stephen Darlington
gt; >>> that. >> >>> >> >>> But I am facing a different issue in meantime on my microservice which >> >>> have following setup : >> >>> >> >>> I have set up a kubernetes pod cluster where I have started 3 ignite >

Re: Failed to parse query SQL table not found issue

2023-04-20 Thread Stephen Darlington
In sqlline, you can type “!tables” (no quotes) to list all the tables. In general, the schema is the cache name and the table is the value type name, so you would need to write "select * from CACHE_NAME.HbaseTableType". > On 20 Apr 2023, at 06:38, Abhishek Ubhe wrote: > > Hello, > > I am faci

Re: JVM pause on Ignite kernal

2023-04-17 Thread Stephen Darlington
It means that no Ignite code is being executed for that time. It’s not possible to say exactly why this was the case, but the most common cause is incorrect Java garbage collection configuration. See the documentation for more details: https://ignite.apache.org/docs/latest/perf-and-troubleshooti

Re: Ignite: Failed to process failed message: java.lang.NullPointerException

2023-04-04 Thread Stephen Darlington
If you have a problem with GridGain, you should ask them for support. Please let us know if you can reproduce in a recent version of Ignite. > On 4 Apr 2023, at 03:10, 周倩 wrote: > > Hi, > I have a question while using gridgain 8.8.9. > Problem scenario: The Ignite server of a node. Start a stan

Re: Key1 equals Key2 but not found in cache

2023-03-22 Thread Stephen Darlington
You can make any column visible in SQL. > On 22 Mar 2023, at 15:34, Humphrey Lopez wrote: > > Can we query the keys as well? Adding QuerySqlField? I think this only > applies to the values right? > > Op wo 22 mrt 2023 om 16:08 schreef Stephen Darlington > m

Re: Key1 equals Key2 but not found in cache

2023-03-22 Thread Stephen Darlington
gt;>>> >>>> Humphrey >>>> >>>> Op wo 22 mrt 2023 om 14:37 schreef Humphrey Lopez >>> <mailto:hmmlo...@gmail.com>>: >>>>> Thanks for clarifying that. Is there a way to mark a property/field to be >>>>>

Re: Key1 equals Key2 but not found in cache

2023-03-22 Thread Stephen Darlington
Ignite doesn’t use your equals or hashCode implementation. Data is stored as a BinaryObject, and it’s that that is compared for equality. > On 22 Mar 2023, at 12:14, Humphrey Lopez wrote: > > They are in the example only checking the first field when overriding the > equals. And hashCode alway

Re: Regarding error : TcpCommunicationSpi - Failed to send message to remote node

2023-03-21 Thread Stephen Darlington
A communication problem happens between nodes, so it’s difficult to say what the problem is when we only see one side of the story. Having said that, you either have a networking issue or one of your nodes is seeing long JVM pauses. A long JVM pause means that Ignite code isn’t running, resulti

Re: pyignite - performance issue

2023-03-14 Thread Stephen Darlington
Macs don’t have epoll, so it doesn’t compile currently. > On 14 Mar 2023, at 16:02, Igor Sapego wrote: > > Unfortunately, we do not have Mac agents, so we can not detect when > compilation on Mac OS is broken, so yeah... > > Best Regards, > Igor > > > On Tue, Mar 14, 2023 at 2:48 PM Ivan Das

Re: Ignite Cluster issues with larger latency between nodes

2023-03-13 Thread Stephen Darlington
Firstly, Ignite isn’t a product in the same way that Coherence is. It’s a community driven project. If you’d like commercial support there are options available. Deploying Ignite across availability zones is pretty common, and single digit round-trip latency between zones is on the high side of

Re: Does peer class loading have to be enabled on both server and client node?

2023-03-02 Thread Stephen Darlington
>> wrote: >>> Oh god! Forget that then! lol Really? So If I have 10 applications they all >>> need to be recompiled/reconfigured and redeployed? >>> >>> On Mon, Feb 27, 2023 at 11:07 AM Stephen Darlington >>> mailto:stephen.darling...@gridgain.com&g

Re: Performance of data stream on 3 cluster node.

2023-03-02 Thread Stephen Darlington
they are all unique... I'll check with the > command... > > On Wed., Mar. 1, 2023, 11:20 a.m. Stephen Darlington, > mailto:stephen.darling...@gridgain.com>> > wrote: >> The streamer doesn’t determine where the data goes. It just efficiently >> sends it to th

Re: Storage Exception using Ignite

2023-03-02 Thread Stephen Darlington
This is a community forum. If you need support with SLAs there are commercial options available. I think you’ll need to share more of your stack trace for someone to determine what the issue is. > On 2 Mar 2023, at 08:47, satyajit.mandal.barclays.com via user > wrote: > > Hi team, > > Any

Re: Performance of data stream on 3 cluster node.

2023-03-01 Thread Stephen Darlington
also get better distribution with more than three nodes. > On 1 Mar 2023, at 15:45, John Smith wrote: > > Ok thanks. I just thought the streamer would be more uniform. > > On Wed, Mar 1, 2023 at 4:41 AM Stephen Darlington > mailto:stephen.darling...@gridgain.com>> >

Re: Performance of data stream on 3 cluster node.

2023-03-01 Thread Stephen Darlington
You might want to check the data distribution. You can use control.sh —cache distribution to do that. > On 28 Feb 2023, at 20:32, John Smith wrote: > > The last thing I can add to clarify is, the 3 node cluster is a centralized > cluster and the CSV loader is a thick client running on its own

Re: Does peer class loading have to be enabled on both server and client node?

2023-02-27 Thread Stephen Darlington
It’s a cluster wide setting and needs to be set to the same value on all nodes, both server and thick-client. > On 27 Feb 2023, at 15:58, John Smith wrote: > > I have 3 node clusters and I'm trying to enable peer class loading on the > cluster, but it keeps shutting off after restart because i

Re: How to avoid "all partition owners have left the grid" or handle automatically.

2023-02-21 Thread Stephen Darlington
> > > > > On Mon., Feb. 20, 2023, 7:03 a.m. Stephen Darlington, > mailto:stephen.darling...@gridgain.com>> > wrote: >> How are your caches configured? If they have at least one backup, you should >> be able to restart one node at a time without

Re: How to avoid "all partition owners have left the grid" or handle automatically.

2023-02-20 Thread Stephen Darlington
How are your caches configured? If they have at least one backup, you should be able to restart one node at a time without data loss. There is no automated way to reset lost partitions. Nor should there be (IMHO). If you have lost partitions, you have probably lost data. That should require man

Re: Get TotalServerNodes using controlscript/Rest Api

2023-02-01 Thread Stephen Darlington
trol-script#system-view-command > [3] > https://ignite.apache.org/docs/2.11.1/monitoring-metrics/new-metrics#cluster > > >> 1 февр. 2023 г., в 13:28, Stephen Darlington >> написал(а): >> >> I’m not aware of any single command to do it, but there are a fe

Re: Get TotalServerNodes using controlscript/Rest Api

2023-02-01 Thread Stephen Darlington
I’m not aware of any single command to do it, but there are a few options. I’ll list a few as they’re all imperfect. There are some command-line JMX reader commands you could use to extract the information from Ignite’s metrics. You could extract the information from the REST API. I needed to u

Re: Safe settings for ignite cache with external store

2023-01-31 Thread Stephen Darlington
uration pre/post-processing which went under radar > till today. It was really specific to test application itself, not Ignite. I > thank you for feedback, pointers and assistance! > > Kind regards, > Łukasz > > On 30.01.2023 12:51, Stephen Darlington wrote: >> I’m not

Re: Safe settings for ignite cache with external store

2023-01-30 Thread Stephen Darlington
filling in memory > managed by Ignite due to lack of clear eviction policy during peak load. > As far I can understand from DataRegionConfiguration, its eviction mechanism > works for whole pages, but I haven't seen this happening. Could it be due to > fact that single cache entry in

Re: Safe settings for ignite cache with external store

2023-01-30 Thread Stephen Darlington
Ignite is designed to work as a cluster with a lot of memory. A single node with 512Mb of memory just isn’t what most people are testing with. I’ve seen similar issues when people use tiny nodes. I don’t see anything immediately wrong with your configuration, but if it works with more memory, th

  1   2   3   4   5   >