Re: Traditional RDBMS PARTITION concept on Ignite

2022-07-20 Thread Denis Magda
Hey folks, let me chime in to clarify the matters. What Wen Bo and Mengliao are really asking for is a combination of two features "partitioning + sharding". In the relational world (Postgres, MySQL, Oracle) partitioning is used to split a large table into smaller tables (called partitions). For

Re: [COMMUNITY] Apache Ignite Community Recap and Celebration of Project Evangelists

2021-12-22 Thread Denis Magda
gt; That’s what we as a community did in 2021. Impressive, isn’t it? > > Now, I’ll list 2021’s 10 most active non-code contributors, all of whom > contributed to spreading the word about Ignite: > > Val Kulichenko > Denis Magda > Alexander Kozhenkov > Stephen Darlington >

Re: Real-world use cases: Ignite and High-Performance Computing

2021-12-03 Thread Denis Magda
n Thu, Dec 2, 2021 at 11:52 PM Denis Magda wrote: > >> Folks, >> >> I've just published an article that lists some real-world use cases of >> Ignite for high-performance computing. Some of you might be interested in >> how the compute APIs are leveraged in practice:

Real-world use cases: Ignite and High-Performance Computing

2021-12-02 Thread Denis Magda
Folks, I've just published an article that lists some real-world use cases of Ignite for high-performance computing. Some of you might be interested in how the compute APIs are leveraged in practice:

Re: Re client node connects to server nodes behind NAT

2021-11-16 Thread Denis Magda
Hi Ma, Streaming is supported for the thin clients (see a related discussion on the user list). As for the peer-class-loading support, not sure that it's coming. As an alternative, you can implement the UriDeploymentSpi interface that will load/reload code from your custom location/repository:

Re: protocol of streaming

2021-11-16 Thread Denis Magda
Nikita, Igor, looping you in... Do we folks have tickets for this documentation update? - Denis On Tue, Nov 16, 2021 at 6:11 AM Pavel Tupitsyn wrote: > Hello Timothy, > > Thin client protocol supports streaming [1], > the documentation just was not updated yet. > > [1] >

Re: test

2021-11-10 Thread Denis Magda
Test Passed - Denis On Wed, Nov 10, 2021 at 7:12 AM Veena Mithare wrote: > > -- > > > Spread bets and CFDs are complex instruments and come with a high risk of > losing money rapidly due to leverage. *66% of retail investor accounts > lose money when spread betting

Re: [Ignite Summit: Cloud Edition] The full schedule is published

2021-10-20 Thread Denis Magda
Btw, check out this 3 minute-long video produced by Kevin that does a great overview of the upcoming event: https://www.youtube.com/watch?v=5Oas92pBSPM - Denis On Wed, Oct 20, 2021 at 2:11 PM Kseniya Romanova wrote: > Hi Igniters! > > The Ignite Summit: Cloud Edition schedule is live on

Ignite Momentum: Recap of 2020-2021

2021-09-14 Thread Denis Magda
Igniters, I've contributed an article listing what we, as a community, achieved together in 2020-2021: https://blogs.apache.org/ignite/entry/apache-ignite-momentum-highlights-from Apologize if I forgot to mention anything else. My goal was to share the project highlights after ASF mentioned us

Fwd: Celebrating ASF's success: FY2021 Annual Report

2021-08-31 Thread Denis Magda
Igniters, I've looked into a full report that is available under this address: https://www.apache.org/foundation/docs/FY2021AnnualReport.pdf And compiled Ignite-specific achievements: https://docs.google.com/document/d/1xZ2cfH_YiuNrf8-YSIsupGU3eU9qovhrfdF0etPhp3c/edit Ignite keeps growing and

Re: Ignite High memory usage though very less disk size

2021-08-02 Thread Denis Magda
To easily collect what Zhenya is asking for and expedite the troubleshooting, you can do a simple monitoring set up: https://www.gridgain.com/docs/tutorials/management-monitoring/ignite-storage-monitoring - Denis On Fri, Jul 30, 2021 at 2:32 PM Zhenya Stanilovsky wrote: > hi, Devakumar J >

Re: Defrag?

2021-06-24 Thread Denis Magda
Ignite fellows, I remember some of us worked on the persistence defragmentation features. Has it been merged? @Valentin Kulichenko probably you know the latest state. - Denis On Thu, Jun 24, 2021 at 11:59 AM Ilya Kasnacheev wrote: > Hello! > > You can probably drop the entire cache and then

Re: [ANNOUNCE] Apache Ignite 2.10.0 Released

2021-03-18 Thread Denis Magda
Excellent, thanks Maxim for driving the release! As for the product definition (in-memory platform vs. distributed database), just copy the positioning we use on the landing page (Distributed Database For High-Performance Computing With In-Memory Speed) - Denis On Thu, Mar 18, 2021 at 6:31 AM

Re: very fast loading of very big table

2021-02-18 Thread Denis Magda
Hello Vladimir, Good to hear from you! How much is that in gigabytes? - Denis On Thu, Feb 18, 2021 at 10:06 PM wrote: > Sep 2020 I've published the paper about Loading Large Datasets into Apache > Ignite by Using a Key-Value API (English [1] and Russian [2] version). The > approach described

Instructor-Led Ignite Essentials Training

2021-02-08 Thread Denis Magda
Folks, We're starting regular training sessions covering Ignite Essentials. See if it's valuable for you. The first session is on Feb 10th and the more to follow: https://www.gridgain.com/resources/webinars/developer-training-apache-ignite-essentials-key-design-principles-building-data This

Re: Control Center core limit info

2021-01-08 Thread Denis Magda
Hello Carsten, To my knowledge, you can have up to 2 nodes monitored by Control Center for free. Then you need to request a license file. As a temporary workaround, you can use the hosted version of the tool that doesn't put any limitations: https://control.gridgain.com - Denis On Fri, Jan 8,

Re: Ignite in-memory + other SQL store without fully loading all data into Ignite

2020-12-29 Thread Denis Magda
Hi Courtney, Glad to hear from you! It's been a while since we met last time. It's truly disappointing seeing you struggle with Ignite that much. Thanks for being open and kicking the discussion off. How about three of us (you, Val, and I) meet the second week of January and talk out the issues?

Re: Implementing HA among Ignite Clusters

2020-12-06 Thread Denis Magda
This DR feature is what you are looking for, complete solution: https://www.gridgain.com/docs/latest/administrators-guide/data-center-replication/introduction On Sunday, December 6, 2020, Alexandr Shapkin wrote: > Hi, > > > > I don’t think that ignite support this out of the box, cause data >

Re: IgniteDataStreamer.keepBinary proposal

2020-12-04 Thread Denis Magda
Hi Vladimir, Most of the code snippets are already arranged in complete and ready-for-usage samples: https://github.com/apache/ignite/tree/master/docs/_docs/code-snippets/java/src/main/java/org/apache/ignite/snippets Anyway, those are code snippets that are injected into quite generic

Re: C# CacheStoreAdapter - Customizing Load, LoadCache methods

2020-12-02 Thread Denis Magda
Yes, once the data is loaded into Ignite you can query it with SQL. - Denis On Wed, Dec 2, 2020 at 9:41 AM adumalagan wrote: > Hi Vlad, I've started to read through your link and I just wanted to know > that, if I were to implement your tutorial, could I perform SQL queries on > the cache

Re: Native persistence - No space left on device error

2020-11-18 Thread Denis Magda
Keep an eye on the storage usage metrics to avoid such incidents proactively in production: https://www.gridgain.com/docs/tutorials/management-monitoring/ignite-storage-monitoring#track-disk-storage-size - Denis On Wed, Nov 18, 2020 at 7:41 AM Ilya Kasnacheev wrote: > Hello! > > When you run

Re: Is there any change to integrate ignite into Android environment?

2020-11-11 Thread Denis Magda
We are not running Ignite test suites on Android, thus, don't have a full picture of what works or fails. Please file a ticket with the stack trace and details about your Android environment. But, you have the REST protocol at your service that will work on any edge device. Use Android networking

Re: Is there any change to integrate ignite into Android environment?

2020-11-09 Thread Denis Magda
Hi, What's the device? Are you planning to start a cluster on those devices? Or connect from those devices to a cluster deployed on server machines? - Denis On Mon, Nov 9, 2020 at 7:46 PM xingjl6280 wrote: > Hi team, > > Is it possible to integrate ignite into Android? > My Android device

Re: WAL and WAL Archive volume size recommendation

2020-11-05 Thread Denis Magda
Hello Facundo, Just go ahead and disable the WAL archives. You need the archives for the point-in-time-recovery feature that is supported by GridGain. I'll check with the community why we have the archives enabled by default in a separate discussion.

Re: New Node - Rebalancing

2020-11-03 Thread Denis Magda
Hi Mahesh, Use these metrics to monitor the progress: - JMX: https://ignite.apache.org/docs/latest/monitoring-metrics/metrics#monitoring-rebalancing - Rebalancing widget of Control Center:

Re: Execution of local SqlFieldsQuery on client node disallowed

2020-10-30 Thread Denis Magda
leh > wrote: > >> Thanks Ilya, Denis for the feedback. >> >> On Mon, Oct 26, 2020 at 1:44 PM Denis Magda wrote: >> >>> Narges, >>> >>> Also, keep in mind that if a local query is executed over a partitioned >>> table and it happens th

Re: Inserting date into ignite with spark jdbc

2020-10-30 Thread Denis Magda
Andrey, Do we need to update our docs? It feels like the docs miss these details or have an outdated example. - Denis On Fri, Oct 30, 2020 at 7:03 AM Andrei Aleksandrov wrote: > Hi, > > Here's an example with correct syntax that should work fine: > > DataFrameWriter < Row > df = resultDF >

Re: Execution of local SqlFieldsQuery on client node disallowed

2020-10-26 Thread Denis Magda
t node? The code is invoked via >>>>> an ignite service deployed on each node and I am not setting the client >>>>> mode anywhere. The code sets the jdbc connection to local and tries to >>>>> execute a sql code on the node in some interval. By the w

Re: [ANNOUNCE] Apache Ignite 2.9.0 Released

2020-10-23 Thread Denis Magda
We made it! Congrats, community! Thanks, Alex for pushing the release till the end, that was a long road ;) I decided to record a quick video featuring top-3 changes in the release. Those are my top-3 additions while you can have yours. Anyway, check it out: https://youtu.be/ewwjq8SIk-s - Denis

Re: Execution of local SqlFieldsQuery on client node disallowed

2020-10-22 Thread Denis Magda
The error message says you're attempting to run the query on a client node. If that's the case (if the service is deployed on the client node), then the local flag has no effect because client nodes don't keep your data locally but rather consume it from servers. - Denis On Thu, Oct 22, 2020 at

Re: Isolating server nodes to a fixed virtual IP or interface

2020-10-22 Thread Denis Magda
Hi Gilles, Thanks for considering Ignite for your project! Let's help to get you to production avoiding bumpy roads ) Try to set the 'localAddress' parameter (and 'localPortRanges' if needed) for both the discovery and communication settings: - Discovery:

Video overview of eight Ignite-specific talks scheduled for the IMCS Summit 2020

2020-10-16 Thread Denis Magda
Igniters, We've got eight (!!!) Ignite-specific sessions scheduled for the In-Memory Computing Summit 2020. I've gone ahead and produced a quick overview of those sessions. Check and weigh up which one to join: https://youtu.be/SCqd4qfBY6Q The sessions are delivered by our community folks:

Tech Talk, October 14th, Pacific Time: ways to prevent out-of-memory issues in Ignite

2020-10-13 Thread Denis Magda
Igniters, I've been with the community for more than 5 years and would say that out-of-memory issues are among the most notorious ones, as well as unexpected ones, that are reported by fellow Ignite developers. Even if we do a great job estimating a required cluster capacity, the data volume can

Re: Continuous Query

2020-10-07 Thread Denis Magda
hen introduce the continuous queries-based improvement whenever is needed. You decide. Hope it helps. - Denis On Wed, Oct 7, 2020 at 9:19 AM Denis Magda wrote: > So, a lesson for the future, would the continuous query approach still be >> preferable if the calculation involves the cache

Re: Continuous Query

2020-10-07 Thread Denis Magda
exists in the list of the countries that I am interested in. >> >> On Tue, Oct 6, 2020 at 4:11 PM Denis Magda wrote: >> >>> Thanks >>> >>> Then, I would consider the continuous queries based solution as long as >>> the record

Re: Continuous Query

2020-10-06 Thread Denis Magda
narges saleh wrote: > Denis > The calculation itself doesn't involve an update or read of another > record, but based on the outcome of the calculation, the process might make > changes in some other tables. > > thanks. > > On Mon, Oct 5, 2020 at 7:04 PM Denis Magda w

Re: Continuous Query

2020-10-05 Thread Denis Magda
ons on the data > without sending any notification to the app. > > On Fri, Oct 2, 2020 at 4:25 PM Denis Magda wrote: > >> And after you detect a record that satisfies the condition, do you need >> to send any notification to the application? Or is it more like a serv

Re: Ignite thread pool configuration

2020-10-05 Thread Denis Magda
Give it a try but do some load testing close to your production workload. And then ramp the numbers up if needed. - Denis On Mon, Oct 5, 2020 at 12:56 AM VeenaMithare wrote: > Thanks Denis, > > I am thinking of setting the below thread pools as this on both client and > server since we dont

Re: [Announcement] New Ignite docs merged to the master

2020-10-05 Thread Denis Magda
is served :) - Denis On Mon, Oct 5, 2020 at 3:00 PM Denis Magda wrote: > Igniters, > > Just a shout-out that the new docs made it to the master (sources in > AsciiDoc format) with the latest version published to the website (HTML > format): https://ignite.apache.org/docs/lat

[Announcement] New Ignite docs merged to the master

2020-10-05 Thread Denis Magda
Igniters, Just a shout-out that the new docs made it to the master (sources in AsciiDoc format) with the latest version published to the website (HTML format): https://ignite.apache.org/docs/latest/ Thanks to everyone involved. Special thanks go to @Artem Budnikov and @Mauricio Stekl who were

Re: Ignite thread pool configuration

2020-10-03 Thread Denis Magda
You can certainly reduce its size ( https://ignite.apache.org/docs/latest/perf-and-troubleshooting/thread-pools-tuning#data-streamer-pool). But at the same time created but unused threads are just some objects that consume a bit of memory but don't use any CPU resources (until you start using

Re: Continuous Query

2020-10-02 Thread Denis Magda
ion should happen at most a couple of minutes after a record is > inserted in the cache but all the detections are local to the node. But > some records with the current timestamp might show up in the system with > big delays. > > On Fri, Oct 2, 2020 at 12:23 PM Denis Magda wrote:

Re: Continuous Query

2020-10-02 Thread Denis Magda
referable? Does a continuous query based approach impose > a lot more overhead? > > On Fri, Oct 2, 2020 at 9:52 AM Denis Magda wrote: > >> Hi Narges, >> >> Use continuous queries if you need to be notified in real-time, i.e. 1) a >> record is inserted, 2) the

Re: Continuous Query

2020-10-02 Thread Denis Magda
Hi Narges, Use continuous queries if you need to be notified in real-time, i.e. 1) a record is inserted, 2) the continuous filter confirms the record's time satisfies your condition, 3) the continuous queries notifies your application that does require processing. The jobs are better for a

Re: Question about Ignite persistence disk space used after clearing cache

2020-09-25 Thread Denis Magda
Hi Scott, The disk space is not compacted even after you clear the entire cache. The compaction feature will be introduced to Ignite soon. So, the metric shows the allocated size. This doc section suggests an approach for the actual size calculation:

Re: Fast Load Large Datasets

2020-09-25 Thread Denis Magda
nite has finally > arrived [1]. Many thanks to @Denis Magda and @Ksenia Romanova for their > valuable help. > > [1] > https://www.gridgain.com/resources/blog/how-fast-load-large-datasets-apache-ignite-using-key-value-api > > Vladimir >

Re: [DISCUSSION] Renaming Ignite's product category

2020-09-24 Thread Denis Magda
what you are > trying to achieve. > > Regards > > > > Adam Carbone | Director of Innovation – Intelligent Platform Team | > Bottomline Technologies > Office: 603-501-6446 | Mobile: 603-570-8418 > www.bottomline.com > > > > > > > > *From:

Re: [DISCUSSION] Renaming Ignite's product category

2020-09-23 Thread Denis Magda
database". It clearly > states > > that Ignite is a database (which is true at this point), while still > > emphasizing the in-memory computing power endorsed by the platform. > > > > The "in-memory computing platform" is an ambiguous term an

[DISCUSSION] Renaming Ignite's product category

2020-09-16 Thread Denis Magda
Igniters, Throughout the history of our project, we could see how the addition of certain features required us to reassess the project's name and category. Before Ignite joined the ASF, it supported only compute APIs resembling the MapReduce engine of Hadoop. Those days, it was fair to define

Re: Tech talk: thoughts and suggestions on how to use Ignite with serverless functions

2020-09-15 Thread Denis Magda
artin's website > > On Tue, Sep 15, 2020 at 7:43 PM Denis Magda wrote: > >> Igniters, >> >> The serverless architecture >> <https://martinfowler.com/articles/serverless.html#WhatIsServerless> is >> getting more traction these days since it helps us to reduce

Tech talk: thoughts and suggestions on how to use Ignite with serverless functions

2020-09-15 Thread Denis Magda
Igniters, The serverless architecture is getting more traction these days since it helps us to reduce the costs of our cloud-based applications. Several months ago I decided to research if Ignite is 100% ready for serverless

Re: Map 10 caches to 10 different ignite nodes

2020-09-11 Thread Denis Magda
Take a look at this documentation page that share a bit more detail on how to use the node filters. - Denis On Fri, Sep 11, 2020 at 5:19 AM abhi2703 wrote: > Thanks a lot Vladimir, that's

Re: Ignite Segmentation Behaviour

2020-09-11 Thread Denis Magda
Hi Samuel, With the current behavior, the segments will not rejoin automatically. Once the network is recovered from a network partitioning event, you need to restart all the nodes of one of the segments. Those nodes will join the other nodes and the cluster will become fully operational. Let me

Re: InvalidClassException local class incompatible for custom cache store factory

2020-09-08 Thread Denis Magda
Hi Xinmin, Are you getting this error for your custom objects? If yes, did you change a type of a field in those objects? Probably, you're hitting this problem: https://www.gridgain.com/docs/latest/perf-troubleshooting-guide/troubleshooting#cluster-doesnt-start-after-field-type-changes - Denis

Re: Regarding TRANSACTIONAL_SNAPSHOT

2020-09-04 Thread Denis Magda
Hi Dana, Here you can find a list of known high-level limitations: https://apacheignite.readme.io/docs/multiversion-concurrency-control#limitations Also, the performance might not be satisfactory and not all the cluster failure scenarios might be covered. Generally, as of know, I would advise

Re: [External]Re: unable to start node

2020-09-02 Thread Denis Magda
@Taras Ledkov , @Igor Seliverstov , @Yuriy Gerzhedovich , did you guys see this issue before? It looks like a bug in the SQL engine. Kamlesh, in the meantime, try to follow the procedure described in this JIRA ticket (you need to clean the index that we'll be rebuild on the startup):

Re: ignite partition mode

2020-08-27 Thread Denis Magda
Explain the steps in detail - Denis On Wed, Aug 26, 2020 at 5:13 AM itsmeravikiran.c wrote: > By using ignite web console > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >

Re: Executing select query in Partition mode (cluster with two nodes) taking more than 10 minutes.

2020-08-27 Thread Denis Magda
Hi Bhavesh, Follow these basic performance tuning recommendations for SQL to understand how to optimize the query. Take the execution plan first. Most likely, you need to set secondary indexes. If that's not the case,

Re: How to stop a node from dying when memory is full?

2020-08-27 Thread Denis Magda
Folks, this article should be relevant to you. It covers all techniques to avoid the OOM except for swapping: https://www.gridgain.com/resources/blog/out-of-memory-apache-ignite-cluster-handling-techniques You can use swapping as a part of your toolbox to survive the time when a node is running

Re: Select clause is quite more slow than same Select on MySQL

2020-08-27 Thread Denis Magda
This resource tries to explain your issue in a bit more detail. In short, there are scenarios when an RDBMS can easily show much better performance numbers. - Denis On Thu, Aug

Re: Failed to map SQL query

2020-08-25 Thread Denis Magda
If it's expected that the SQL query will produce a large data set then consider using the memory quotas feature with the offloading to disk option . It's not available in Ignite though. GridGain releases it

Re: ignite partition mode

2020-08-21 Thread Denis Magda
How do you check that the second node doesn't keep any records? What your verification method? - Denis On Tue, Aug 18, 2020 at 3:17 AM itsmeravikiran.c wrote: > Our application running with 2 ignite node,. > But data is available in one node, and not available in the second node. > Our cache

Re: Issue with using Ignite with Spring Data

2020-08-21 Thread Denis Magda
the cache for the ones which are > missing ? > > If my above understanding is correct then that explains why I was getting > null results from the queries executed once the Spring boot is instantiated > as the cache load on startup was not complete yet. > > > Regards, > Srika

Re: Issue with using Ignite with Spring Data

2020-08-21 Thread Denis Magda
Hi Srikanta, You forgot to share the configuration. Anyway, I think it's clear what you are looking for. Check this example showing how to configure CacheJdbcPojoStoreFactory programmatically (click on the "Java" tab, by default the example shows the XML version):

Re: Lost node again.

2020-08-20 Thread Denis Magda
uot; hours. > > Dennis, wouldn't 15 seconds faillureDetectionTimeout cause even more > shutdowns? > We also considered more tuning stuff in the docs, we' ll see I guess... > As for now we don't have separate disks for now. > > > > On Wed, 19 Aug 2020 at 23:35, Denis M

Re: Lost node again.

2020-08-19 Thread Denis Magda
John, I would try to get to the bottom of the issue, especially, if the case is reproducible. If that's not GC then check if that's the I/O (your logs show that the checkpointing rate is high): - You can monitor checkpointing duration with a JMX tool

Re: Ignite Queue (Documentation or Code defect)?

2020-08-19 Thread Denis Magda
Could you please file a ticket in Ignite JIRA for 2.10 release? That's definitely an overlook in the current implementation. - Denis On Tue, Aug 18, 2020 at 9:57 AM Humphrey wrote: > Hope someone pics this up. That the code is not behaving as the > documentation > is saying. > (Not throwing

Re: Operation block on Cluster recovery/rebalance.

2020-08-17 Thread Denis Magda
> > On Fri, 14 Aug 2020 at 18:22, Denis Magda wrote: > >> @Evgenii Zhuravlev , @Ilya Kasnacheev >> , any thoughts on this? >> >> As a dirty workaround, you can update your cache references on client >> reconnect events. You will be getting an exception by

Re: Operation block on Cluster recovery/rebalance.

2020-08-14 Thread Denis Magda
back > > 2- Implement some kind of logic on the client side not to block the HTTP > part... > > Can IgniteCache instance be notified of disconnected events so I can maybe > tell the repository class I have to set a flag to skip the operation? > > > On Fri., Aug. 14, 20

Re: Operation block on Cluster recovery/rebalance.

2020-08-14 Thread Denis Magda
, Aug. 14, 2020, 12:53 p.m. Denis Magda, wrote: > >> John, >> >> Ok, we nailed it. That's the current expected behavior. Generally, I >> agree with you that the platform should support an option when operations >> fail if the cluster is deactivated. Could you prop

Re: Change Data Capture Feature

2020-08-14 Thread Denis Magda
Hello Pavel, GridGain supports a Kafka Connect integration that supports all sophisticated CDC scenarios: https://www.gridgain.com/docs/latest/integrations/kafka/cert-kafka-connect Debezium is another option. This article covers how to capture changes with GridGain Kafka Connect

Re: Operation block on Cluster recovery/rebalance.

2020-08-14 Thread Denis Magda
Complete(result.result()); > } else { > promise.tryFail(result.cause()); > } > }); > > return promise.future(); > } > > public T cache() { > return (T) cache; > } > } > > &g

Re: How to use Ignite Spring Data to query selected fields from Ignite ?

2020-08-14 Thread Denis Magda
Hi, Check this section of the Ignite + Spring Data tutorial: https://www.gridgain.com/docs/tutorials/spring/spring_ignite_tutorial#create-spring-data-repositories - Denis On Wed, Aug 12, 2020 at 6:52 PM 1478814670 <1478814...@qq.com> wrote: > Hi, > Use Ignite Spring Data module to query

Re: 2.8.1 - Loading Plugin Provider - Conflicting documentation

2020-08-13 Thread Denis Magda
Veena, thanks for the ticket! We’ll take care of it. On Thursday, August 13, 2020, VeenaMithare wrote: > HI , > > Raised a Documentation Improvement jira : > IGNITE-13356 > Documentation Change needed: PluginProvider loading changed from 2.8.1 > regards, > Veena. > > > > -- > Sent from:

Re: Enabling swapPath causes invoking shutdown hook

2020-08-13 Thread Denis Magda
me, it may be a good > practice to make full use of the swap mechanism of the OS, which takes up > more disk space but achieves better performance. > 在 2020/8/14 上午8:22, Denis Magda 写道: > > Ignite swapping is based on the swapping mechanism of the OS. So, you > shouldn’t see any dif

Re: Enabling swapPath causes invoking shutdown hook

2020-08-13 Thread Denis Magda
Ignite swapping is based on the swapping mechanism of the OS. So, you shouldn’t see any difference if enable the OS one directly some way. Generally, you should not use swapping of any form as a permanent persistence layer due to the performance penalty. Once the swapping kicks in, you should

Re: Operation block on Cluster recovery/rebalance.

2020-08-13 Thread Denis Magda
nnected exception only happens when all server nodes in > the cluster are down. The blockage only happens when the cluster is trying > to establish baseline topology. > > On Wed., Aug. 12, 2020, 6:28 p.m. Denis Magda, wrote: > >> John, >> >> I don't see any tr

Re: Operation block on Cluster recovery/rebalance.

2020-08-12 Thread Denis Magda
blocks. >> >> My application first first runs a select on the cache and then does a put >> to cache. >> >> On Tue, 11 Aug 2020 at 19:22, Denis Magda wrote: >> >>> John, >>> >>> It sounds like a deadlock caused by the application logi

Re: Operation block on Cluster recovery/rebalance.

2020-08-11 Thread Denis Magda
t;> >> Basically the client application is an HTTP Server on each HTTP request >> does cache exception. >> >> >> >> >> >> >> On Fri, 7 Aug 2020 at 19:46, John Smith wrote: >> >>> No, everything blocks... Also using 2.7.0 just in cas

Re: [BLOG] Apache Ignite Extensions

2020-08-10 Thread Denis Magda
Hi Saikat, The weekly routines of an Apache Ignite committer :) I believe that Ignite application developers would love to learn insights from this article and eventually get modular-based Ignite integrations. So, with(out) your permission sharing the article via @user list. Excellent article

Re: What does all partition owners have left the grid, partition data has been lost mean?

2020-08-07 Thread Denis Magda
John, This page covers all the aspects of backups in Ignite (what are those, how to configure, etc.): https://www.gridgain.com/docs/latest/developers-guide/configuring-caches/configuring-backups As for the 5 nodes cluster with the persistence, yes, all those have to be added to be in the same

Re: Operation block on Cluster recovery/rebalance.

2020-08-07 Thread Denis Magda
If I'm not mistaken, key-value operations (cache.get/put) and compute calls fail with an exception if the cluster is deactivated. Do those fail on your end? As for the async and SQL operations, let's see what other community members say. - Denis On Fri, Aug 7, 2020 at 1:06 PM John Smith

Re: Enabling swapPath causes invoking shutdown hook

2020-08-07 Thread Denis Magda
Agree with Ilya that the performance should be comparable if you disable the WAL of the Ignite persistence. Anyway, the swapping and Ignite persistence pursue different goals. The swapping is one of the out-of-memory protection techniques - if you run out of DRAM, then the OS will start swapping

Re: Best first steps for performance tuning

2020-08-07 Thread Denis Magda
Devin, Please consider watching this talk by Ivan Rakov, one of main contributors to the native persistence. Rewind to 28 minutes 14 seconds for performance consideration: https://www.youtube.com/watch?v=f2ArcJPH4iU Let us know if any piece of advice was helpful and we’ll put the knowledge on

Re: read-though tutorial for a big table

2020-08-07 Thread Denis Magda
Alex, Please share a bit more details on what you’re struggling with. It sounds like you are looking for a specific piece of advice rather than generic performance suggestions. Denis On Thursday, August 6, 2020, Alex Panchenko wrote: > Hello Vladimir, > > are there some key things you can

Re: run ignitevisorcmd in k8s and docker?

2020-08-07 Thread Denis Magda
CMD in the same container with > Ignite server, and using the same configuration file with > KubernetesIPFinder that ignite server use. Should this mode be supported? > And for the link provided, does it mean that web console can also be used? > Thanks! - Bright > > - 原始邮件 -

Re: run ignitevisorcmd in k8s and docker?

2020-08-06 Thread Denis Magda
Hi there, Visor CMD uses a legacy connection mode (daemon node) that might be tricky to deal with in K8S environments. Try to start it inside the same K8S network with your cluster and use a configuration with KubernetesIPFinder you used for the server nodes. Alternatively, go for an alternate

Re: Call for presentations for ApacheCon North America 2020 now open

2020-08-06 Thread Denis Magda
Wesley, Definitely follow the advice of Saikat and submit the talk to the IMC Summit. Also, we’ll be happy to host you for Ignite virtual meetup. Many community folks will be glad to learn how you use Ignite ML in production. Are you ready? https://www.meetup.com/Apache-Ignite-Virtual-Meetup/

Re: Call for presentations for ApacheCon North America 2020 now open

2020-08-04 Thread Denis Magda
he Flink. > > > > I would also like to co-present on Ignite internals and usecases deep > dive. > > > > Regards, > > Saikat > > > > On Wed, Jan 22, 2020 at 6:22 PM Denis Magda wrote: > > > >> Igniters, > >> > >> I was submi

Re: Serialize a char array member as part of class serialization into cache - C++ API

2020-08-03 Thread Denis Magda
Igor, Would you please join the discussion and help Data tackle the issue? - Denis On Thu, Jul 30, 2020 at 1:03 AM Dana Milan wrote: > Hi, > > I couldn't find an answer anywhere else, hopefully you can help me. > > I have the following class: > > class Pair { > friend struct

Re: Ignite Web Console sign up. Not found.

2020-08-03 Thread Denis Magda
The Ignite community stopped supporting Ignite Web Console some time ago and recently made a decision to discontinue the tool officially: https://issues.apache.org/jira/browse/IGNITE-13038 Please select an alternate tool. We've put together a list of potential candidates:

Re: Effective Monitoring of Rebalancing

2020-07-31 Thread Denis Magda
John, If it's still relevant for you, now you can monitor rebalancing progress with a special widget of Control Center: https://www.gridgain.com/docs/control-center/latest/monitoring/configuring-widgets#rebalance-widget - Denis On Fri, Jan 17, 2020 at 12:33 AM John Gardner wrote: > I've

Re: Work Directory Usage with Persistence Disabled

2020-07-30 Thread Denis Magda
Hello Mitchell, Ignite saves there classes of objects which your application puts in caches or executes as compute tasks. For instance, if you put a MyObject instance in a cache, then Ignite will persist the info about MyObject in the marshaller directory and then will be able to deserialize this

Re: [MEETUP] Apache Ignite Best Practices for Native Persistence and Data Recovery

2020-07-29 Thread Denis Magda
Vasiliy, You can find a link to the recording in the comments section here: https://www.meetup.com/ru-RU/Apache-Ignite-Virtual-Meetup/events/271602652/ - Denis On Wed, Jul 29, 2020 at 2:36 AM Vasily Laktionov wrote:

Re: Kubernetes : Connection timed out (Connection timed out)

2020-07-29 Thread Denis Magda
Steve, Excellent, glad the problem is gone. The community is working on the new documentation and, as far as I know, the Kubernetes instructions will be brought up-to-date. Thanks for pointing that out. - Denis On Wed, Jul 29, 2020 at 2:53 AM steve.hostettler wrote: > Hello Dennis, > > so it

Fwd: The Apache(R) Software Foundation Announces Annual Report for 2020 Fiscal Year

2020-07-29 Thread Denis Magda
Igniters, The board of directors published the annual report and even though Ignite is not mentioned in the press release, you can find encouraging datapoints by looking into the full report: https://www.apache.org/foundation/docs/FY2020AnnualReport.pdf Remember that Ignite is compared to other

Re: Kubernetes : Connection timed out (Connection timed out)

2020-07-28 Thread Denis Magda
Steve, Jose, Try to follow this instruction created specifically for Azure Kubernetes Service (AKS): https://www.gridgain.com/docs/latest/installation-guide/kubernetes/azure-deployment Not, if the cluster (server nodes) are planned to be deployed as virtual machines (on-premises) while the thick

Re: Load balanced CQ listener/Catch up missed events

2020-07-27 Thread Denis Magda
The client can create a queue, and the servers will keep items of that queue. Those items will be stored in memory and disk tiers of the servers. And, yes, physically the records will be persisted in the database folder (that is under the work folder by default). Hope this helps. - Denis On

Re: 3rd party persistence: Mapping with RDBMS tables that don't have primary keys

2020-07-25 Thread Denis Magda
Hi Alex, > I'm not going to write any new records or update existing ones for such > tables through Ignite. So I can skip the overrides in CacheStore > implementation, right? (I'm using default implementation at the moment) That's right. https://apacheignite.readme.io/docs/id-generator > Thi

Re: Apache Ignite with istio/envoy mTLS

2020-07-23 Thread Denis Magda
To support this deployment model you would need to have a Kubernetes Service per Ignite server node so that remote thick clients can connect to any server from outside. Also, you would need to enable the following setting on the clients side (the setting will be released in Ignite 2.9):

  1   2   3   4   5   6   7   8   9   10   >