[ANNOUNCE] Ignite Spark Extension 2.0.0 and 3.0.0 Released

2022-12-19 Thread Maxim Muzafarov
/community/resources.html#ask -- Best Regards, Maxim Muzafarov on behalf of Apache Ignite PMC

Re: Ignite Snapshots take minutes to complete

2022-05-27 Thread Maxim Muzafarov
Hello, If you're copying a snapshot part to the new node, then you have to be sure that the /ignite/work/cp, /ignite/wal, /ignite/walarchive directories are empty prior to the node start. Is it true for your case? On Fri, 27 May 2022 at 10:29, Surinder Mehra wrote: > > Hi, > Please find ignite c

Re:

2022-05-18 Thread Maxim Muzafarov
Hello, Please, check the following: https://dist.apache.org/repos/dist/release/ignite/ignite-extensions/ignite-zookeeper-ip-finder-ext/1.0.0/ On Fri, 6 May 2022 at 12:08, Kseniya Romanova wrote: > > Here's the email with voting and details > https://lists.apache.org/thread/njk9v4nzhkdnfxm155dml

[ANNOUNCE] Apache Ignite Extensions Released

2022-05-18 Thread Maxim Muzafarov
://ignite.apache.org/community/resources.html#ask Regards, Maxim Muzafarov on behalf of the Apache Ignite community.

Re: Unable to remove cache key entries after Ignite server restart

2022-05-13 Thread Maxim Muzafarov
> INFO:Started cache in recovery mode [name=mycache, id=-478150787, > dataRegionName=default, mode=REPLICATED, atomicity=ATOMIC, > backups=2147483647, mvcc=false] > INFO:Resolved page store work directory > INFO:Finished recovery for cache [cache=abc, grp=abc, > startVer=Af

Re: Apache Ignite H2 Vulnerabilities

2022-05-06 Thread Maxim Muzafarov
Lokesh, Talking about the Ignite Calcite integration module the dependency over the H2 will be removed in the next release 2.14. On Tue, 3 May 2022 at 15:17, Lokesh Bandaru wrote: > > Thanks Stephen. > Not sure if this is the right forum but wanted to check if there is a plan > already to come

Re: Unable to remove cache key entries after Ignite server restart

2022-05-06 Thread Maxim Muzafarov
Hello, The crash-recovery machinery for the restarted node should works fine. Do you have any error during the cache key removal procedure? Have you checked the data using the Repair Read tool [1] (the CHECK_ONLY strategy [2]) or the idle verify procedure [3]? [1] https://ignite.apache.org/docs

Re: ignite-spark compatibility

2022-05-06 Thread Maxim Muzafarov
Hello, If plans exist, they are very distant and I think the Spark 3.0 support for the Apache Ignige 2.x can occurs much earlier. However, I don't know any estimates or release dates for this feature. On Mon, 11 Apr 2022 at 16:20, Kerr, Andrew (Nokia - CA/Ottawa) wrote: > > Hello, > > > > We ar

Re: Question about the starting order of REPLICATED + Persist cluster

2022-05-06 Thread Maxim Muzafarov
Hello, It seems all of your questions are related to the `baseline topology` concept . Please, check the following link - [1]. Why do you need to take a control on the cluster nodes order manually? For example, if you're running nodes B and C the cluster still in the inactive mode (node A is offl

Re: Warning Exception closing JdbcConnection

2022-02-16 Thread Maxim Muzafarov
Hello, According to the given exception stack trace, you may ignore this warning message. It's sad to say and it's true that the log messages should be improved, hopefully it will happen in the next release. On Mon, 14 Feb 2022 at 18:34, Thomas Kramer wrote: > > Has anyone solved this or identif

Re: Restore data from Ignite snapshots

2022-02-09 Thread Maxim Muzafarov
we run restore command, it does not copy data >>> >>> Could you please suggest how it would work. directory structure is attached. >>> Also, can you suggest a better way to copy snapshot directory data to S3 . >>> I am thinking of using a kubernetes CSI driver t

Re: Restore data from Ignite snapshots

2022-02-03 Thread Maxim Muzafarov
mmand : ./control.sh --snapshot restore snapshot_1 --start >> 8. Command was successful but data is not copied to cluster nodes. >> >> Please note that when I restarted the cluster, it created binary_data, >> marshaler and nodes directories by default. >> >> Did I mi

Re: Critical System Error in ContinuousQuery processing node

2022-02-01 Thread Maxim Muzafarov
Hello, Can you attach the full stack trace and log, please? On Thu, 27 Jan 2022 at 19:11, Mike Wiesenberg wrote: > > Hi, > When I start a continuous query listener while another client is deleting > entries from the same cache, I observe the node and listener crash with this > exception in th

Re: How to use ignite-aws-ext with 2.12.0

2022-02-01 Thread Maxim Muzafarov
Hello, The aws extension will be released soon. Nothing changed here from 2.11 to 2.12 except that the sources have been moved to the ignite-extension project [1] and the first release is needed to be prepared. [1] https://github.com/apache/ignite-extensions/tree/master/modules/aws-ext On Wed, 2

Re: Restore data from Ignite snapshots

2022-02-01 Thread Maxim Muzafarov
Hello, Your case looks correct to me, however, I'd like to mention some important points that may help you: - the directories structure of the snapshot has the same structure as the Ignite native persistence, so you may backup the original cluster node directory (for binary_data, marshaller and db

[ANNOUNCE] Apache Ignite 2.11.1 Released

2021-12-21 Thread Maxim Muzafarov
/download.cgi Please let us know if you encounter any problems: https://ignite.apache.org/community/resources.html#ask Regards, Maxim Muzafarov on behalf of the Apache Ignite community.

[ANNOUNCE] Apache Ignite 2.11.0 Released

2021-09-20 Thread Maxim Muzafarov
the database: https://ignite.apache.org/releases/2.11.0/release_notes.html Download the latest Ignite version from here: https://ignite.apache.org/download.cgi Please let us know if you encounter any problems: https://ignite.apache.org/community/resources.html#ask Regards, Maxim Muzafarov on

Re: Apache Ignite Repo 403 Forbidden

2021-08-27 Thread Maxim Muzafarov
Mustafa, I've created an issue to fix this. Nikita, will you take a look at this issue? https://issues.apache.org/jira/browse/IGNITE-15381 On Wed, 11 Aug 2021 at 16:32, Mustafa Sunka wrote: > > Thank you for the update. Do you know when the documentation will be updated > to reflect this? > >

Re: no ignite spring data 2.2 on repo for ignite 2.10.0 release?

2021-03-25 Thread Maxim Muzafarov
Hello, It seems the module moved to Ignite extensions [1] [2] and will be released shortly. [1] https://ignite.apache.org/releases/2.10.0/release_notes.html [2] http://apache-ignite-developers.2346864.n4.nabble.com/Migration-of-spring-data-modules-to-ignite-extensions-td49566.html On Thu, 25

[ANNOUNCE] Apache Ignite 2.10.0 Released

2021-03-18 Thread Maxim Muzafarov
/resources.html#ask Regards, Maxim Muzafarov on behalf of the Apache Ignite community.

Re: Corrupted B+ Tree Causing Repeated Crashes

2021-02-26 Thread Maxim Muzafarov
Mitchell, I've created the issue [1] for your case, but it's really hard to define the root cause without additional information (the exception stack trace isn't enough for analysis). Do you have the issue reproducer? Does this issue still appear? There are some issues already been fixed since th

Re: Cluster-wide snapshot operation finished successfully

2021-02-25 Thread Maxim Muzafarov
Hello, This message appears at the node on which the snapshot operation has been initiated. It may be not the same node for different snapshot operation. How did you run the snapshot? (control.sh, jxm, java API) On Wed, 24 Feb 2021 at 12:46, 38797715 <38797...@qq.com> wrote: > > Hello team, > > Y

Re: Corrupted B+ Tree Causing Repeated Crashes

2021-02-25 Thread Maxim Muzafarov
Mitchell, Can you provide the full log and the cache configuration? On Thu, 25 Feb 2021 at 03:55, Mitchell Rathbun (BLOOMBERG/ 731 LEX) wrote: > > Any other thoughts on this? The data corruption occurred when we were using > version 2.7.5. I have looked at a couple of tickets involving corrupte

Re: Re[2]: Detecting checkpoints programmatically

2021-01-29 Thread Maxim Muzafarov
Hello Raymon, Is it possible for your case writing a custom MetricExporterSpi [1]? So all these checkpoint metrics [2] will be exported to your monitoring system. It is also possible to get all metrics through the console [3]. [1] https://github.com/apache/ignite/blob/master/modules/core/src/mai

Re: Native persistence enabled: Loading the same data again takes longer than initially

2020-12-01 Thread Maxim Muzafarov
Vincent, What type of IgniteDataStreamer you are using? allowOverwrite == true/false? Are you loading data to SQL table or just a regular cache? Are there any indexes exists? Yes, disabling WAL means you have a risk of losing data while it still remains disabled. Then the initial loading complete

Re: Native persistence enabled: Loading the same data again takes longer than initially

2020-11-30 Thread Maxim Muzafarov
Hello Vincent, What kind of Ignites API you are using for initial data loading? I always use this man page [1] for my local tests with simultaneously disabling WALs if the Ignite native persistence enabled. [1] https://apacheignite.readme.io/docs/data-loading On Mon, 30 Nov 2020 at 16:55, Vinc

Re: What is considered high IO wait and partition exchange fiallure?

2020-11-18 Thread Maxim Muzafarov
Hello John, Can you share the full log and cluster configuration? For instance, the cluster may fail the node due to unresponsive socket request if this node had long GC pauses due to high load. > Does this mean this node was also the master? Not sure I've got your question. Do you mean the coor

Re: New Node - Rebalancing

2020-11-05 Thread Maxim Muzafarov
Hi Mahesh, In addition to the Denis answer, please, check the new rebalancing metrics for added for each cache group (2.8, 2.9 releases): https://issues.apache.org/jira/browse/IGNITE-12193 On Tue, 3 Nov 2020 at 22:35, Denis Magda wrote: > > Hi Mahesh, > > Use these metrics to monitor the progres

Re: Tracing configuration

2020-10-30 Thread Maxim Muzafarov
Hello Bastien, Is the issue [1] is the same as you faced with? It seems to me it will be available in 2.9.1 (or 2.10). [1] https://issues.apache.org/jira/browse/IGNITE-13640 On Fri, 30 Oct 2020 at 17:49, Bastien Durel wrote: > > Hello, > > I'd like to activate tracing to investigate a slowdown,

[ANNOUNCE] Apache Ignite 2.8.0 Released

2020-03-12 Thread Maxim Muzafarov
Download the latest Ignite version from here: https://ignite.apache.org/download.cgi Please let us know if you encounter any problems: https://ignite.apache.org/community/resources.html#ask Regards, Maxim Muzafarov on behalf of Apache Ignite community.

Re: [EXTERNAL] Re: Replace or Put after PutAsync causes Ignite to hang

2020-01-13 Thread Maxim Muzafarov
Igniters, Bump this thread up. It seems the issue [1] is important but still unassigned. [1] https://issues.apache.org/jira/browse/IGNITE-12033 On Thu, 15 Aug 2019 at 15:01, Pavel Tupitsyn wrote: > Hi Eduard, > > Yes, that is the same issue. > The workaround above is not enough, because SetSy

Critical issues pripority for the upcoming Apache Ignite 2.8 Release

2019-12-18 Thread Maxim Muzafarov
Igniters, The 2.8 Release of Apache Ignite is coming. Hopefully, it will occur by the end of January 2020. The list of blocker and critical issues [1] related to the 2.8 release has been created. All blocker issues will definitely be fixed for the upcoming release. My point is related to the cri

Re: Handling Of Partition loss

2019-09-18 Thread Maxim Muzafarov
Hello, 1) I'm not sure that I've cached your idea right, but is this method are you looking for? org.apache.ignite.IgniteCache#lostPartitions [1] 2) I doubt that it is possible since resetLostPartitions method accepts only cache names. [1] https://ignite.apache.org/releases/latest/javadoc/org/a

Re: Node failure with "Failed to write buffer." error

2019-09-02 Thread Maxim Muzafarov
Generally, I don't know. The estimated date was - 27 august, but by this time there are some `blocker` issues still open. In my humble opinion, they can be fixed until the end of September. On Mon, 2 Sep 2019 at 14:58, ihalilaltun wrote: > > I am sorry but it has been a long time that we changed

Re: Node failure with "Failed to write buffer." error

2019-09-02 Thread Maxim Muzafarov
Hello, Dmitry is already working over the issue [1] you faced above. Probably, it will be included to the next 2.7.6 Apache Ignite release. According to [2] confluence page, the release will be ready when all the `blocker` issues will be solved. Can you also clarify what type the IO issues you fa

Re: Node failure with "Failed to write buffer." error

2019-08-23 Thread Maxim Muzafarov
It seems to me that it is a bug in the implementation when mmap set to `false` value. I'll try to check. Just for my curious, can you clarify why the `false` value is used? According to the comment [1] using mmap=true with the LOG_ONLY mode shows the best pefromance results. [1] https://issues.a

Re: Rebalancing only to backups

2019-08-23 Thread Maxim Muzafarov
Hello, I would not recommend using NONE rebalance mode since it is not stable enough (this is true, that cache for this mode will not be rebalanced, but you always should keep in mind then your 6th node return to the cluster you should call manual rebalancing -- method rebalance() on cache API).

Re: Node failure with "Failed to write buffer." error

2019-08-23 Thread Maxim Muzafarov
Hello, Did you change IGNITE_WAL_MMAP system variable? (true by default). Can you also attach your Ignite configuration file? I've checked the log you provided and it seems to me that during the file rollover WAL procedure the current wal-file is closed, but the WalWriter thread corresponding to

Re: Is there a way to use IgniteQueue with AffinityKey?

2019-06-28 Thread Maxim Muzafarov
Hello googy, Purely curious, why do you want to use IgniteQueue like an IgniteCache? What is your goal? Please note, that such Ignite data structures (base on Ignite caches) considered being reworked in future [1]. So, I think it's a good starting thing for collecting user experience with it :-)

Re: Checking for rebalancing?

2019-06-28 Thread Maxim Muzafarov
ing configuration, etc) but it felt like the > kind of thing that people must be doing, whether with something like Ansible > or Kubernetes. > > Regards, > Stephen > > On 27 Jun 2019, at 19:01, Maxim Muzafarov wrote: > > Stephen, > > AFAIK there is no such public opt

Re: Checking for rebalancing?

2019-06-27 Thread Maxim Muzafarov
Stephen, AFAIK there is no such public option to wait for all the cluster caches are fully rebalanced. Please, take a look here [1]. This is an internal method which returns the future (will be completed when cache group rebalance is finished) and it's not exposed to any Ignites public API, so I d