RE: Is ID generator split brain compliant?

2018-10-11 Thread abatra
It worked. Directory set for IGNITE_HOME was getting cleaned up because it wasn't on a mount point or docker volume. Once I set IGNITE_HOME to a directory that persisted between container stop and start, the ID generator worked as expected. -- Sent from:

RE: Is ID generator split brain compliant?

2018-10-10 Thread abatra
Server logs -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

RE: Is ID generator split brain compliant?

2018-10-10 Thread abatra
I did not see any locks related logs. I did set consistent ID to make sure Ignite looks for the same folder on a restart. But it did not work. On docker restart i.e. the ID generator starts generating a sequence from the initial value. I am attaching the ignite logs for server restart in this

RE: Is ID generator split brain compliant?

2018-10-09 Thread Stanislav Lukyanov
@ignite.apache.org Subject: Re: Is ID generator split brain compliant? I believe it won't work either. I will try it soon and share the result. Could you please share some pointers that I should look at for debugging persistence? I have org.apache.ignite=DEBUG in logs and IGNITE_QUITE set to false. There a lot

Re: Is ID generator split brain compliant?

2018-10-01 Thread abatra
I believe it won't work either. I will try it soon and share the result. Could you please share some pointers that I should look at for debugging persistence? I have org.apache.ignite=DEBUG in logs and IGNITE_QUITE set to false. There a lot of logs, most of which I can not make sense of w.r.t.

Re: Is ID generator split brain compliant?

2018-09-29 Thread Pavel Pereslegin
Hello Ankit, I'm not an expert in docker, but for me it looks like you have a problem with overall cache persistence (not only with AtomicSequence), could you try to put some values into cache and check their availability after the restart? пт, 28 сент. 2018 г. в 23:45, abatra : > To give more

Re: Is ID generator split brain compliant?

2018-09-28 Thread abatra
To give more information on how I restart the server: I run server and client inside their own respective docker container and I issue 'docker stop' for server node container ID to stop and then restart it. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Is ID generator split brain compliant?

2018-09-28 Thread abatra
I tried debugging it a bit. Now, I am running only 1 server node. I am running other node as client. Even with single server node, the atomic sequence is reset to initial value after the server node restarts. I checked the IGNITE_HOME folder, on every restart, the contents are recreated with a

Re: Is ID generator split brain compliant?

2018-09-28 Thread Pavel Pereslegin
Ankit, > 1. I run two nodes in the cluster. I checked 2 nodes cluster restart (simultaneously, 2 processes on same machine) with the same result - after restart the "current" value != "initial" value. > 2. I restart the entire node and hence the server gets restarted. I gave this example only

Re: Is ID generator split brain compliant?

2018-09-28 Thread abatra
There are only two differences in the way you tried the example: 1. I run two nodes in the cluster. 2. I do not stop and configure the server while the JVM is running. I restart the entire node and hence the server gets restarted. Otherwise, I am not sure how is that working out for you. Also,

Re: Is ID generator split brain compliant?

2018-09-27 Thread Pavel Pereslegin
Ankit, I tried test your example with the following code: configure(); System.out.println("Initial value: " + getCurrentValue("sequence")); for (int i = 0; i < 10_000; i++) incrementAndGet("sequence"); stop(); configure(); System.out.println("Value after restart: " +

Re: Is ID generator split brain compliant?

2018-09-27 Thread abatra
*Configuration* private static final String STORAGE_PATH = "/existingDirectory/ignite/data/storage";private static final String WAL_PATH = "/existingDirectory/ignite/data/wal";private static final String WAL_ARCHIVE_PATH = "/existingDirectory/ignite/data/wal/archive"; @Override

Re: Is ID generator split brain compliant?

2018-09-27 Thread Pavel Pereslegin
Ankit, I checked sequence and atomic on Ignite 2.6 with the following code: try (Ignite ignite = Ignition.start("example-persistent-store.xml")) { ignite.active(true); IgniteAtomicSequence seq = ignite.atomicSequence("sequence", 0, true); IgniteAtomicLong atomic =

Re: Is ID generator split brain compliant?

2018-09-27 Thread abatra
Hi Anton, With persistence enabled, if I reboot the nodes in the cluster, ID generator starts generating ID from 1 after the nodes are back up. My expectation is that that the latest generated ID(s) will be persisted across cluster reboot and the ID generator will start from the latest persisted

Re: Is ID generator split brain compliant?

2018-09-26 Thread Pavel Pereslegin
Anton, IgniteAtomicSequence should work fine with persistence. Ankit, what issue did you encounter when using IgniteAtomicSequence with enabled persistence? What version of Apache Ignite you are using? вт, 25 сент. 2018 г. в 15:11, Anton Vinogradov : > Denis, > > As far as I understand,

Re: Is ID generator split brain compliant?

2018-09-25 Thread Anton Vinogradov
Denis, As far as I understand, question is about IgniteAtomicSequence? We fixed IgniteSet to be persisted and recovered properly. Pavel Pereslegin, Could you please check whether we have the same issue with IgniteAtomicSequence? сб, 22 сент. 2018 г. в 4:17, Denis Magda : > So far, it looks

Re: Is ID generator split brain compliant?

2018-09-21 Thread Denis Magda
> > So far, it looks pretty good except that it does not provide persistence > out > of the box. But I can work around it by backing latest generated ID in a > persistent cache and initializing ID generator with the latest value on a > cluster restart. Sounds like a good solution. *Anton*, I do

Re: Is ID generator split brain compliant?

2018-09-19 Thread Jörn Franke
I think you need to also look at the processes that are using the id in case of a split brain scenario. A unique identifier is always some centralistic approach either it is done by one central service or a central rule that is enforced in a distributed fashion. For instance, in your case you

Is ID generator split brain compliant?

2018-09-19 Thread abatra
Hi, I have a requirement to create a distributed cluster-unique ID generator microservice. I have done a PoC on it using Apache Ignite ID Generator. I created a 2 node cluster with two instances of microservices running on each node. Nodes are in the same datacenter (in fact in the same