KafkaStream marshaller error

2020-07-02 Thread Maxim Volkomorov
I have 1 DataNod and 1 Service with streaming. I have a filter for service: public boolean apply(ClusterNode node) { Boolean dataNode = node.attribute("kafkastreamer.service.node"); return dataNode != null && dataNode; } I have a marshalling error java.io.NotSerializableException: org.apach

Hot service upgrade without downtime

2020-07-02 Thread Sergey Antonov
Hello, Igniters! I’d like to know, does Ignite have ability to upgrade user’s service in service grid without downtime? Let’s imagine that I have grid with 2 nodes. Each node has deployed instance of service. I’d like to upgrade service version without service’s downtime. At the moment I have

question about node segment and split brain

2020-07-02 Thread bbweb
Hi,  we are considering ignite for mission critical system and concerning about node segmentation and split brain problem. I searched for current documents and suggestions but still have some questions in the following, please help and thanks in advance: 1、For long gc case , when a node has long gc

Re: Hot service upgrade without downtime

2020-07-02 Thread Aravind J
Hi , If you are ready to port your cluster to kubernetes, these steps can be handled in much more cleaner way , even though technically it does the same steps mentioned above . With just "kubectil patch" command , you can achieve this . Regards Aravind On Thu, 2 Jul 2020 at 15:39, Sergey Antono

Re: ScanQuery Transform: fail to deserialze! ignite 2.8.0, java 11

2020-07-02 Thread Rafael Troilo
Hi Denis, thank you for your quick response. Unfortunately even avoiding lambdas or anonymous classes didn't solve this problem. And was my first thought for this problem too. With: MyFilter.java import org.apache.ignite.lang.IgniteClosure; public class MyFilter implements IgniteClosure {

RE: Hot service upgrade without downtime

2020-07-02 Thread Sergey Antonov
Hi, Aravind. Thank you for reply! I don’t think that kubernetes may help in my case. The main problem is a requirement to cancel service during service upgrade [1]. So, in that moment, the service will be stopped and other application can’t use them. [1] https://apacheignite.readme.io/docs/s

Re: Hot service upgrade without downtime

2020-07-02 Thread Ilya Kasnacheev
Hello! I don't see why you can't start the new service under new name, and then stop the old service when new service is already available. Regards, -- Ilya Kasnacheev чт, 2 июл. 2020 г. в 16:35, Sergey Antonov : > Hi, Aravind. > > > > Thank you for reply! I don’t think that kubernetes may he

Re: ScanQuery Transform: fail to deserialze! ignite 2.8.0, java 11

2020-07-02 Thread Ilya Kasnacheev
Hello! Did you enable peer class loading? You need to either enable peer class loading, or put your filter class(es) to all server nodes. Regards, -- Ilya Kasnacheev чт, 2 июл. 2020 г. в 15:09, Rafael Troilo : > Hi Denis, > > thank you for your quick response. Unfortunately even avoiding lamb

Re: Ignite node log file setup

2020-07-02 Thread Ilya Kasnacheev
Hello! """ In Spring syntax it will be #{systemProperties['gridName']}: """ Regards, -- Ilya Kasnacheev ср, 1 июл. 2020 г. в 12:01, kay : > Hello, I'm waiting for reply :) > > How can I set system property to use in ignite config file?? > I set and got a error so , attacted log file before.

Re: Re:

2020-07-02 Thread Ilya Kasnacheev
Hello! I've never seen this issue so I don't know. I would really appreciate a reproducer. Regards, -- Ilya Kasnacheev ср, 1 июл. 2020 г. в 08:16, BEELA GAYATRI : > > > Hi Kasnacheev, > > > >The below behavior is occurring randomly after stopping the node. Do we > have any resolution apar

Re: CusterGroup topology unexpectedly empty

2020-07-02 Thread Ilya Kasnacheev
Hello! Please note that ClusterGroups usually do not recompute. This means, if you had two nodes with _roleAttribute "True", and they all went away, the group is now empty, even as two new nodes has joined with the same attribute. You need to re-create ClusterGroup in order to refresh it. Please

Re: KafkaStream marshaller error

2020-07-02 Thread Ilya Kasnacheev
Hello! You should probably start KafkaStreamer on remote node when the service is initialized (init()), instead of starting it in e.g. constructor and trying to send it to remote node. Avoid putting fat instances in the fields of service/compute/predicate classes. Regards, -- Ilya Kasnacheev

Re: ScanQuery Transform: fail to deserialze! ignite 2.8.0, java 11

2020-07-02 Thread Denis Magda
Ilya, Yes, Rafael confirmed that the peer-class-loading is set. Still does not work, this time complaining that the MyFilter class is not found. PeerClassLoading is active as far as I can tell. At least in both server/client ignite config Is this a known limitation or regression? Should we file

Re: ScanQuery Transform: fail to deserialze! ignite 2.8.0, java 11

2020-07-02 Thread Ilya Kasnacheev
Hello! I would like to start with a reproducer. Rafael, can you please throw together a runnable stand-alone reproducer of this issue? Thanks, -- Ilya Kasnacheev чт, 2 июл. 2020 г. в 17:28, Denis Magda : > Ilya, > > Yes, Rafael confirmed that the peer-class-loading is set. > > Still does not

Re: KafkaStream marshaller error

2020-07-02 Thread Maxim Volkomorov
Now i disabled node Filtering. You mean i started KafkaStreamer in init()? I started KafkaStreamer like: @Override public void execute(ServiceContext ctx) throws Exception { log.info("KafkaStreamerService starting ..."); kafkaStreamer.start(); log.info("KafkaStreame

Re: KafkaStream marshaller error

2020-07-02 Thread Ilya Kasnacheev
Hello! Where do you assign kafkaStreamer field? Regards, -- Ilya Kasnacheev чт, 2 июл. 2020 г. в 18:46, Maxim Volkomorov <2201...@gmail.com>: > Now i disabled node Filtering. You mean i started KafkaStreamer in > init()? > I started KafkaStreamer like: > > @Override > public void exec

Re: KafkaStream marshaller error

2020-07-02 Thread Maxim Volkomorov
public class KafkaStreamerService implements Service { public static final String SERVICE_NAME = "KafkaStreamerService"; private static final long serialVersionUID = 1L; @IgniteInstanceResource private Ignite ignite; private KafkaStreamer kafkaStreamer = new KafkaStreamer<>();

Re: KafkaStream marshaller error

2020-07-02 Thread Ilya Kasnacheev
Hello! You should do the assignment in init() method. Don't create KafkaStreamer before service is sent over and is ready for initialization. Regards, -- Ilya Kasnacheev чт, 2 июл. 2020 г. в 18:54, Maxim Volkomorov <2201...@gmail.com>: > public class KafkaStreamerService implements Service {

Re: KafkaStream marshaller error

2020-07-02 Thread Maxim Volkomorov
Ok, if i put an assignment to init(), how will i start it in execute() method, and stop in canсel()? This example was taken here http://apache-ignite-users.70518.x6.nabble.com/Kindly-tell-me-where-to-find-these-jar-files-td12649.html чт, 2 июл. 2020 г. в 18:57, Ilya Kasnacheev : > Hello! > > You

Re: KafkaStream marshaller error

2020-07-02 Thread Ilya Kasnacheev
Hello! init() will be called before execute() and stop(). To be extra sure, you can check for null. Regards, -- Ilya Kasnacheev чт, 2 июл. 2020 г. в 19:06, Maxim Volkomorov <2201...@gmail.com>: > Ok, if i put an assignment to init(), how will i start it in execute() > method, and stop in can

Re: KafkaStream marshaller error

2020-07-02 Thread Maxim Volkomorov
oh sorry, I didn’t immediately understand what you mean.Thank you! чт, 2 июл. 2020 г. в 19:25, Ilya Kasnacheev : > Hello! > > init() will be called before execute() and stop(). > > To be extra sure, you can check for null. > > Regards, > -- > Ilya Kasnacheev > > > чт, 2 июл. 2020 г. в 19:06, Maxi