FileNotFoundException when restoring checkpoint

2017-07-17 Thread Shai Kaplan
Hi. I'm running Flink 1.3.1 with checkpoints stored in Azure blobs. Incremental checkpoints feature is on. The job is trying to restore a checkpoint and consistently gets: java.lang.IllegalStateException: Could not initialize keyed state backend. at

RE: KryoException: Encountered unregistered class ID

2017-06-06 Thread Shai Kaplan
s the only possible way at the moment. On 6 June 2017 at 5:45:12 PM, Shai Kaplan (shai.kap...@microsoft.com<mailto:shai.kap...@microsoft.com>) wrote: No. This way you can set default serializers for specific classes, I want to change the default serializer that Kryo uses when it can't f

RE: KryoException: Encountered unregistered class ID

2017-06-06 Thread Shai Kaplan
. You can also specify it directly: StreamExecutionEnvironment.registerTypeWithKryoSerializer(YourClass.class, TaggedFieldSerializer.class). Does the above work? On 6 June 2017 at 5:09:21 PM, Shai Kaplan (shai.kap...@microsoft.com<mailto:shai.kap...@microsoft.com>) wrote: I understand t

RE: KryoException: Encountered unregistered class ID

2017-06-06 Thread Shai Kaplan
serializer? From: Tzu-Li (Gordon) Tai [mailto:tzuli...@apache.org] Sent: Sunday, June 04, 2017 3:28 PM To: Shai Kaplan <shai.kap...@microsoft.com>; user@flink.apache.org Subject: Re: KryoException: Encountered unregistered class ID Hi Shai, Flink’s Kryo registrations do not allow spec

KryoException: Encountered unregistered class ID

2017-06-04 Thread Shai Kaplan
Hi. I'm running a job from a savepoint. I've changed one of the classes stored in state. When I try to load the value from the state I get "com.esotericsoftware.kryo.KryoException: Encountered unregistered class ID: 97". I tried to understand if the problem arise from the nature of the change,

RE: Flink checkpointing gets stuck

2017-02-23 Thread Shai Kaplan
And now it's happening again -Original Message- From: Shai Kaplan [mailto:shai.kap...@microsoft.com] Sent: Wednesday, February 22, 2017 12:02 PM To: user@flink.apache.org Subject: RE: Flink checkpointing gets stuck I changed the checkpoint interval to 30 minutes, and also switched

RE: Flink checkpointing gets stuck

2017-02-22 Thread Shai Kaplan
Can you check the TaskManager and JobManager logs if other errors are reported? Feel free to share them. Then I could help with going over them. – Ufuk On Tue, Feb 21, 2017 at 2:47 PM, Shai Kaplan <shai.kap...@microsoft.com> wrote: > Hi. > > I'm running a Flink 1.2 job with a 10 secon

RE: Flink checkpointing gets stuck

2017-02-21 Thread Shai Kaplan
D=0> What is the configuration on which you running the job ? What is the RocksDB predefined option you are using ? Regards, Vinay Patil On Tue, Feb 21, 2017 at 7:13 PM, Shai Kaplan [via Apache Flink User Mailing List archive.] <[hidden email]> wrote: Hi. I'm running a Flink 1.2 j

Flink checkpointing gets stuck

2017-02-21 Thread Shai Kaplan
Hi. I'm running a Flink 1.2 job with a 10 seconds checkpoint interval. After some running time (minutes-hours) Flink fails to save checkpoints, and stops processing records (I'm not sure if the checkpointing failure is the cause of the problem or just a symptom). After several checkpoints that