Re: Error while adding data to RocksDB: No more bytes left

2016-09-30 Thread Shannon Carey
he.org>> Date: Friday, September 30, 2016 at 3:58 AM To: <user@flink.apache.org<mailto:user@flink.apache.org>> Cc: Stephan Ewen <se...@apache.org<mailto:se...@apache.org>> Subject: Re: Error while adding data to RocksDB: No more bytes left Agree with Stefan, let's see if

Re: Error while adding data to RocksDB: No more bytes left

2016-09-30 Thread Stephan Ewen
ClassResolver.readClass( > DefaultClassResolver.java:115) > at com.esotericsoftware.kryo.Kryo.readClass(Kryo.java:641) > at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:752) > at org.apache.flink.api.java.typeutils.runtime.kryo. > KryoSerializer.deserialize(KryoSerializer.ja

Re: Error while adding data to RocksDB: No more bytes left

2016-09-30 Thread Stephan Ewen
om.esotericsoftware.kryo.Kryo.readClass(Kryo.java:641) > at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:752) > at org.apache.flink.api.java.typeutils.runtime.kryo. > KryoSerializer.deserialize(KryoSerializer.java:232) > at org.apache.flink.api.scala.typeutils.CaseClassS

Re: Error while adding data to RocksDB: No more bytes left

2016-09-30 Thread Stefan Richter
> at com.esotericsoftware.kryo.Kryo.readClass(Kryo.java:641) > at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:752) > at > org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.deserialize(KryoSerializer.java:232) > at > org.apache.flink.api.scala.typeutils.CaseClassSerializer.deserialize(CaseClassSeria

Re: Error while adding data to RocksDB: No more bytes left

2016-09-29 Thread Shannon Carey
lassResolver.java:136) ... 52 more From: Stephan Ewen <se...@apache.org<mailto:se...@apache.org>> Date: Wednesday, September 28, 2016 at 1:18 PM To: <user@flink.apache.org<mailto:user@flink.apache.org>> Subject: Re: Error while adding data to RocksDB: No more bytes left Hi

Re: Error while adding data to RocksDB: No more bytes left

2016-09-28 Thread Stephan Ewen
Hi Shannon! The stack trace you pasted is independent of checkpointing - it seems to be from the regular processing. Does this only happen when checkpoints are activated? Can you also share which checkpoint method you use? - FullyAsynchronous - SemiAsynchronous I think there are two

Error while adding data to RocksDB: No more bytes left

2016-09-28 Thread Shannon Carey
It appears that when one of my jobs tries to checkpoint, the following exception is triggered. I am using Flink 1.1.1 in Scala 2.11. RocksDB checkpoints are being saved to S3. java.lang.RuntimeException: Error while adding data to RocksDB at