Hi Varun, This can be related to this issue: https://issues.apache.org/jira/browse/FLINK-8226 <https://issues.apache.org/jira/browse/FLINK-8226> which is currently fixed on the master.
Could you please try the current master to see if the error persists? Thanks, Kostas > On Jan 15, 2018, at 4:09 PM, Varun Dhore <varundhor...@gmail.com> wrote: > > > >> Hello Flink community, >> >> I have encountered following exception while testing 1.4.0 release. This >> error is occurring intermittently and my CEP job keeps restarting after this >> exception. I am running the job with Event time semantics and checkpoints >> enabled. >> >> >> java.lang.RuntimeException: Exception occurred while processing >> valve output watermark: >> at >> org.apache.flink.streaming.runtime.io.StreamInputProcessor$ForwardingValveOutputHandler.handleWatermark(StreamInputProcessor.java:289) >> at >> org.apache.flink.streaming.runtime.streamstatus.StatusWatermarkValve.findAndOutputNewMinWatermarkAcrossAlignedChannels(StatusWatermarkValve.java:173) >> at >> org.apache.flink.streaming.runtime.streamstatus.StatusWatermarkValve.inputWatermark(StatusWatermarkValve.java:108) >> at >> org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:188) >> at >> org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:69) >> at >> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:263) >> at >> org.apache.flink.runtime.taskmanager.Task.run(Task.java:702) >> at java.lang.Thread.run(Thread.java:745) >> Caused by: java.lang.RuntimeException: Error while adding data >> to RocksDB >> at >> org.apache.flink.contrib.streaming.state.RocksDBValueState.update(RocksDBValueState.java:102) >> at >> org.apache.flink.cep.operator.AbstractKeyedCEPPatternOperator.updateNFA(AbstractKeyedCEPPatternOperator.java:276) >> at >> org.apache.flink.cep.operator.AbstractKeyedCEPPatternOperator.onEventTime(AbstractKeyedCEPPatternOperator.java:248) >> at >> org.apache.flink.streaming.api.operators.HeapInternalTimerService.advanceWatermark(HeapInternalTimerService.java:275) >> at >> org.apache.flink.streaming.api.operators.InternalTimeServiceManager.advanceWatermark(InternalTimeServiceManager.java:107) >> at >> org.apache.flink.streaming.api.operators.AbstractStreamOperator.processWatermark(AbstractStreamOperator.java:946) >> at >> org.apache.flink.streaming.runtime.io.StreamInputProcessor$ForwardingValveOutputHandler.handleWatermark(StreamInputProcessor.java:286) >> ... 7 more >> Caused by: java.lang.IllegalStateException: Could not find id >> for entry: SharedBufferEntry(ValueTimeWrapper(Event(id: 1,name: ”e1”, >> timestamp: 1515593398897), 1515593398897, 0), [SharedBufferEdge(null, 1)], 2) >> at >> org.apache.flink.util.Preconditions.checkState(Preconditions.java:195) >> at >> org.apache.flink.cep.nfa.SharedBuffer$SharedBufferSerializer.serialize(SharedBuffer.java:972) >> at >> org.apache.flink.cep.nfa.SharedBuffer$SharedBufferSerializer.serialize(SharedBuffer.java:839) >> at >> org.apache.flink.cep.nfa.NFA$NFASerializer.serialize(NFA.java:919) >> at >> org.apache.flink.cep.nfa.NFA$NFASerializer.serialize(NFA.java:839) >> at >> org.apache.flink.contrib.streaming.state.RocksDBValueState.update(RocksDBValueState.java:99) >> ... 13 more >> >> >> Thanks, >> Varun
