Hi Sridhar,
From looking at your code:
1) The “KafkaDataSource” is a custom source that you implemented? Does this
source buffer anything?
2) The getStreamSource2 seems to return again a "new
KafkaDataSource”. Can this be a problem?
3) You are working on processing time and you are simply detec
One more point to add.
I disabled checkpoints (by commenting out code that calls
enableCheckpointing()) and re-ran the job this time with plenty of memory
to the job manager
~/flink-1.3.2/bin/yarn-session.sh -n 4 -jm 24576 -tm 24576 -s 2 -d
At the Jobmanager, I am still hitting:
2017-09-25 06:4
Here is the snippet :
public interface Rule {
DataStream run();
}
public class Rule1 implements Rule {
private static final String RULE_ID = "Rule1"
@Override
public DataStream run() {
Pattern MyMessage1Pattern =
Pattern.begin("first").
I talked a bit with Kostas on what may be happening here.
It could be that your patterns are not closing, which depends on the pattern
construction of your CEP job.
Could you perhaps provide an overview / code snippet of what your CEP job is
doing?
Looping Kostas (in CC) also to this thread as
Thanks for the reply. Well, tracing back to the root cause, I see the
following:
1. At the Job manager, the Checkpoint times are getting worse :
Jobmanager :
Checkpoint times are getting worse progressively.
2017-09-16 05:05:50,813 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator
Hi Sridhar,
Sorry that this didn't get a response earlier.
According to the trace, it seems like the job failed during the process, and
when trying to automatically restore from a checkpoint, deserialization of a
CEP `IterativeCondition` object failed. As far as I can tell, CEP operators
are just
I am running Flink 1.3.0 against Kafka 0.10. I managed to bring the flink
cluster up and have been running my flink CEP job for more than 3 hours
when I see the following exception :
The messages consumed from Kafka are protobuf messages and I use a protobuf
serializer. i have no clue as to where
