Re: In AbstractRocksDBState, why write a byte 42 between key and namespace?

2016-07-17 Thread Aljoscha Krettek
@Stephan It's not about the serializers not being able to read the key. The key/namespace are never read again. It's just about the serialized form possibly being ambiguous since we don't control the TypeSerializers and there might be wanky var-length encoding schemes and what not. On Fri, 15 Jul

[jira] [Created] (FLINK-4227) Add Heron (heronstreaming.io) comparison to features page

2016-07-17 Thread Suminda Dharmasena (JIRA)
Suminda Dharmasena created FLINK-4227: - Summary: Add Heron (heronstreaming.io) comparison to features page Key: FLINK-4227 URL: https://issues.apache.org/jira/browse/FLINK-4227 Project: Flink

custom control messages from source

2016-07-17 Thread Chen Qin
Hi there, So far, checkpoint trigger is hardcoded in CheckpointCorrdinator which triggered periodically and push control messages to task managers. It was implemented orthogonal to business logics implemented in jobs. Our scenario requires master pipeline flow control messages along with events i