Balazs Kossovics created STORM-1873:
---------------------------------------
Summary: Reemit late tuples in windowed mode
Key: STORM-1873
URL: https://issues.apache.org/jira/browse/STORM-1873
Project: Apache Storm
Issue Type: Improvement
Components: storm-core
Reporter: Balazs Kossovics
Currently late tuples are just logged (and acknowledged in the coming 1.0.2),
but in our use-case it would be desirable to emit them on a different stream
than the default.
I implemented a first version, where every windowed bolt are going to have a
'_late' stream by default, and component-specific parameter
(Config.TOPOLOGY_BOLTS_EMIT_LATE_TUPLE) the definer of the bolt could turn on
or off the emission of the late tuples on this stream.
One could turn on the emission of late tuples with a builder method like this:
new MyWindowedBolt()
.withTimestampField("timestamp")
.withLateTupleEmission(true)
.withWindow(
new BaseWindowedBolt.Duration(1,
TimeUnit.MINUTES),
new BaseWindowedBolt.Duration(1,
TimeUnit.SECONDS)
);
What do you think about it?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)