Chris Riccomini created SAMZA-465:
-------------------------------------
Summary: Use coordinator stream and eliminate CheckpointManager
Key: SAMZA-465
URL: https://issues.apache.org/jira/browse/SAMZA-465
Project: Samza
Issue Type: Sub-task
Components: container, kafka
Affects Versions: 0.9.0
Reporter: Chris Riccomini
Assignee: Chris Riccomini
Fix For: 0.9.0
SAMZA-448 introduced a coordinator stream into Samza, but still kept
CheckpointManagers. This means that master currently has two streams, which is
totally unnecessary. We should eliminate the CheckpointManager, and use the
coordinator stream instead.
This work will involve modifying the JobCoordinator to continue reading
messages from the coordinator stream even after it starts up. This is required
because a container may fail and restart. When it does so, the offset that it
receives from the JobCoordinator (via the HTTP JSON server) must be up to date.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
