Checkpointing: offload serialization of PEs from the event processing thread
----------------------------------------------------------------------------
Key: S4-40
URL: https://issues.apache.org/jira/browse/S4-40
Project: Apache S4
Issue Type: Improvement
Affects Versions: 0.4
Reporter: Matthieu Morel
Assignee: Matthieu Morel
Fix For: 0.4
Checkpointing preserves PE state by serializing PE data then storing the
serialized data on stable storage.
Currently, the storage operation is asynchronous, but the serialization of PEs
is performed by the event processing thread. Some PEs have complex data
structures that take time to serialize, adding latency to event processing.
This affects the overall response time and can also lead to queues overflows
and event loss.
Therefore, we must perform the serialization asynchronously, and make sure to
prevent any race condition (PE data updated by normal event processing while PE
being serialized on another thread).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
