The current implementation works like below: 1. Unbundles the received bundle. 2. Puts the decompressed and deserialized message into queue. If queue is disk-based, message will be serialized again. 3. At the same time, checkpoints the messages.
The problem is that it consumes huge memory, and also there are duplicate deserialization and serialization operation overheads. When I refactor queue, I'll also refactor the checkpoint mechanism. -- Best Regards, Edward J. Yoon CEO at DataSayer Co., Ltd.
