I have a pair of services. One dispatches commands to the other for processing.
My consumer sometimes fails to execute commands as a result of transient errors. To deal with this, commands are retried after an exponentially increasing delay up to a maximum of 4 times. (Delays: 1hr, 2hr, 4hr, 8hr.) What's the standard way to set up something like this using Kafka? The only solution I've found so far is to setup 5 topics (main_topic, delayed_1hr, delayed_2hr, delayed_4hr,delayed_8hr), and then have pollers that poll each of these topics, enforce delays, and escalate messages from one topic to another if errors occur. Thanks in advance for any pointers you guys can give me, -John
