Hi all,
I'd like to propose KIP-1348, which adds a built-in 
LogAndContinueProductionExceptionHandler to Kafka Streams.
After KIP-1034 landed DLQ support, deserialization and processing each have 
both a fail and a continue handler — but production only has 
DefaultProductionExceptionHandler, which always fails. Even with a DLQ topic 
configured, the app shuts down. Users who want to skip a bad record and keep 
going have to write a custom handler, which isn't the case for the other two 
error types.
The new handler logs the error, routes the record to the DLQ (if configured), 
and returns RESUME. It follows the exact same pattern as 
LogAndContinueExceptionHandler and LogAndContinueProcessingExceptionHandler. No 
new configs — users opt in via the existing production.exception.handler 
setting. The default stays fail.
KIP: 
https://cwiki.apache.org/confluence/display/KAFKA/KIP-1348%3A+Complete+Built-in+Exception+Handler+Symmetry+with+LogAndContinueProductionExceptionHandler
Looking forward to your feedback.
Thanks,
Ankur Sinha

Reply via email to