Hi all,

Recently I've been encountering an issue where some external dependencies
or process causes writes within my JDBCSink to fail (e.g. something is
being inserted with an explicit constraint that never made it's way there).
I'm trying to see if there's a pattern or recommendation for handling this
similar to a dead-letter queue.

Basically - if I experience a given number of failures (> max retry
attempts) when writing to my JDBC destination, I'd like to take the record
that was attempted and throw it into a Kafka topic or some other
destination so that it can be evaluated at a later time.

Are there any well defined patterns or recommended approaches around this?

Thanks,

Rion

Reply via email to