Hi Rion, We have implemented such a solution with Sink Wrapper.
Regards, Maciek śr., 14 lip 2021 o 16:21 Rion Williams <rionmons...@gmail.com> napisał(a): > > Hi all, > > Recently I've been encountering an issue where some external dependencies or > process causes writes within my JDBCSink to fail (e.g. something is being > inserted with an explicit constraint that never made it's way there). I'm > trying to see if there's a pattern or recommendation for handling this > similar to a dead-letter queue. > > Basically - if I experience a given number of failures (> max retry attempts) > when writing to my JDBC destination, I'd like to take the record that was > attempted and throw it into a Kafka topic or some other destination so that > it can be evaluated at a later time. > > Are there any well defined patterns or recommended approaches around this? > > Thanks, > > Rion -- Maciek Bryński