[DISCUSS] KIP-1328: Dead Letter Queue Support for DSL Dropped Records

[권대호]

  Hi all,        
  I'd like to start a discussion on KIP-1328: Dead Letter Queue Support for DSL 
Dropped Records.                                                                
                                              
                                                                                
               
  KIP: 
https://cwiki.apache.org/confluence/display/KAFKA/KIP-1328%3A+Dead+Letter+Queue+Support+for+DSL+Dropped+Records
                                                                                
        
  JIRA: https://issues.apache.org/jira/browse/KAFKA-20439                       
                                                                                
                                              
                                                         
  Kafka Streams DSL operators currently drop certain records silently (e.g., 
null key/value, expired window records) with only a log warning and a metric 
increment. There is no way to capture these records  
  for analysis or reprocessing.                                                 
                                                                                
                                               
                                         
  This KIP proposes adding a writeToDlq() method to ProcessingContext, allowing 
DSL operators to route dropped records to the existing DLQ infrastructure 
introduced in KIP-1034.                              
                                                                                
                                                                                
                                               
  Looking forward to your feedback.                                             
                                                                                
                                               
                                                                                
                                                                                
                                               
  Thanks,                                                                       
                                                                                
                                               
  Daeho Kwon