wangxianghu edited a comment on pull request #4969:
URL: https://github.com/apache/hudi/pull/4969#issuecomment-1062572923


   > Do we really see a need for chained post processor just for 
jsonKafkaSource. Unless or otherwise required, don't want to add them. if you 
know of valid use-case, let me know.
   
   @nsivabalan thanks for your review
   There might be fewer usage scenarios compare to Transformer
   
   But, in our companay, we use maxwell to subscribe binlogļ¼Œso I add a 
MaxwellJsonKafkaPostprocessor to extract the data we need.
   
   sometimes, there might be some data quality problems, for example, some not 
nullable fileds have null values, we have to fix it through processor, 
   sometimes, we alse need to encode some fields for safety purpose, 
MaxwellJsonKafkaPostprocessor + user-defined processor could be a choice.
   
   So I think somebody else who use maxwell may need this feature too


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Reply via email to