ruchirvaninasdaq edited a comment on issue #1285: URL: https://github.com/apache/camel-kafka-connector/issues/1285#issuecomment-969436423
Following customizations I am doing withing the camel connectors: 1. I have custom S3Object Conveter (to use my custom Seralizer) 2. I have added promethues metric collector gauge to Kafkaconnect. In camel source task I update metric with every message pull from s3. 3. I have some initialization process on intilization of Kafkaconnect (push some message to our kafka cluster to wake up other processes). For this, I add my custom method in CamelAws2S3SourceConnector method. I have also updated the apache-camel-s3 for my custom reading process. I really appreciate the method/feture you added on my request for moveAfterRead. But we need more custom messagefactory class to validate the mesage even before we send to connector (if it fails, we dont want to keep in same bucket but move-it to `FAILED` prefix on the outputbucket). So we have custom logic added in camel-s3 package also for that. If you have any better recommended approch please let me know. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@camel.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
