Thanks Mark for getting back with a detailed explanation, I just had one more question, do you think there will be issue with using different version of Kafka broker & consumekafka processor
On Fri, Dec 17, 2021 at 8:45 PM Mark Payne <marka...@hotmail.com> wrote: > Midhun, > > There are several ConsumeKafka processors. They come in two flavors: > > ConsumeKafka_<client version> > ConsumeKafkaRecord_<client version> > > Typically, the ConsumeKafkaRecord processors are preferable, as they allow > writing out multiple messages into the same FlowFile, which is FAR more > efficient in terms of both processing performance (throughput) and memory > utilization. > > But ideally you want to use the version that matches your Kafka brokers. > So if you’re using Kafka 2.6 you should use ConsumeKafka_2_6. If you are > using Kafka 2.0 - 2.5 you should use ConsumeKafka_2_5 and so on. > > Thanks > -Mark > > > > On Dec 17, 2021, at 7:55 AM, Midhun Mohan <midhun.mo...@esginc.us> > wrote: > > > > Hi Team, > > > > I remember seeing a Kafka consumer named ConsumeKafka in version lower > than > > 1.15 , do we have replacement for that processor in 1.15 > > > > -- > > > > > > Regards, > > Midhun Mohan > > -- Regards, Midhun Mohan
