Re: compatible kafka version to use when using with logstash 7.5.1-1
Hello Manoj, I did kafka rolling upgrade and sorted out errors at both producer and consumer side. but logstash 7.5 is sending empty messages to my kafka brokers where as logstash 2.4 is sending json messages normally(im seeing messages in kafka UI tool) what is the supported Kafka version with logstash 7.5? On 2020/08/07 03:30:55, wrote: > Are you getting any error at kafka broker or producing/consuming message ? > Can you please provide more detail how did you upgrade or what error you are > getting . it all depend how did you upgraded ? > > > > On 8/6/20, 4:13 PM, "Satish Kumar" wrote: > > [External] > > > Hello, > > I upgraded kafka from 0.10 to 2.5.0 and also I upgraded logstash from 2.4 > to 7.5 > > when I have kafka 1.10 and logstash 2.4 the messages used to forward > without any problems. But after the upgrade I'm getting errors in both > logstash and kafka logs so I would like to know what is the compatible > kafka version to use with logstash ( logstash is using kafka-integration > plugin 10.0.0). Please let me know what the compatible version is. I will > do upgrades/downgrades according to that. > > > This e-mail and any files transmitted with it are for the sole use of the > intended recipient(s) and may contain confidential and privileged > information. If you are not the intended recipient(s), please reply to the > sender and destroy all copies of the original message. Any unauthorized > review, use, disclosure, dissemination, forwarding, printing or copying of > this email, and/or any action taken in reliance on the contents of this > e-mail is strictly prohibited and may be unlawful. Where permitted by > applicable law, this e-mail and other e-mail communications sent to and from > Cognizant e-mail addresses may be monitored. > This e-mail and any files transmitted with it are for the sole use of the > intended recipient(s) and may contain confidential and privileged > information. If you are not the intended recipient(s), please reply to the > sender and destroy all copies of the original message. Any unauthorized > review, use, disclosure, dissemination, forwarding, printing or copying of > this email, and/or any action taken in reliance on the contents of this > e-mail is strictly prohibited and may be unlawful. Where permitted by > applicable law, this e-mail and other e-mail communications sent to and from > Cognizant e-mail addresses may be monitored. >
Re: compatible kafka version to use when using with logstash 7.5.1-1
Note that 2.5.1 has just been released. Ismael On Tue, Aug 11, 2020 at 7:54 AM Ismael Juma wrote: > Yeah, I'd recommend upgrading to 2.5.1 (will be announced very soon) or > 2.6.0. > > Ismael > > On Tue, Aug 11, 2020, 7:43 AM REYMOND Jean-max (BPCE-IT - SYNCHRONE > TECHNOLOGIES) wrote: > >> Hi, >> May be this issue : https://issues.apache.org/jira/browse/KAFKA-9669 ? >> >> -Message d'origine- >> De : Satish Kumar >> Envoyé : vendredi 7 août 2020 00:49 >> À : users@kafka.apache.org >> Objet : compatible kafka version to use when using with logstash 7.5.1-1 >> >> Hello, >> >> I upgraded kafka from 0.10 to 2.5.0 and also I upgraded logstash from 2.4 >> to 7.5 >> >> when I have kafka 1.10 and logstash 2.4 the messages used to forward >> without any problems. But after the upgrade I'm getting errors in both >> logstash and kafka logs so I would like to know what is the compatible >> kafka version to use with logstash ( logstash is using kafka-integration >> plugin 10.0.0). Please let me know what the compatible version is. I will >> do upgrades/downgrades according to that. >> >> -- >> L'intégrité de ce message n'étant pas assurée sur Internet, BPCE-IT ne >> peut être tenu responsable de son contenu. Si vous n'êtes pas destinataire >> de ce message, merci de le détruire et d'avertir l'expéditeur. >> The integrity of this message cannot be guaranteed on the Internet. >> BPCE-IT cannot therefore be considered responsible for the contents. If you >> are not the intended recipient of this message, then please delete it and >> notify the sender. >> >> -- >> >
Re: compatible kafka version to use when using with logstash 7.5.1-1
Yeah, I'd recommend upgrading to 2.5.1 (will be announced very soon) or 2.6.0. Ismael On Tue, Aug 11, 2020, 7:43 AM REYMOND Jean-max (BPCE-IT - SYNCHRONE TECHNOLOGIES) wrote: > Hi, > May be this issue : https://issues.apache.org/jira/browse/KAFKA-9669 ? > > -Message d'origine- > De : Satish Kumar > Envoyé : vendredi 7 août 2020 00:49 > À : users@kafka.apache.org > Objet : compatible kafka version to use when using with logstash 7.5.1-1 > > Hello, > > I upgraded kafka from 0.10 to 2.5.0 and also I upgraded logstash from 2.4 > to 7.5 > > when I have kafka 1.10 and logstash 2.4 the messages used to forward > without any problems. But after the upgrade I'm getting errors in both > logstash and kafka logs so I would like to know what is the compatible > kafka version to use with logstash ( logstash is using kafka-integration > plugin 10.0.0). Please let me know what the compatible version is. I will > do upgrades/downgrades according to that. > > -- > L'intégrité de ce message n'étant pas assurée sur Internet, BPCE-IT ne > peut être tenu responsable de son contenu. Si vous n'êtes pas destinataire > de ce message, merci de le détruire et d'avertir l'expéditeur. > The integrity of this message cannot be guaranteed on the Internet. > BPCE-IT cannot therefore be considered responsible for the contents. If you > are not the intended recipient of this message, then please delete it and > notify the sender. > > -- >
RE: compatible kafka version to use when using with logstash 7.5.1-1
Hi, May be this issue : https://issues.apache.org/jira/browse/KAFKA-9669 ? -Message d'origine- De : Satish Kumar Envoyé : vendredi 7 août 2020 00:49 À : users@kafka.apache.org Objet : compatible kafka version to use when using with logstash 7.5.1-1 Hello, I upgraded kafka from 0.10 to 2.5.0 and also I upgraded logstash from 2.4 to 7.5 when I have kafka 1.10 and logstash 2.4 the messages used to forward without any problems. But after the upgrade I'm getting errors in both logstash and kafka logs so I would like to know what is the compatible kafka version to use with logstash ( logstash is using kafka-integration plugin 10.0.0). Please let me know what the compatible version is. I will do upgrades/downgrades according to that. -- L'intégrité de ce message n'étant pas assurée sur Internet, BPCE-IT ne peut être tenu responsable de son contenu. Si vous n'êtes pas destinataire de ce message, merci de le détruire et d'avertir l'expéditeur. The integrity of this message cannot be guaranteed on the Internet. BPCE-IT cannot therefore be considered responsible for the contents. If you are not the intended recipient of this message, then please delete it and notify the sender. --
Re: compatible kafka version to use when using with logstash 7.5.1-1
Are you getting any error at kafka broker or producing/consuming message ? Can you please provide more detail how did you upgrade or what error you are getting . it all depend how did you upgraded ? On 8/6/20, 4:13 PM, "Satish Kumar" wrote: [External] Hello, I upgraded kafka from 0.10 to 2.5.0 and also I upgraded logstash from 2.4 to 7.5 when I have kafka 1.10 and logstash 2.4 the messages used to forward without any problems. But after the upgrade I'm getting errors in both logstash and kafka logs so I would like to know what is the compatible kafka version to use with logstash ( logstash is using kafka-integration plugin 10.0.0). Please let me know what the compatible version is. I will do upgrades/downgrades according to that. This e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient(s), please reply to the sender and destroy all copies of the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email, and/or any action taken in reliance on the contents of this e-mail is strictly prohibited and may be unlawful. Where permitted by applicable law, this e-mail and other e-mail communications sent to and from Cognizant e-mail addresses may be monitored. This e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient(s), please reply to the sender and destroy all copies of the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email, and/or any action taken in reliance on the contents of this e-mail is strictly prohibited and may be unlawful. Where permitted by applicable law, this e-mail and other e-mail communications sent to and from Cognizant e-mail addresses may be monitored.
compatible kafka version to use when using with logstash 7.5.1-1
Hello, I upgraded kafka from 0.10 to 2.5.0 and also I upgraded logstash from 2.4 to 7.5 when I have kafka 1.10 and logstash 2.4 the messages used to forward without any problems. But after the upgrade I'm getting errors in both logstash and kafka logs so I would like to know what is the compatible kafka version to use with logstash ( logstash is using kafka-integration plugin 10.0.0). Please let me know what the compatible version is. I will do upgrades/downgrades according to that.
