Hi Everyone, I personally found that the 0.8.x clients do not work with 0.10.0. We upgraded our clients (KafkaSpout and custom consumers) to 0.9.0.1 and then Kafka produce/consume worked fine.
--John On Tue, Jul 18, 2017 at 6:36 AM, Sachin Mittal <sjmit...@gmail.com> wrote: > OK. > > Just a doubt I have is that my broker is 0.10.2 and producer is also of the > same version and writes to a topic. > Then I have a client from version 0.8.2 trying to fetch these messages and > what I see is that all messages are getting dropped. > > However since this is an older client I tried to fetch its offsets using: > kafka-run-class kafka.tools.ConsumerOffsetChecker --zookeeper > localhost:2181 --group test > > I saw that lag is 0. > > So probably better question would be can 0.8.2 read a message written by > 0.10.2 > > Thanks > Sachin > > > > On Tue, Jul 18, 2017 at 3:26 PM, Tom Crayford <tcrayf...@heroku.com> > wrote: > > > All broker versions support all older client versions > > > > On Tue, Jul 18, 2017 at 10:15 AM, Sachin Mittal <sjmit...@gmail.com> > > wrote: > > > > > Hi, > > > This gives me some information but still not the complete picture. > > > > > > It says: > > > 0.10.2, Java clients have acquired the ability to communicate with > older > > > brokers. > > > > > > It also says > > > Version 0.11.0 brokers support 0.8.x and newer clients > > > > > > Question is does 0.10.2 broker support 0.8.x clients? > > > > > > This may solve answer my temporary doubt, but a compatibility matrix > will > > > be much helpful to have a yes/no answer. > > > > > > Thanks > > > Sachin > > > > > > > > > > > > On Tue, Jul 18, 2017 at 2:38 PM, Michal Borowiecki < > > > michal.borowie...@openbet.com> wrote: > > > > > >> Have you seen this: http://kafka.apache.org/ > documentation.html#upgrade > > >> > > >> Starting with version 0.10.2, Java clients (producer and consumer) > have > > >> acquired the ability to communicate with older brokers. Version 0.11.0 > > >> clients can talk to version 0.10.0 or newer brokers. However, if your > > >> brokers are older than 0.10.0, you must upgrade all the brokers in the > > >> Kafka cluster before upgrading your clients. Version 0.11.0 brokers > > support > > >> 0.8.x and newer clients. > > >> > > >> Hope that helps. > > >> > > >> Cheers, > > >> > > >> Michał > > >> > > >> On 18/07/17 08:17, Sachin Mittal wrote: > > >> > > >> Hi, > > >> I would like some help/information on what client versions are > > compatible > > >> with what broker versions in kafka. > > >> > > >> Some table like this would be good > > >> > > >> server > > >> client 0.8 0.9 0.10 0.11 > > >> 0.8 yes ? ? ? > > >> 0.9 ? yes ? ? > > >> 0.10 ? ? yes ? > > >> 0.11 ? ? ? yes > > >> > > >> So if question marks are filled it would be of great help. > > >> > > >> Reason I am asking is many times we need to use other > > libraries/frameworks > > >> to pull/push data from/into kafka and sometimes these support only a > > >> particular version of clients. > > >> > > >> Like right now I am trying to pull data from kafka via > druid/tranquility > > >> and they have clients of version 0.8.x implemented but my broker is > > running > > >> 0.10.x. > > >> > > >> Also if such a table can be posted on kafka documentation page or > github > > >> page that would be great. > > >> > > >> Thanks > > >> Sachin > > >> > > >> > > >> > > >> -- > > >> <http://www.openbet.com/> Michal Borowiecki > > >> Senior Software Engineer L4 > > >> T: +44 208 742 1600 <+44%2020%208742%201600> > > >> > > >> > > >> +44 203 249 8448 <+44%2020%203249%208448> > > >> > > >> > > >> > > >> E: michal.borowie...@openbet.com > > >> W: www.openbet.com > > >> OpenBet Ltd > > >> > > >> Chiswick Park Building 9 > > >> > > >> 566 Chiswick High Rd > > >> > > >> London > > >> > > >> W4 5XT > > >> > > >> UK > > >> <https://www.openbet.com/email_promo> > > >> This message is confidential and intended only for the addressee. If > you > > >> have received this message in error, please immediately notify the > > >> postmas...@openbet.com and delete it from your system as well as any > > >> copies. The content of e-mails as well as traffic data may be > monitored > > by > > >> OpenBet for employment and security purposes. To protect the > environment > > >> please do not print this e-mail unless necessary. OpenBet Ltd. > > Registered > > >> Office: Chiswick Park Building 9, 566 Chiswick High Road, London, W4 > > 5XT, > > >> United Kingdom. A company registered in England and Wales. Registered > > no. > > >> 3134634. VAT no. GB927523612 > > >> > > > > > > > > >
