Re: two questions
Hi, I should mention that you don't need to change your code to upgrade clients from 0.8.x to 0.9.x. The Scala producers and consumers are all still present in 0.9.x. Ismael On Mon, Mar 21, 2016 at 9:46 PM, feifei hsu wrote: > They also document that as of now. However, 0.9 Brokers work with 0.8.x > clients. > > However, Anyone has a large deployment on this scenario. e.g. 0.9 > brokers + 0.8.x clients? How is your experience and result? more concern in > term of system issues. like reliability/scability/performance? we have > been heavily invested in the 0.8.x clients. upgrading 0.8.x to 0.9 brokers > first,to take expected features for a while might be the best /feasible > choice concerning the 0.9 client incompatibility . we could later upgrade > the client when we have more resource to develop our client codes. > Your input will be really appreciated. > > On Mon, Mar 21, 2016 at 10:42 AM, Alexis Midon < > alexis.mi...@airbnb.com.invalid> wrote: > > > Hi Ismael, > > > > could you elaborate on "newer clients don't work with older brokers > > though."? doc pointers are fine. > > I was under the impression that I could the 0.9 clients with 0.8 brokers. > > > > thanks > > > > Alexis > > > > On Mon, Mar 21, 2016 at 2:05 AM Ismael Juma wrote: > > > > > Hi Allen, > > > > > > Answers inline. > > > > > > On Mon, Mar 21, 2016 at 5:56 AM, allen chan < > > allen.michael.c...@gmail.com> > > > wrote: > > > > > > > 1) I am using the upgrade instructions to upgrade from 0.8 to 0.9. > Can > > > > someone tell me if i need to continue to bump the > > > > inter.broker.protocol.version after each upgrade? Currently the > broker > > > code > > > > is 0.9.0.1 but i have the config file listing as > > > > inter.broker.protocol.versi > > > > on=0.9.0.0 > > > > > > > > > > When it comes to inter.broker.protocol.version, 0.9.0.0 and 0.9.0.1 are > > the > > > same , so you don't have to. Internally, they are both mapped to > 0.9.0.X. > > > > > > > > > > 2) Is it possible to use multiple variations of producers / > consumers? > > > > My broker is on 0.9.0.1 and i am currently using 0.8.x > > > producer/consumer. I > > > > want to test the new producer first then the new consumer. So would > > there > > > > be issues if the setup was: > > > > 0.9.x producer -> 0.9.x broker -> 0.8.x consumer > > > > > > > > > > Newer brokers support older clients, so this is fine. Note that newer > > > clients don't work with older brokers though. > > > > > > Ismael > > > > > >
Re: two questions
They also document that as of now. However, 0.9 Brokers work with 0.8.x clients. However, Anyone has a large deployment on this scenario. e.g. 0.9 brokers + 0.8.x clients? How is your experience and result? more concern in term of system issues. like reliability/scability/performance? we have been heavily invested in the 0.8.x clients. upgrading 0.8.x to 0.9 brokers first,to take expected features for a while might be the best /feasible choice concerning the 0.9 client incompatibility . we could later upgrade the client when we have more resource to develop our client codes. Your input will be really appreciated. On Mon, Mar 21, 2016 at 10:42 AM, Alexis Midon < alexis.mi...@airbnb.com.invalid> wrote: > Hi Ismael, > > could you elaborate on "newer clients don't work with older brokers > though."? doc pointers are fine. > I was under the impression that I could the 0.9 clients with 0.8 brokers. > > thanks > > Alexis > > On Mon, Mar 21, 2016 at 2:05 AM Ismael Juma wrote: > > > Hi Allen, > > > > Answers inline. > > > > On Mon, Mar 21, 2016 at 5:56 AM, allen chan < > allen.michael.c...@gmail.com> > > wrote: > > > > > 1) I am using the upgrade instructions to upgrade from 0.8 to 0.9. Can > > > someone tell me if i need to continue to bump the > > > inter.broker.protocol.version after each upgrade? Currently the broker > > code > > > is 0.9.0.1 but i have the config file listing as > > > inter.broker.protocol.versi > > > on=0.9.0.0 > > > > > > > When it comes to inter.broker.protocol.version, 0.9.0.0 and 0.9.0.1 are > the > > same , so you don't have to. Internally, they are both mapped to 0.9.0.X. > > > > > > > 2) Is it possible to use multiple variations of producers / consumers? > > > My broker is on 0.9.0.1 and i am currently using 0.8.x > > producer/consumer. I > > > want to test the new producer first then the new consumer. So would > there > > > be issues if the setup was: > > > 0.9.x producer -> 0.9.x broker -> 0.8.x consumer > > > > > > > Newer brokers support older clients, so this is fine. Note that newer > > clients don't work with older brokers though. > > > > Ismael > > >
Re: two questions
Yeah, the Java/Scala clients use the latest protocol version in their requests and that will not work with older brokers if there are incompatible changes (ie 0.9.0.1 clients don't work with 0.8.2.2 brokers, but they do work with 0.9.0.0 brokers). This should be made more explicit in the upgrade notes, it currently says: "It is important that you upgrade your Kafka cluster before upgrading your clients. If you are using MirrorMaker downstream clusters should be upgraded first as well" Depending on the outcome of KIP-35, things may or may not change in the future. Ismael On 21 Mar 2016 17:52, "Rajiv Kurian" wrote: > They don't work with the old brokers. We made the assumption that they > did and had to roll-back. > > On Mon, Mar 21, 2016 at 10:42 AM, Alexis Midon < > alexis.mi...@airbnb.com.invalid> wrote: > > > Hi Ismael, > > > > could you elaborate on "newer clients don't work with older brokers > > though."? doc pointers are fine. > > I was under the impression that I could the 0.9 clients with 0.8 brokers. > > > > thanks > > > > Alexis > > > > On Mon, Mar 21, 2016 at 2:05 AM Ismael Juma wrote: > > > > > Hi Allen, > > > > > > Answers inline. > > > > > > On Mon, Mar 21, 2016 at 5:56 AM, allen chan < > > allen.michael.c...@gmail.com> > > > wrote: > > > > > > > 1) I am using the upgrade instructions to upgrade from 0.8 to 0.9. > Can > > > > someone tell me if i need to continue to bump the > > > > inter.broker.protocol.version after each upgrade? Currently the > broker > > > code > > > > is 0.9.0.1 but i have the config file listing as > > > > inter.broker.protocol.versi > > > > on=0.9.0.0 > > > > > > > > > > When it comes to inter.broker.protocol.version, 0.9.0.0 and 0.9.0.1 are > > the > > > same , so you don't have to. Internally, they are both mapped to > 0.9.0.X. > > > > > > > > > > 2) Is it possible to use multiple variations of producers / > consumers? > > > > My broker is on 0.9.0.1 and i am currently using 0.8.x > > > producer/consumer. I > > > > want to test the new producer first then the new consumer. So would > > there > > > > be issues if the setup was: > > > > 0.9.x producer -> 0.9.x broker -> 0.8.x consumer > > > > > > > > > > Newer brokers support older clients, so this is fine. Note that newer > > > clients don't work with older brokers though. > > > > > > Ismael > > > > > >
Re: two questions
They don't work with the old brokers. We made the assumption that they did and had to roll-back. On Mon, Mar 21, 2016 at 10:42 AM, Alexis Midon < alexis.mi...@airbnb.com.invalid> wrote: > Hi Ismael, > > could you elaborate on "newer clients don't work with older brokers > though."? doc pointers are fine. > I was under the impression that I could the 0.9 clients with 0.8 brokers. > > thanks > > Alexis > > On Mon, Mar 21, 2016 at 2:05 AM Ismael Juma wrote: > > > Hi Allen, > > > > Answers inline. > > > > On Mon, Mar 21, 2016 at 5:56 AM, allen chan < > allen.michael.c...@gmail.com> > > wrote: > > > > > 1) I am using the upgrade instructions to upgrade from 0.8 to 0.9. Can > > > someone tell me if i need to continue to bump the > > > inter.broker.protocol.version after each upgrade? Currently the broker > > code > > > is 0.9.0.1 but i have the config file listing as > > > inter.broker.protocol.versi > > > on=0.9.0.0 > > > > > > > When it comes to inter.broker.protocol.version, 0.9.0.0 and 0.9.0.1 are > the > > same , so you don't have to. Internally, they are both mapped to 0.9.0.X. > > > > > > > 2) Is it possible to use multiple variations of producers / consumers? > > > My broker is on 0.9.0.1 and i am currently using 0.8.x > > producer/consumer. I > > > want to test the new producer first then the new consumer. So would > there > > > be issues if the setup was: > > > 0.9.x producer -> 0.9.x broker -> 0.8.x consumer > > > > > > > Newer brokers support older clients, so this is fine. Note that newer > > clients don't work with older brokers though. > > > > Ismael > > >
Re: two questions
Hi Ismael, could you elaborate on "newer clients don't work with older brokers though."? doc pointers are fine. I was under the impression that I could the 0.9 clients with 0.8 brokers. thanks Alexis On Mon, Mar 21, 2016 at 2:05 AM Ismael Juma wrote: > Hi Allen, > > Answers inline. > > On Mon, Mar 21, 2016 at 5:56 AM, allen chan > wrote: > > > 1) I am using the upgrade instructions to upgrade from 0.8 to 0.9. Can > > someone tell me if i need to continue to bump the > > inter.broker.protocol.version after each upgrade? Currently the broker > code > > is 0.9.0.1 but i have the config file listing as > > inter.broker.protocol.versi > > on=0.9.0.0 > > > > When it comes to inter.broker.protocol.version, 0.9.0.0 and 0.9.0.1 are the > same , so you don't have to. Internally, they are both mapped to 0.9.0.X. > > > > 2) Is it possible to use multiple variations of producers / consumers? > > My broker is on 0.9.0.1 and i am currently using 0.8.x > producer/consumer. I > > want to test the new producer first then the new consumer. So would there > > be issues if the setup was: > > 0.9.x producer -> 0.9.x broker -> 0.8.x consumer > > > > Newer brokers support older clients, so this is fine. Note that newer > clients don't work with older brokers though. > > Ismael >
Re: two questions
Hi Allen, Answers inline. On Mon, Mar 21, 2016 at 5:56 AM, allen chan wrote: > 1) I am using the upgrade instructions to upgrade from 0.8 to 0.9. Can > someone tell me if i need to continue to bump the > inter.broker.protocol.version after each upgrade? Currently the broker code > is 0.9.0.1 but i have the config file listing as > inter.broker.protocol.versi > on=0.9.0.0 > When it comes to inter.broker.protocol.version, 0.9.0.0 and 0.9.0.1 are the same , so you don't have to. Internally, they are both mapped to 0.9.0.X. > 2) Is it possible to use multiple variations of producers / consumers? > My broker is on 0.9.0.1 and i am currently using 0.8.x producer/consumer. I > want to test the new producer first then the new consumer. So would there > be issues if the setup was: > 0.9.x producer -> 0.9.x broker -> 0.8.x consumer > Newer brokers support older clients, so this is fine. Note that newer clients don't work with older brokers though. Ismael
two questions
1) I am using the upgrade instructions to upgrade from 0.8 to 0.9. Can someone tell me if i need to continue to bump the inter.broker.protocol.version after each upgrade? Currently the broker code is 0.9.0.1 but i have the config file listing as inter.broker.protocol.versi on=0.9.0.0 2) Is it possible to use multiple variations of producers / consumers? My broker is on 0.9.0.1 and i am currently using 0.8.x producer/consumer. I want to test the new producer first then the new consumer. So would there be issues if the setup was: 0.9.x producer -> 0.9.x broker -> 0.8.x consumer Thanks -- Allen Michael Chan
