Re: Preliminary blog post for the Apache Kafka 2.3.0 release
Here it is: https://youtu.be/YutjYKSGd64 Thanks in advance!! On Tue., 25 Jun. 2019, 12:39 am Colin McCabe, wrote: > Hi Stephane, > > Sounds interesting! Do you have a link to the video you made for 2.3? > > best, > Colin > > > On Sun, Jun 23, 2019, at 15:10, Stephane Maarek wrote: > > The video is ready :) waiting for the release of Kafka 2.3 to make it > > public. @colin if you want to link it in the blog at some point that'd be > > great! > > > > On Wed., 19 Jun. 2019, 4:03 pm Ron Dagostino, wrote: > > > > > Looks great, Colin. > > > > > > I have also enjoyed Stephane Maarek's "What's New in Kafka..." series > of > > > videos (e.g. https://www.youtube.com/watch?v=kaWbp1Cnfo4&t=10s). > Having > > > summaries like this in both formats -- blog and video -- for every > release > > > would be helpful as different people have different preferences. > > > > > > Ron > > > > > > On Tue, Jun 18, 2019 at 8:20 PM Colin McCabe > wrote: > > > > > > > Thanks, Konstantine. I reworked the wording a bit -- take a look. > > > > > > > > best, > > > > C. > > > > > > > > On Tue, Jun 18, 2019, at 14:31, Konstantine Karantasis wrote: > > > > > Thanks Colin. > > > > > Great initiative! > > > > > > > > > > Here's a small correction (between **) for KIP-415 with a small > > > > suggestion > > > > > as well (between _ _): > > > > > > > > > > In Kafka Connect, worker tasks are distributed among the available > > > worker > > > > > nodes. When a connector is reconfigured or a new connector is > deployed > > > > _as > > > > > well as when a worker is added or removed_, the *tasks* must be > > > > rebalanced > > > > > across the Connect cluster to help ensure that all of the worker > nodes > > > > are > > > > > doing a fair share of the Connect work. In 2.2 and earlier, a > Connect > > > > > rebalance caused all worker threads to pause while the rebalance > > > > proceeded. > > > > > As of KIP-415, rebalancing is no longer a stop-the-world affair, > making > > > > > configuration changes a more pleasant thing. > > > > > > > > > > Cheers, > > > > > Konstantine > > > > > > > > > > On Tue, Jun 18, 2019 at 1:50 PM Swen Moczarski < > > > swen.moczar...@gmail.com > > > > > > > > > > wrote: > > > > > > > > > > > Nice overview! > > > > > > > > > > > > I found some typos: > > > > > > rbmainder > > > > > > bmits > > > > > > implbmentation > > > > > > > > > > > > Am Di., 18. Juni 2019 um 22:43 Uhr schrieb Boyang Chen < > > > > > > bche...@outlook.com > > > > > > >: > > > > > > > > > > > > > One typo: > > > > > > > KIP-428: Add in-mbmory window store > > > > > > > should be > > > > > > > KIP-428: Add in-memory window store > > > > > > > > > > > > > > > > > > > > > > > > > > > > From: Colin McCabe > > > > > > > Sent: Wednesday, June 19, 2019 4:22 AM > > > > > > > To: dev@kafka.apache.org > > > > > > > Subject: Re: Preliminary blog post for the Apache Kafka 2.3.0 > > > release > > > > > > > > > > > > > > Sorry, I copied the wrong URL at first. Try this URL instead: > > > > > > > > > > > > > > > > > > > > > https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache > > > > > > > > > > > > > > best, > > > > > > > Colin > > > > > > > > > > > > > > On Tue, Jun 18, 2019, at 13:17, Colin McCabe wrote: > > > > > > > > Hmm. I'm looking to see if there's any way to open up the > > > > > > > permissions... :| > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Tue, Jun 18, 2019, at 13:12, M. Manna wrote: > > > > > > > > > It’s asking for credentials...? > > > > > > > > > > > > > > > > > > On Tue, 18 Jun 2019 at 15:10, Colin McCabe < > cmcc...@apache.org > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > Hi all, > > > > > > > > > > > > > > > > > > > > I've written up a preliminary blog post about the > upcoming > > > > Apache > > > > > > > Kafka > > > > > > > > > > 2.3.0 release. Take a look and let me know what you > think. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache > > > > > > > > > > > > > > > > > > > > cheers, > > > > > > > > > > Colin > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
Re: Preliminary blog post for the Apache Kafka 2.3.0 release
Hi Stephane, Sounds interesting! Do you have a link to the video you made for 2.3? best, Colin On Sun, Jun 23, 2019, at 15:10, Stephane Maarek wrote: > The video is ready :) waiting for the release of Kafka 2.3 to make it > public. @colin if you want to link it in the blog at some point that'd be > great! > > On Wed., 19 Jun. 2019, 4:03 pm Ron Dagostino, wrote: > > > Looks great, Colin. > > > > I have also enjoyed Stephane Maarek's "What's New in Kafka..." series of > > videos (e.g. https://www.youtube.com/watch?v=kaWbp1Cnfo4&t=10s). Having > > summaries like this in both formats -- blog and video -- for every release > > would be helpful as different people have different preferences. > > > > Ron > > > > On Tue, Jun 18, 2019 at 8:20 PM Colin McCabe wrote: > > > > > Thanks, Konstantine. I reworked the wording a bit -- take a look. > > > > > > best, > > > C. > > > > > > On Tue, Jun 18, 2019, at 14:31, Konstantine Karantasis wrote: > > > > Thanks Colin. > > > > Great initiative! > > > > > > > > Here's a small correction (between **) for KIP-415 with a small > > > suggestion > > > > as well (between _ _): > > > > > > > > In Kafka Connect, worker tasks are distributed among the available > > worker > > > > nodes. When a connector is reconfigured or a new connector is deployed > > > _as > > > > well as when a worker is added or removed_, the *tasks* must be > > > rebalanced > > > > across the Connect cluster to help ensure that all of the worker nodes > > > are > > > > doing a fair share of the Connect work. In 2.2 and earlier, a Connect > > > > rebalance caused all worker threads to pause while the rebalance > > > proceeded. > > > > As of KIP-415, rebalancing is no longer a stop-the-world affair, making > > > > configuration changes a more pleasant thing. > > > > > > > > Cheers, > > > > Konstantine > > > > > > > > On Tue, Jun 18, 2019 at 1:50 PM Swen Moczarski < > > swen.moczar...@gmail.com > > > > > > > > wrote: > > > > > > > > > Nice overview! > > > > > > > > > > I found some typos: > > > > > rbmainder > > > > > bmits > > > > > implbmentation > > > > > > > > > > Am Di., 18. Juni 2019 um 22:43 Uhr schrieb Boyang Chen < > > > > > bche...@outlook.com > > > > > >: > > > > > > > > > > > One typo: > > > > > > KIP-428: Add in-mbmory window store > > > > > > should be > > > > > > KIP-428: Add in-memory window store > > > > > > > > > > > > > > > > > > > > > > > > From: Colin McCabe > > > > > > Sent: Wednesday, June 19, 2019 4:22 AM > > > > > > To: dev@kafka.apache.org > > > > > > Subject: Re: Preliminary blog post for the Apache Kafka 2.3.0 > > release > > > > > > > > > > > > Sorry, I copied the wrong URL at first. Try this URL instead: > > > > > > > > > > > > > > > > https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache > > > > > > > > > > > > best, > > > > > > Colin > > > > > > > > > > > > On Tue, Jun 18, 2019, at 13:17, Colin McCabe wrote: > > > > > > > Hmm. I'm looking to see if there's any way to open up the > > > > > > permissions... :| > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Tue, Jun 18, 2019, at 13:12, M. Manna wrote: > > > > > > > > It’s asking for credentials...? > > > > > > > > > > > > > > > > On Tue, 18 Jun 2019 at 15:10, Colin McCabe > > > > > > > wrote: > > > > > > > > > > > > > > > > > Hi all, > > > > > > > > > > > > > > > > > > I've written up a preliminary blog post about the upcoming > > > Apache > > > > > > Kafka > > > > > > > > > 2.3.0 release. Take a look and let me know what you think. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache > > > > > > > > > > > > > > > > > > cheers, > > > > > > > > > Colin > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
Re: Preliminary blog post for the Apache Kafka 2.3.0 release
Hi Ismael, Good idea. I added a section on this. best, Colin On Fri, Jun 21, 2019, at 17:30, Ismael Juma wrote: > Thanks Colin! Maybe we should mention that restarts are much faster when > you have a lot of partitions: > https://issues.apache.org/jira/browse/KAFKA-7283 > > "We did experiments on a cluster with 15 brokers, each of which has ~3k > segments (and there are 31.8k partitions with RF=3 which are evenly > distributed across brokers; total bytes-in-rate is around 400 MBps). The > results show that rolling bounce time reduces from 135 minutes to 55 > minutes." > > Ismael > > On Tue, Jun 18, 2019 at 1:10 PM Colin McCabe wrote: > > > Hi all, > > > > I've written up a preliminary blog post about the upcoming Apache Kafka > > 2.3.0 release. Take a look and let me know what you think. > > > > > > https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache > > > > cheers, > > Colin > > >
Re: Preliminary blog post for the Apache Kafka 2.3.0 release
The video is ready :) waiting for the release of Kafka 2.3 to make it public. @colin if you want to link it in the blog at some point that'd be great! On Wed., 19 Jun. 2019, 4:03 pm Ron Dagostino, wrote: > Looks great, Colin. > > I have also enjoyed Stephane Maarek's "What's New in Kafka..." series of > videos (e.g. https://www.youtube.com/watch?v=kaWbp1Cnfo4&t=10s). Having > summaries like this in both formats -- blog and video -- for every release > would be helpful as different people have different preferences. > > Ron > > On Tue, Jun 18, 2019 at 8:20 PM Colin McCabe wrote: > > > Thanks, Konstantine. I reworked the wording a bit -- take a look. > > > > best, > > C. > > > > On Tue, Jun 18, 2019, at 14:31, Konstantine Karantasis wrote: > > > Thanks Colin. > > > Great initiative! > > > > > > Here's a small correction (between **) for KIP-415 with a small > > suggestion > > > as well (between _ _): > > > > > > In Kafka Connect, worker tasks are distributed among the available > worker > > > nodes. When a connector is reconfigured or a new connector is deployed > > _as > > > well as when a worker is added or removed_, the *tasks* must be > > rebalanced > > > across the Connect cluster to help ensure that all of the worker nodes > > are > > > doing a fair share of the Connect work. In 2.2 and earlier, a Connect > > > rebalance caused all worker threads to pause while the rebalance > > proceeded. > > > As of KIP-415, rebalancing is no longer a stop-the-world affair, making > > > configuration changes a more pleasant thing. > > > > > > Cheers, > > > Konstantine > > > > > > On Tue, Jun 18, 2019 at 1:50 PM Swen Moczarski < > swen.moczar...@gmail.com > > > > > > wrote: > > > > > > > Nice overview! > > > > > > > > I found some typos: > > > > rbmainder > > > > bmits > > > > implbmentation > > > > > > > > Am Di., 18. Juni 2019 um 22:43 Uhr schrieb Boyang Chen < > > > > bche...@outlook.com > > > > >: > > > > > > > > > One typo: > > > > > KIP-428: Add in-mbmory window store > > > > > should be > > > > > KIP-428: Add in-memory window store > > > > > > > > > > > > > > > > > > > > From: Colin McCabe > > > > > Sent: Wednesday, June 19, 2019 4:22 AM > > > > > To: dev@kafka.apache.org > > > > > Subject: Re: Preliminary blog post for the Apache Kafka 2.3.0 > release > > > > > > > > > > Sorry, I copied the wrong URL at first. Try this URL instead: > > > > > > > > > > > > https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache > > > > > > > > > > best, > > > > > Colin > > > > > > > > > > On Tue, Jun 18, 2019, at 13:17, Colin McCabe wrote: > > > > > > Hmm. I'm looking to see if there's any way to open up the > > > > > permissions... :| > > > > > > > > > > > > > > > > > > > > > > > > On Tue, Jun 18, 2019, at 13:12, M. Manna wrote: > > > > > > > It’s asking for credentials...? > > > > > > > > > > > > > > On Tue, 18 Jun 2019 at 15:10, Colin McCabe > > > > > wrote: > > > > > > > > > > > > > > > Hi all, > > > > > > > > > > > > > > > > I've written up a preliminary blog post about the upcoming > > Apache > > > > > Kafka > > > > > > > > 2.3.0 release. Take a look and let me know what you think. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache > > > > > > > > > > > > > > > > cheers, > > > > > > > > Colin > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
Re: Preliminary blog post for the Apache Kafka 2.3.0 release
Thanks Colin! Maybe we should mention that restarts are much faster when you have a lot of partitions: https://issues.apache.org/jira/browse/KAFKA-7283 "We did experiments on a cluster with 15 brokers, each of which has ~3k segments (and there are 31.8k partitions with RF=3 which are evenly distributed across brokers; total bytes-in-rate is around 400 MBps). The results show that rolling bounce time reduces from 135 minutes to 55 minutes." Ismael On Tue, Jun 18, 2019 at 1:10 PM Colin McCabe wrote: > Hi all, > > I've written up a preliminary blog post about the upcoming Apache Kafka > 2.3.0 release. Take a look and let me know what you think. > > > https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache > > cheers, > Colin >
Re: Preliminary blog post for the Apache Kafka 2.3.0 release
Looks great to me Colin. Thanks for the small adjustments! Cheers, Konstantine On Thu, Jun 20, 2019 at 9:50 AM Colin McCabe wrote: > On Thu, Jun 20, 2019, at 00:23, Matthias J. Sax wrote: > > Great blog post, Colin! > > > > Two comments: > > > > > > (1) KIP-258: "future features" -> "the ability to return the latest > > timestamp in Interactive Queries" > > > > This is not a future feature, but the timestamp can be queried in 2.3 > > already. > > Thanks for the correction. This should be fixed. > > > > > > > (2) Why only listing KIP-428; KIP-445 is equally important. > > > > Good point. I added information about KIP-445. > > best, > Colin > > > > > > > -Matthias > > > > > > On 6/19/19 7:02 AM, Ron Dagostino wrote: > > > Looks great, Colin. > > > > > > I have also enjoyed Stephane Maarek's "What's New in Kafka..." series > of > > > videos (e.g. https://www.youtube.com/watch?v=kaWbp1Cnfo4&t=10s). > Having > > > summaries like this in both formats -- blog and video -- for every > release > > > would be helpful as different people have different preferences. > > > > > > Ron > > > > > > On Tue, Jun 18, 2019 at 8:20 PM Colin McCabe > wrote: > > > > > >> Thanks, Konstantine. I reworked the wording a bit -- take a look. > > >> > > >> best, > > >> C. > > >> > > >> On Tue, Jun 18, 2019, at 14:31, Konstantine Karantasis wrote: > > >>> Thanks Colin. > > >>> Great initiative! > > >>> > > >>> Here's a small correction (between **) for KIP-415 with a small > > >> suggestion > > >>> as well (between _ _): > > >>> > > >>> In Kafka Connect, worker tasks are distributed among the available > worker > > >>> nodes. When a connector is reconfigured or a new connector is > deployed > > >> _as > > >>> well as when a worker is added or removed_, the *tasks* must be > > >> rebalanced > > >>> across the Connect cluster to help ensure that all of the worker > nodes > > >> are > > >>> doing a fair share of the Connect work. In 2.2 and earlier, a Connect > > >>> rebalance caused all worker threads to pause while the rebalance > > >> proceeded. > > >>> As of KIP-415, rebalancing is no longer a stop-the-world affair, > making > > >>> configuration changes a more pleasant thing. > > >>> > > >>> Cheers, > > >>> Konstantine > > >>> > > >>> On Tue, Jun 18, 2019 at 1:50 PM Swen Moczarski < > swen.moczar...@gmail.com > > >>> > > >>> wrote: > > >>> > > >>>> Nice overview! > > >>>> > > >>>> I found some typos: > > >>>> rbmainder > > >>>> bmits > > >>>> implbmentation > > >>>> > > >>>> Am Di., 18. Juni 2019 um 22:43 Uhr schrieb Boyang Chen < > > >>>> bche...@outlook.com > > >>>>> : > > >>>> > > >>>>> One typo: > > >>>>> KIP-428: Add in-mbmory window store > > >>>>> should be > > >>>>> KIP-428: Add in-memory window store > > >>>>> > > >>>>> > > >>>>> > > >>>>> From: Colin McCabe > > >>>>> Sent: Wednesday, June 19, 2019 4:22 AM > > >>>>> To: dev@kafka.apache.org > > >>>>> Subject: Re: Preliminary blog post for the Apache Kafka 2.3.0 > release > > >>>>> > > >>>>> Sorry, I copied the wrong URL at first. Try this URL instead: > > >>>>> > > >>>> > > >> > https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache > > >>>>> > > >>>>> best, > > >>>>> Colin > > >>>>> > > >>>>> On Tue, Jun 18, 2019, at 13:17, Colin McCabe wrote: > > >>>>>> Hmm. I'm looking to see if there's any way to open up the > > >>>>> permissions... :| > > >>>>>> > > >>>>>> > > >>>>>> > > >>>>>> On Tue, Jun 18, 2019, at 13:12, M. Manna wrote: > > >>>>>>> It’s asking for credentials...? > > >>>>>>> > > >>>>>>> On Tue, 18 Jun 2019 at 15:10, Colin McCabe > > >>>> wrote: > > >>>>>>> > > >>>>>>>> Hi all, > > >>>>>>>> > > >>>>>>>> I've written up a preliminary blog post about the upcoming > > >> Apache > > >>>>> Kafka > > >>>>>>>> 2.3.0 release. Take a look and let me know what you think. > > >>>>>>>> > > >>>>>>>> > > >>>>>>>> > > >>>>> > > >>>> > > >> > https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache > > >>>>>>>> > > >>>>>>>> cheers, > > >>>>>>>> Colin > > >>>>>>>> > > >>>>>>> > > >>>>>> > > >>>>> > > >>>> > > >>> > > >> > > > > > > > > > Attachments: > > * signature.asc >
Re: Preliminary blog post for the Apache Kafka 2.3.0 release
On Thu, Jun 20, 2019, at 00:23, Matthias J. Sax wrote: > Great blog post, Colin! > > Two comments: > > > (1) KIP-258: "future features" -> "the ability to return the latest > timestamp in Interactive Queries" > > This is not a future feature, but the timestamp can be queried in 2.3 > already. Thanks for the correction. This should be fixed. > > > (2) Why only listing KIP-428; KIP-445 is equally important. > Good point. I added information about KIP-445. best, Colin > > > -Matthias > > > On 6/19/19 7:02 AM, Ron Dagostino wrote: > > Looks great, Colin. > > > > I have also enjoyed Stephane Maarek's "What's New in Kafka..." series of > > videos (e.g. https://www.youtube.com/watch?v=kaWbp1Cnfo4&t=10s). Having > > summaries like this in both formats -- blog and video -- for every release > > would be helpful as different people have different preferences. > > > > Ron > > > > On Tue, Jun 18, 2019 at 8:20 PM Colin McCabe wrote: > > > >> Thanks, Konstantine. I reworked the wording a bit -- take a look. > >> > >> best, > >> C. > >> > >> On Tue, Jun 18, 2019, at 14:31, Konstantine Karantasis wrote: > >>> Thanks Colin. > >>> Great initiative! > >>> > >>> Here's a small correction (between **) for KIP-415 with a small > >> suggestion > >>> as well (between _ _): > >>> > >>> In Kafka Connect, worker tasks are distributed among the available worker > >>> nodes. When a connector is reconfigured or a new connector is deployed > >> _as > >>> well as when a worker is added or removed_, the *tasks* must be > >> rebalanced > >>> across the Connect cluster to help ensure that all of the worker nodes > >> are > >>> doing a fair share of the Connect work. In 2.2 and earlier, a Connect > >>> rebalance caused all worker threads to pause while the rebalance > >> proceeded. > >>> As of KIP-415, rebalancing is no longer a stop-the-world affair, making > >>> configuration changes a more pleasant thing. > >>> > >>> Cheers, > >>> Konstantine > >>> > >>> On Tue, Jun 18, 2019 at 1:50 PM Swen Moczarski >>> > >>> wrote: > >>> > >>>> Nice overview! > >>>> > >>>> I found some typos: > >>>> rbmainder > >>>> bmits > >>>> implbmentation > >>>> > >>>> Am Di., 18. Juni 2019 um 22:43 Uhr schrieb Boyang Chen < > >>>> bche...@outlook.com > >>>>> : > >>>> > >>>>> One typo: > >>>>> KIP-428: Add in-mbmory window store > >>>>> should be > >>>>> KIP-428: Add in-memory window store > >>>>> > >>>>> > >>>>> > >>>>> From: Colin McCabe > >>>>> Sent: Wednesday, June 19, 2019 4:22 AM > >>>>> To: dev@kafka.apache.org > >>>>> Subject: Re: Preliminary blog post for the Apache Kafka 2.3.0 release > >>>>> > >>>>> Sorry, I copied the wrong URL at first. Try this URL instead: > >>>>> > >>>> > >> https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache > >>>>> > >>>>> best, > >>>>> Colin > >>>>> > >>>>> On Tue, Jun 18, 2019, at 13:17, Colin McCabe wrote: > >>>>>> Hmm. I'm looking to see if there's any way to open up the > >>>>> permissions... :| > >>>>>> > >>>>>> > >>>>>> > >>>>>> On Tue, Jun 18, 2019, at 13:12, M. Manna wrote: > >>>>>>> It’s asking for credentials...? > >>>>>>> > >>>>>>> On Tue, 18 Jun 2019 at 15:10, Colin McCabe > >>>> wrote: > >>>>>>> > >>>>>>>> Hi all, > >>>>>>>> > >>>>>>>> I've written up a preliminary blog post about the upcoming > >> Apache > >>>>> Kafka > >>>>>>>> 2.3.0 release. Take a look and let me know what you think. > >>>>>>>> > >>>>>>>> > >>>>>>>> > >>>>> > >>>> > >> https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache > >>>>>>>> > >>>>>>>> cheers, > >>>>>>>> Colin > >>>>>>>> > >>>>>>> > >>>>>> > >>>>> > >>>> > >>> > >> > > > > > Attachments: > * signature.asc
Re: Preliminary blog post for the Apache Kafka 2.3.0 release
Great blog post, Colin! Two comments: (1) KIP-258: "future features" -> "the ability to return the latest timestamp in Interactive Queries" This is not a future feature, but the timestamp can be queried in 2.3 already. (2) Why only listing KIP-428; KIP-445 is equally important. -Matthias On 6/19/19 7:02 AM, Ron Dagostino wrote: > Looks great, Colin. > > I have also enjoyed Stephane Maarek's "What's New in Kafka..." series of > videos (e.g. https://www.youtube.com/watch?v=kaWbp1Cnfo4&t=10s). Having > summaries like this in both formats -- blog and video -- for every release > would be helpful as different people have different preferences. > > Ron > > On Tue, Jun 18, 2019 at 8:20 PM Colin McCabe wrote: > >> Thanks, Konstantine. I reworked the wording a bit -- take a look. >> >> best, >> C. >> >> On Tue, Jun 18, 2019, at 14:31, Konstantine Karantasis wrote: >>> Thanks Colin. >>> Great initiative! >>> >>> Here's a small correction (between **) for KIP-415 with a small >> suggestion >>> as well (between _ _): >>> >>> In Kafka Connect, worker tasks are distributed among the available worker >>> nodes. When a connector is reconfigured or a new connector is deployed >> _as >>> well as when a worker is added or removed_, the *tasks* must be >> rebalanced >>> across the Connect cluster to help ensure that all of the worker nodes >> are >>> doing a fair share of the Connect work. In 2.2 and earlier, a Connect >>> rebalance caused all worker threads to pause while the rebalance >> proceeded. >>> As of KIP-415, rebalancing is no longer a stop-the-world affair, making >>> configuration changes a more pleasant thing. >>> >>> Cheers, >>> Konstantine >>> >>> On Tue, Jun 18, 2019 at 1:50 PM Swen Moczarski >> >>> wrote: >>> >>>> Nice overview! >>>> >>>> I found some typos: >>>> rbmainder >>>> bmits >>>> implbmentation >>>> >>>> Am Di., 18. Juni 2019 um 22:43 Uhr schrieb Boyang Chen < >>>> bche...@outlook.com >>>>> : >>>> >>>>> One typo: >>>>> KIP-428: Add in-mbmory window store >>>>> should be >>>>> KIP-428: Add in-memory window store >>>>> >>>>> >>>>> >>>>> From: Colin McCabe >>>>> Sent: Wednesday, June 19, 2019 4:22 AM >>>>> To: dev@kafka.apache.org >>>>> Subject: Re: Preliminary blog post for the Apache Kafka 2.3.0 release >>>>> >>>>> Sorry, I copied the wrong URL at first. Try this URL instead: >>>>> >>>> >> https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache >>>>> >>>>> best, >>>>> Colin >>>>> >>>>> On Tue, Jun 18, 2019, at 13:17, Colin McCabe wrote: >>>>>> Hmm. I'm looking to see if there's any way to open up the >>>>> permissions... :| >>>>>> >>>>>> >>>>>> >>>>>> On Tue, Jun 18, 2019, at 13:12, M. Manna wrote: >>>>>>> It’s asking for credentials...? >>>>>>> >>>>>>> On Tue, 18 Jun 2019 at 15:10, Colin McCabe >>>> wrote: >>>>>>> >>>>>>>> Hi all, >>>>>>>> >>>>>>>> I've written up a preliminary blog post about the upcoming >> Apache >>>>> Kafka >>>>>>>> 2.3.0 release. Take a look and let me know what you think. >>>>>>>> >>>>>>>> >>>>>>>> >>>>> >>>> >> https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache >>>>>>>> >>>>>>>> cheers, >>>>>>>> Colin >>>>>>>> >>>>>>> >>>>>> >>>>> >>>> >>> >> > signature.asc Description: OpenPGP digital signature
Re: Preliminary blog post for the Apache Kafka 2.3.0 release
Looks great, Colin. I have also enjoyed Stephane Maarek's "What's New in Kafka..." series of videos (e.g. https://www.youtube.com/watch?v=kaWbp1Cnfo4&t=10s). Having summaries like this in both formats -- blog and video -- for every release would be helpful as different people have different preferences. Ron On Tue, Jun 18, 2019 at 8:20 PM Colin McCabe wrote: > Thanks, Konstantine. I reworked the wording a bit -- take a look. > > best, > C. > > On Tue, Jun 18, 2019, at 14:31, Konstantine Karantasis wrote: > > Thanks Colin. > > Great initiative! > > > > Here's a small correction (between **) for KIP-415 with a small > suggestion > > as well (between _ _): > > > > In Kafka Connect, worker tasks are distributed among the available worker > > nodes. When a connector is reconfigured or a new connector is deployed > _as > > well as when a worker is added or removed_, the *tasks* must be > rebalanced > > across the Connect cluster to help ensure that all of the worker nodes > are > > doing a fair share of the Connect work. In 2.2 and earlier, a Connect > > rebalance caused all worker threads to pause while the rebalance > proceeded. > > As of KIP-415, rebalancing is no longer a stop-the-world affair, making > > configuration changes a more pleasant thing. > > > > Cheers, > > Konstantine > > > > On Tue, Jun 18, 2019 at 1:50 PM Swen Moczarski > > > wrote: > > > > > Nice overview! > > > > > > I found some typos: > > > rbmainder > > > bmits > > > implbmentation > > > > > > Am Di., 18. Juni 2019 um 22:43 Uhr schrieb Boyang Chen < > > > bche...@outlook.com > > > >: > > > > > > > One typo: > > > > KIP-428: Add in-mbmory window store > > > > should be > > > > KIP-428: Add in-memory window store > > > > > > > > > > > > > > > > From: Colin McCabe > > > > Sent: Wednesday, June 19, 2019 4:22 AM > > > > To: dev@kafka.apache.org > > > > Subject: Re: Preliminary blog post for the Apache Kafka 2.3.0 release > > > > > > > > Sorry, I copied the wrong URL at first. Try this URL instead: > > > > > > > > https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache > > > > > > > > best, > > > > Colin > > > > > > > > On Tue, Jun 18, 2019, at 13:17, Colin McCabe wrote: > > > > > Hmm. I'm looking to see if there's any way to open up the > > > > permissions... :| > > > > > > > > > > > > > > > > > > > > On Tue, Jun 18, 2019, at 13:12, M. Manna wrote: > > > > > > It’s asking for credentials...? > > > > > > > > > > > > On Tue, 18 Jun 2019 at 15:10, Colin McCabe > > > wrote: > > > > > > > > > > > > > Hi all, > > > > > > > > > > > > > > I've written up a preliminary blog post about the upcoming > Apache > > > > Kafka > > > > > > > 2.3.0 release. Take a look and let me know what you think. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache > > > > > > > > > > > > > > cheers, > > > > > > > Colin > > > > > > > > > > > > > > > > > > > > > > > > > > > >
Re: Preliminary blog post for the Apache Kafka 2.3.0 release
Thanks, Konstantine. I reworked the wording a bit -- take a look. best, C. On Tue, Jun 18, 2019, at 14:31, Konstantine Karantasis wrote: > Thanks Colin. > Great initiative! > > Here's a small correction (between **) for KIP-415 with a small suggestion > as well (between _ _): > > In Kafka Connect, worker tasks are distributed among the available worker > nodes. When a connector is reconfigured or a new connector is deployed _as > well as when a worker is added or removed_, the *tasks* must be rebalanced > across the Connect cluster to help ensure that all of the worker nodes are > doing a fair share of the Connect work. In 2.2 and earlier, a Connect > rebalance caused all worker threads to pause while the rebalance proceeded. > As of KIP-415, rebalancing is no longer a stop-the-world affair, making > configuration changes a more pleasant thing. > > Cheers, > Konstantine > > On Tue, Jun 18, 2019 at 1:50 PM Swen Moczarski > wrote: > > > Nice overview! > > > > I found some typos: > > rbmainder > > bmits > > implbmentation > > > > Am Di., 18. Juni 2019 um 22:43 Uhr schrieb Boyang Chen < > > bche...@outlook.com > > >: > > > > > One typo: > > > KIP-428: Add in-mbmory window store > > > should be > > > KIP-428: Add in-memory window store > > > > > > > > > ____ > > > From: Colin McCabe > > > Sent: Wednesday, June 19, 2019 4:22 AM > > > To: dev@kafka.apache.org > > > Subject: Re: Preliminary blog post for the Apache Kafka 2.3.0 release > > > > > > Sorry, I copied the wrong URL at first. Try this URL instead: > > > > > https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache > > > > > > best, > > > Colin > > > > > > On Tue, Jun 18, 2019, at 13:17, Colin McCabe wrote: > > > > Hmm. I'm looking to see if there's any way to open up the > > > permissions... :| > > > > > > > > > > > > > > > > On Tue, Jun 18, 2019, at 13:12, M. Manna wrote: > > > > > It’s asking for credentials...? > > > > > > > > > > On Tue, 18 Jun 2019 at 15:10, Colin McCabe > > wrote: > > > > > > > > > > > Hi all, > > > > > > > > > > > > I've written up a preliminary blog post about the upcoming Apache > > > Kafka > > > > > > 2.3.0 release. Take a look and let me know what you think. > > > > > > > > > > > > > > > > > > > > > > > https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache > > > > > > > > > > > > cheers, > > > > > > Colin > > > > > > > > > > > > > > > > > > > > >
Re: Preliminary blog post for the Apache Kafka 2.3.0 release
Thanks, Swen. Fixed. C. On Tue, Jun 18, 2019, at 13:50, Swen Moczarski wrote: > Nice overview! > > I found some typos: > rbmainder > bmits > implbmentation > > Am Di., 18. Juni 2019 um 22:43 Uhr schrieb Boyang Chen >: > > > One typo: > > KIP-428: Add in-mbmory window store > > should be > > KIP-428: Add in-memory window store > > > > > > > > From: Colin McCabe > > Sent: Wednesday, June 19, 2019 4:22 AM > > To: dev@kafka.apache.org > > Subject: Re: Preliminary blog post for the Apache Kafka 2.3.0 release > > > > Sorry, I copied the wrong URL at first. Try this URL instead: > > https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache > > > > best, > > Colin > > > > On Tue, Jun 18, 2019, at 13:17, Colin McCabe wrote: > > > Hmm. I'm looking to see if there's any way to open up the > > permissions... :| > > > > > > > > > > > > On Tue, Jun 18, 2019, at 13:12, M. Manna wrote: > > > > It’s asking for credentials...? > > > > > > > > On Tue, 18 Jun 2019 at 15:10, Colin McCabe wrote: > > > > > > > > > Hi all, > > > > > > > > > > I've written up a preliminary blog post about the upcoming Apache > > Kafka > > > > > 2.3.0 release. Take a look and let me know what you think. > > > > > > > > > > > > > > > > > https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache > > > > > > > > > > cheers, > > > > > Colin > > > > > > > > > > > > > > >
Re: Preliminary blog post for the Apache Kafka 2.3.0 release
Thanks, Boyang! Fixed. C. On Tue, Jun 18, 2019, at 13:43, Boyang Chen wrote: > One typo: > KIP-428: Add in-mbmory window store > should be > KIP-428: Add in-memory window store > > > > From: Colin McCabe > Sent: Wednesday, June 19, 2019 4:22 AM > To: dev@kafka.apache.org > Subject: Re: Preliminary blog post for the Apache Kafka 2.3.0 release > > Sorry, I copied the wrong URL at first. Try this URL instead: > https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache > > best, > Colin > > On Tue, Jun 18, 2019, at 13:17, Colin McCabe wrote: > > Hmm. I'm looking to see if there's any way to open up the permissions... :| > > > > > > > > On Tue, Jun 18, 2019, at 13:12, M. Manna wrote: > > > It’s asking for credentials...? > > > > > > On Tue, 18 Jun 2019 at 15:10, Colin McCabe wrote: > > > > > > > Hi all, > > > > > > > > I've written up a preliminary blog post about the upcoming Apache Kafka > > > > 2.3.0 release. Take a look and let me know what you think. > > > > > > > > > > > > https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache > > > > > > > > cheers, > > > > Colin > > > > > > > > > >
Re: Preliminary blog post for the Apache Kafka 2.3.0 release
Thanks Colin. Great initiative! Here's a small correction (between **) for KIP-415 with a small suggestion as well (between _ _): In Kafka Connect, worker tasks are distributed among the available worker nodes. When a connector is reconfigured or a new connector is deployed _as well as when a worker is added or removed_, the *tasks* must be rebalanced across the Connect cluster to help ensure that all of the worker nodes are doing a fair share of the Connect work. In 2.2 and earlier, a Connect rebalance caused all worker threads to pause while the rebalance proceeded. As of KIP-415, rebalancing is no longer a stop-the-world affair, making configuration changes a more pleasant thing. Cheers, Konstantine On Tue, Jun 18, 2019 at 1:50 PM Swen Moczarski wrote: > Nice overview! > > I found some typos: > rbmainder > bmits > implbmentation > > Am Di., 18. Juni 2019 um 22:43 Uhr schrieb Boyang Chen < > bche...@outlook.com > >: > > > One typo: > > KIP-428: Add in-mbmory window store > > should be > > KIP-428: Add in-memory window store > > > > > > > > From: Colin McCabe > > Sent: Wednesday, June 19, 2019 4:22 AM > > To: dev@kafka.apache.org > > Subject: Re: Preliminary blog post for the Apache Kafka 2.3.0 release > > > > Sorry, I copied the wrong URL at first. Try this URL instead: > > > https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache > > > > best, > > Colin > > > > On Tue, Jun 18, 2019, at 13:17, Colin McCabe wrote: > > > Hmm. I'm looking to see if there's any way to open up the > > permissions... :| > > > > > > > > > > > > On Tue, Jun 18, 2019, at 13:12, M. Manna wrote: > > > > It’s asking for credentials...? > > > > > > > > On Tue, 18 Jun 2019 at 15:10, Colin McCabe > wrote: > > > > > > > > > Hi all, > > > > > > > > > > I've written up a preliminary blog post about the upcoming Apache > > Kafka > > > > > 2.3.0 release. Take a look and let me know what you think. > > > > > > > > > > > > > > > > > > https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache > > > > > > > > > > cheers, > > > > > Colin > > > > > > > > > > > > > > >
Re: Preliminary blog post for the Apache Kafka 2.3.0 release
Nice overview! I found some typos: rbmainder bmits implbmentation Am Di., 18. Juni 2019 um 22:43 Uhr schrieb Boyang Chen : > One typo: > KIP-428: Add in-mbmory window store > should be > KIP-428: Add in-memory window store > > > > From: Colin McCabe > Sent: Wednesday, June 19, 2019 4:22 AM > To: dev@kafka.apache.org > Subject: Re: Preliminary blog post for the Apache Kafka 2.3.0 release > > Sorry, I copied the wrong URL at first. Try this URL instead: > https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache > > best, > Colin > > On Tue, Jun 18, 2019, at 13:17, Colin McCabe wrote: > > Hmm. I'm looking to see if there's any way to open up the > permissions... :| > > > > > > > > On Tue, Jun 18, 2019, at 13:12, M. Manna wrote: > > > It’s asking for credentials...? > > > > > > On Tue, 18 Jun 2019 at 15:10, Colin McCabe wrote: > > > > > > > Hi all, > > > > > > > > I've written up a preliminary blog post about the upcoming Apache > Kafka > > > > 2.3.0 release. Take a look and let me know what you think. > > > > > > > > > > > > > https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache > > > > > > > > cheers, > > > > Colin > > > > > > > > > >
Re: Preliminary blog post for the Apache Kafka 2.3.0 release
One typo: KIP-428: Add in-mbmory window store should be KIP-428: Add in-memory window store From: Colin McCabe Sent: Wednesday, June 19, 2019 4:22 AM To: dev@kafka.apache.org Subject: Re: Preliminary blog post for the Apache Kafka 2.3.0 release Sorry, I copied the wrong URL at first. Try this URL instead: https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache best, Colin On Tue, Jun 18, 2019, at 13:17, Colin McCabe wrote: > Hmm. I'm looking to see if there's any way to open up the permissions... :| > > > > On Tue, Jun 18, 2019, at 13:12, M. Manna wrote: > > It’s asking for credentials...? > > > > On Tue, 18 Jun 2019 at 15:10, Colin McCabe wrote: > > > > > Hi all, > > > > > > I've written up a preliminary blog post about the upcoming Apache Kafka > > > 2.3.0 release. Take a look and let me know what you think. > > > > > > > > > https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache > > > > > > cheers, > > > Colin > > > > > >
Re: Preliminary blog post for the Apache Kafka 2.3.0 release
Sorry, I copied the wrong URL at first. Try this URL instead: https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache best, Colin On Tue, Jun 18, 2019, at 13:17, Colin McCabe wrote: > Hmm. I'm looking to see if there's any way to open up the permissions... :| > > > > On Tue, Jun 18, 2019, at 13:12, M. Manna wrote: > > It’s asking for credentials...? > > > > On Tue, 18 Jun 2019 at 15:10, Colin McCabe wrote: > > > > > Hi all, > > > > > > I've written up a preliminary blog post about the upcoming Apache Kafka > > > 2.3.0 release. Take a look and let me know what you think. > > > > > > > > > https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache > > > > > > cheers, > > > Colin > > > > > >
Re: Preliminary blog post for the Apache Kafka 2.3.0 release
Hmm. I'm looking to see if there's any way to open up the permissions... :| C. On Tue, Jun 18, 2019, at 13:12, M. Manna wrote: > It’s asking for credentials...? > > On Tue, 18 Jun 2019 at 15:10, Colin McCabe wrote: > > > Hi all, > > > > I've written up a preliminary blog post about the upcoming Apache Kafka > > 2.3.0 release. Take a look and let me know what you think. > > > > > > https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache > > > > cheers, > > Colin > > >
Re: Preliminary blog post for the Apache Kafka 2.3.0 release
It’s asking for credentials...? On Tue, 18 Jun 2019 at 15:10, Colin McCabe wrote: > Hi all, > > I've written up a preliminary blog post about the upcoming Apache Kafka > 2.3.0 release. Take a look and let me know what you think. > > > https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache > > cheers, > Colin >
Preliminary blog post for the Apache Kafka 2.3.0 release
Hi all, I've written up a preliminary blog post about the upcoming Apache Kafka 2.3.0 release. Take a look and let me know what you think. https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache cheers, Colin
