Re: [VOTE] 2.1.0 RC0

2018-11-09 Thread Dong Lin
Hey everyone,

Thanks for your help with testing the release! It has taken us some time to
validate the system tests for 2.1.0, fix flaky test and discuss/fix upgrade
note. All these issues are resolved now.

I have started another email thread to vote for 2.1.0 RC1. Please help test
and vote for RC1 when you get time. Hopefully we can officially release
Apache Kafka 2.1.0 next week.

Cheers,
Dong

On Tue, Nov 6, 2018 at 11:28 AM Dong Lin  wrote:

> Hey Satish,
>
> Yes! We will have another RC to include e.g.
> https://github.com/apache/kafka/pull/5857.
>
> Thanks,
> Dong
>
> On Mon, Nov 5, 2018 at 8:14 PM Satish Duggana 
> wrote:
>
>> Hi Dong,
>> Is there a RC1 planned with configs documentation fixes and
>> https://github.com/apache/kafka/pull/5857 ?
>>
>> Thanks,
>> Satish.
>> On Thu, Nov 1, 2018 at 4:05 PM Jakub Scholz  wrote:
>> >
>> > +1 (non-binding) ... I used the staged binaries and checked it with
>> > different clients.
>> >
>> > On Wed, Oct 24, 2018 at 10:17 AM Dong Lin  wrote:
>> >
>> > > Hello Kafka users, developers and client-developers,
>> > >
>> > > This is the first candidate for feature release of Apache Kafka 2.1.0.
>> > >
>> > > This is a major version release of Apache Kafka. It includes 28 new
>> KIPs
>> > > and
>> > >
>> > > critical bug fixes. Please see the Kafka 2.1.0 release plan for more
>> > > details:
>> > >
>> > > *
>> > >
>> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=91554044*
>> > > <
>> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=91554044
>> > > >
>> > >
>> > > Here are a few notable highlights:
>> > >
>> > > - Java 11 support
>> > > - Support for Zstandard, which achieves compression comparable to
>> gzip with
>> > > higher compression and especially decompression speeds(KIP-110)
>> > > - Avoid expiring committed offsets for active consumer group (KIP-211)
>> > > - Provide Intuitive User Timeouts in The Producer (KIP-91)
>> > > - Kafka's replication protocol now supports improved fencing of
>> zombies.
>> > > Previously, under certain rare conditions, if a broker became
>> partitioned
>> > > from Zookeeper but not the rest of the cluster, then the logs of
>> replicated
>> > > partitions could diverge and cause data loss in the worst case
>> (KIP-320)
>> > > - Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353,
>> KIP-356)
>> > > - Admin script and admin client API improvements to simplify admin
>> > > operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
>> > > - DNS handling improvements (KIP-235, KIP-302)
>> > >
>> > > Release notes for the 2.1.0 release:
>> > > http://home.apache.org/~lindong/kafka-2.1.0-rc0/RELEASE_NOTES.html
>> > >
>> > > *** Please download, test and vote ***
>> > >
>> > > * Kafka's KEYS file containing PGP keys we use to sign the release:
>> > > http://kafka.apache.org/KEYS
>> > >
>> > > * Release artifacts to be voted upon (source and binary):
>> > > http://home.apache.org/~lindong/kafka-2.1.0-rc0/
>> > >
>> > > * Maven artifacts to be voted upon:
>> > > https://repository.apache.org/content/groups/staging/
>> > >
>> > > * Javadoc:
>> > > http://home.apache.org/~lindong/kafka-2.1.0-rc0/javadoc/
>> > >
>> > > * Tag to be voted upon (off 2.1 branch) is the 2.1.0-rc0 tag:
>> > > https://github.com/apache/kafka/tree/2.1.0-rc0
>> > >
>> > > * Documentation:
>> > > *http://kafka.apache.org/21/documentation.html*
>> > > 
>> > >
>> > > * Protocol:
>> > > http://kafka.apache.org/21/protocol.html
>> > >
>> > > * Successful Jenkins builds for the 2.1 branch:
>> > > Unit/integration tests: *
>> https://builds.apache.org/job/kafka-2.1-jdk8/38/
>> > > *
>> > >
>> > > Please test and verify the release artifacts and submit a vote for
>> this RC,
>> > > or report any issues so we can fix them and get a new RC out ASAP.
>> Although
>> > > this release vote requires PMC votes to pass, testing, votes, and bug
>> > > reports are valuable and appreciated from everyone.
>> > >
>> > > Cheers,
>> > > Dong
>> > >
>>
>


Re: [VOTE] 2.1.0 RC0

2018-11-06 Thread Dong Lin
Hey Satish,

Yes! We will have another RC to include e.g.
https://github.com/apache/kafka/pull/5857.

Thanks,
Dong

On Mon, Nov 5, 2018 at 8:14 PM Satish Duggana 
wrote:

> Hi Dong,
> Is there a RC1 planned with configs documentation fixes and
> https://github.com/apache/kafka/pull/5857 ?
>
> Thanks,
> Satish.
> On Thu, Nov 1, 2018 at 4:05 PM Jakub Scholz  wrote:
> >
> > +1 (non-binding) ... I used the staged binaries and checked it with
> > different clients.
> >
> > On Wed, Oct 24, 2018 at 10:17 AM Dong Lin  wrote:
> >
> > > Hello Kafka users, developers and client-developers,
> > >
> > > This is the first candidate for feature release of Apache Kafka 2.1.0.
> > >
> > > This is a major version release of Apache Kafka. It includes 28 new
> KIPs
> > > and
> > >
> > > critical bug fixes. Please see the Kafka 2.1.0 release plan for more
> > > details:
> > >
> > > *
> > >
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=91554044*
> > > <
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=91554044
> > > >
> > >
> > > Here are a few notable highlights:
> > >
> > > - Java 11 support
> > > - Support for Zstandard, which achieves compression comparable to gzip
> with
> > > higher compression and especially decompression speeds(KIP-110)
> > > - Avoid expiring committed offsets for active consumer group (KIP-211)
> > > - Provide Intuitive User Timeouts in The Producer (KIP-91)
> > > - Kafka's replication protocol now supports improved fencing of
> zombies.
> > > Previously, under certain rare conditions, if a broker became
> partitioned
> > > from Zookeeper but not the rest of the cluster, then the logs of
> replicated
> > > partitions could diverge and cause data loss in the worst case
> (KIP-320)
> > > - Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353,
> KIP-356)
> > > - Admin script and admin client API improvements to simplify admin
> > > operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
> > > - DNS handling improvements (KIP-235, KIP-302)
> > >
> > > Release notes for the 2.1.0 release:
> > > http://home.apache.org/~lindong/kafka-2.1.0-rc0/RELEASE_NOTES.html
> > >
> > > *** Please download, test and vote ***
> > >
> > > * Kafka's KEYS file containing PGP keys we use to sign the release:
> > > http://kafka.apache.org/KEYS
> > >
> > > * Release artifacts to be voted upon (source and binary):
> > > http://home.apache.org/~lindong/kafka-2.1.0-rc0/
> > >
> > > * Maven artifacts to be voted upon:
> > > https://repository.apache.org/content/groups/staging/
> > >
> > > * Javadoc:
> > > http://home.apache.org/~lindong/kafka-2.1.0-rc0/javadoc/
> > >
> > > * Tag to be voted upon (off 2.1 branch) is the 2.1.0-rc0 tag:
> > > https://github.com/apache/kafka/tree/2.1.0-rc0
> > >
> > > * Documentation:
> > > *http://kafka.apache.org/21/documentation.html*
> > > 
> > >
> > > * Protocol:
> > > http://kafka.apache.org/21/protocol.html
> > >
> > > * Successful Jenkins builds for the 2.1 branch:
> > > Unit/integration tests: *
> https://builds.apache.org/job/kafka-2.1-jdk8/38/
> > > *
> > >
> > > Please test and verify the release artifacts and submit a vote for
> this RC,
> > > or report any issues so we can fix them and get a new RC out ASAP.
> Although
> > > this release vote requires PMC votes to pass, testing, votes, and bug
> > > reports are valuable and appreciated from everyone.
> > >
> > > Cheers,
> > > Dong
> > >
>


Re: [VOTE] 2.1.0 RC0

2018-11-05 Thread Satish Duggana
Hi Dong,
Is there a RC1 planned with configs documentation fixes and
https://github.com/apache/kafka/pull/5857 ?

Thanks,
Satish.
On Thu, Nov 1, 2018 at 4:05 PM Jakub Scholz  wrote:
>
> +1 (non-binding) ... I used the staged binaries and checked it with
> different clients.
>
> On Wed, Oct 24, 2018 at 10:17 AM Dong Lin  wrote:
>
> > Hello Kafka users, developers and client-developers,
> >
> > This is the first candidate for feature release of Apache Kafka 2.1.0.
> >
> > This is a major version release of Apache Kafka. It includes 28 new KIPs
> > and
> >
> > critical bug fixes. Please see the Kafka 2.1.0 release plan for more
> > details:
> >
> > *
> > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=91554044*
> >  > >
> >
> > Here are a few notable highlights:
> >
> > - Java 11 support
> > - Support for Zstandard, which achieves compression comparable to gzip with
> > higher compression and especially decompression speeds(KIP-110)
> > - Avoid expiring committed offsets for active consumer group (KIP-211)
> > - Provide Intuitive User Timeouts in The Producer (KIP-91)
> > - Kafka's replication protocol now supports improved fencing of zombies.
> > Previously, under certain rare conditions, if a broker became partitioned
> > from Zookeeper but not the rest of the cluster, then the logs of replicated
> > partitions could diverge and cause data loss in the worst case (KIP-320)
> > - Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
> > - Admin script and admin client API improvements to simplify admin
> > operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
> > - DNS handling improvements (KIP-235, KIP-302)
> >
> > Release notes for the 2.1.0 release:
> > http://home.apache.org/~lindong/kafka-2.1.0-rc0/RELEASE_NOTES.html
> >
> > *** Please download, test and vote ***
> >
> > * Kafka's KEYS file containing PGP keys we use to sign the release:
> > http://kafka.apache.org/KEYS
> >
> > * Release artifacts to be voted upon (source and binary):
> > http://home.apache.org/~lindong/kafka-2.1.0-rc0/
> >
> > * Maven artifacts to be voted upon:
> > https://repository.apache.org/content/groups/staging/
> >
> > * Javadoc:
> > http://home.apache.org/~lindong/kafka-2.1.0-rc0/javadoc/
> >
> > * Tag to be voted upon (off 2.1 branch) is the 2.1.0-rc0 tag:
> > https://github.com/apache/kafka/tree/2.1.0-rc0
> >
> > * Documentation:
> > *http://kafka.apache.org/21/documentation.html*
> > 
> >
> > * Protocol:
> > http://kafka.apache.org/21/protocol.html
> >
> > * Successful Jenkins builds for the 2.1 branch:
> > Unit/integration tests: *https://builds.apache.org/job/kafka-2.1-jdk8/38/
> > *
> >
> > Please test and verify the release artifacts and submit a vote for this RC,
> > or report any issues so we can fix them and get a new RC out ASAP. Although
> > this release vote requires PMC votes to pass, testing, votes, and bug
> > reports are valuable and appreciated from everyone.
> >
> > Cheers,
> > Dong
> >


Re: [VOTE] 2.1.0 RC0

2018-11-01 Thread Jakub Scholz
+1 (non-binding) ... I used the staged binaries and checked it with
different clients.

On Wed, Oct 24, 2018 at 10:17 AM Dong Lin  wrote:

> Hello Kafka users, developers and client-developers,
>
> This is the first candidate for feature release of Apache Kafka 2.1.0.
>
> This is a major version release of Apache Kafka. It includes 28 new KIPs
> and
>
> critical bug fixes. Please see the Kafka 2.1.0 release plan for more
> details:
>
> *
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=91554044*
>  >
>
> Here are a few notable highlights:
>
> - Java 11 support
> - Support for Zstandard, which achieves compression comparable to gzip with
> higher compression and especially decompression speeds(KIP-110)
> - Avoid expiring committed offsets for active consumer group (KIP-211)
> - Provide Intuitive User Timeouts in The Producer (KIP-91)
> - Kafka's replication protocol now supports improved fencing of zombies.
> Previously, under certain rare conditions, if a broker became partitioned
> from Zookeeper but not the rest of the cluster, then the logs of replicated
> partitions could diverge and cause data loss in the worst case (KIP-320)
> - Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
> - Admin script and admin client API improvements to simplify admin
> operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
> - DNS handling improvements (KIP-235, KIP-302)
>
> Release notes for the 2.1.0 release:
> http://home.apache.org/~lindong/kafka-2.1.0-rc0/RELEASE_NOTES.html
>
> *** Please download, test and vote ***
>
> * Kafka's KEYS file containing PGP keys we use to sign the release:
> http://kafka.apache.org/KEYS
>
> * Release artifacts to be voted upon (source and binary):
> http://home.apache.org/~lindong/kafka-2.1.0-rc0/
>
> * Maven artifacts to be voted upon:
> https://repository.apache.org/content/groups/staging/
>
> * Javadoc:
> http://home.apache.org/~lindong/kafka-2.1.0-rc0/javadoc/
>
> * Tag to be voted upon (off 2.1 branch) is the 2.1.0-rc0 tag:
> https://github.com/apache/kafka/tree/2.1.0-rc0
>
> * Documentation:
> *http://kafka.apache.org/21/documentation.html*
> 
>
> * Protocol:
> http://kafka.apache.org/21/protocol.html
>
> * Successful Jenkins builds for the 2.1 branch:
> Unit/integration tests: *https://builds.apache.org/job/kafka-2.1-jdk8/38/
> *
>
> Please test and verify the release artifacts and submit a vote for this RC,
> or report any issues so we can fix them and get a new RC out ASAP. Although
> this release vote requires PMC votes to pass, testing, votes, and bug
> reports are valuable and appreciated from everyone.
>
> Cheers,
> Dong
>


Re: [VOTE] 2.1.0 RC0

2018-10-24 Thread Andras Beni
+1 (non-binding)

Verified signatures and checksums of release artifacts
Performed quickstart steps on rc artifacts (both scala 2.11 and 2.12) and
one built from tag 2.1.0-rc0

Andras

On Wed, Oct 24, 2018 at 10:17 AM Dong Lin  wrote:

> Hello Kafka users, developers and client-developers,
>
> This is the first candidate for feature release of Apache Kafka 2.1.0.
>
> This is a major version release of Apache Kafka. It includes 28 new KIPs
> and
>
> critical bug fixes. Please see the Kafka 2.1.0 release plan for more
> details:
>
> *
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=91554044*
>  >
>
> Here are a few notable highlights:
>
> - Java 11 support
> - Support for Zstandard, which achieves compression comparable to gzip with
> higher compression and especially decompression speeds(KIP-110)
> - Avoid expiring committed offsets for active consumer group (KIP-211)
> - Provide Intuitive User Timeouts in The Producer (KIP-91)
> - Kafka's replication protocol now supports improved fencing of zombies.
> Previously, under certain rare conditions, if a broker became partitioned
> from Zookeeper but not the rest of the cluster, then the logs of replicated
> partitions could diverge and cause data loss in the worst case (KIP-320)
> - Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
> - Admin script and admin client API improvements to simplify admin
> operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
> - DNS handling improvements (KIP-235, KIP-302)
>
> Release notes for the 2.1.0 release:
> http://home.apache.org/~lindong/kafka-2.1.0-rc0/RELEASE_NOTES.html
>
> *** Please download, test and vote ***
>
> * Kafka's KEYS file containing PGP keys we use to sign the release:
> http://kafka.apache.org/KEYS
>
> * Release artifacts to be voted upon (source and binary):
> http://home.apache.org/~lindong/kafka-2.1.0-rc0/
>
> * Maven artifacts to be voted upon:
> https://repository.apache.org/content/groups/staging/
>
> * Javadoc:
> http://home.apache.org/~lindong/kafka-2.1.0-rc0/javadoc/
>
> * Tag to be voted upon (off 2.1 branch) is the 2.1.0-rc0 tag:
> https://github.com/apache/kafka/tree/2.1.0-rc0
>
> * Documentation:
> *http://kafka.apache.org/21/documentation.html*
> 
>
> * Protocol:
> http://kafka.apache.org/21/protocol.html
>
> * Successful Jenkins builds for the 2.1 branch:
> Unit/integration tests: *https://builds.apache.org/job/kafka-2.1-jdk8/38/
> *
>
> Please test and verify the release artifacts and submit a vote for this RC,
> or report any issues so we can fix them and get a new RC out ASAP. Although
> this release vote requires PMC votes to pass, testing, votes, and bug
> reports are valuable and appreciated from everyone.
>
> Cheers,
> Dong
>


[VOTE] 2.1.0 RC0

2018-10-24 Thread Dong Lin
Hello Kafka users, developers and client-developers,

This is the first candidate for feature release of Apache Kafka 2.1.0.

This is a major version release of Apache Kafka. It includes 28 new KIPs and

critical bug fixes. Please see the Kafka 2.1.0 release plan for more
details:

*https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=91554044*


Here are a few notable highlights:

- Java 11 support
- Support for Zstandard, which achieves compression comparable to gzip with
higher compression and especially decompression speeds(KIP-110)
- Avoid expiring committed offsets for active consumer group (KIP-211)
- Provide Intuitive User Timeouts in The Producer (KIP-91)
- Kafka's replication protocol now supports improved fencing of zombies.
Previously, under certain rare conditions, if a broker became partitioned
from Zookeeper but not the rest of the cluster, then the logs of replicated
partitions could diverge and cause data loss in the worst case (KIP-320)
- Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
- Admin script and admin client API improvements to simplify admin
operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
- DNS handling improvements (KIP-235, KIP-302)

Release notes for the 2.1.0 release:
http://home.apache.org/~lindong/kafka-2.1.0-rc0/RELEASE_NOTES.html

*** Please download, test and vote ***

* Kafka's KEYS file containing PGP keys we use to sign the release:
http://kafka.apache.org/KEYS

* Release artifacts to be voted upon (source and binary):
http://home.apache.org/~lindong/kafka-2.1.0-rc0/

* Maven artifacts to be voted upon:
https://repository.apache.org/content/groups/staging/

* Javadoc:
http://home.apache.org/~lindong/kafka-2.1.0-rc0/javadoc/

* Tag to be voted upon (off 2.1 branch) is the 2.1.0-rc0 tag:
https://github.com/apache/kafka/tree/2.1.0-rc0

* Documentation:
*http://kafka.apache.org/21/documentation.html*


* Protocol:
http://kafka.apache.org/21/protocol.html

* Successful Jenkins builds for the 2.1 branch:
Unit/integration tests: *https://builds.apache.org/job/kafka-2.1-jdk8/38/
*

Please test and verify the release artifacts and submit a vote for this RC,
or report any issues so we can fix them and get a new RC out ASAP. Although
this release vote requires PMC votes to pass, testing, votes, and bug
reports are valuable and appreciated from everyone.

Cheers,
Dong