Re: [ANNOUNCE] Apache Kafka 2.2.1

2019-06-03 Thread Harsha
Thanks Vahid. -Harsha On Mon, Jun 3, 2019, at 9:21 AM, Jonathan Santilli wrote: > That's fantastic! thanks a lot Vahid for managing the release. > > -- > Jonathan > > > > > On Mon, Jun 3, 2019 at 5:18 PM Mickael Maison > wrote: > > > Thank you Vahid > > > > On Mon, Jun 3, 2019 at 5:12 PM Wl

Re: Transactional markers are not deleted from log segments when policy is compact

2019-06-03 Thread Pranavi Chandramohan
Thanks for confirming that Jonathan. Cheers! On Mon, 3 Jun 2019, 7:27 pm Jonathan Santilli, wrote: > Hello Pranavi, > > according to the changes, that should be the case: "The producer is no > longer active, which means we can delete all records for that producer." > > > https://github.com/apac

Re: How to prevent data loss in "read-process-write" application?

2019-06-03 Thread Guozhang Wang
Hello, Transactional messaging is actually designed to solve this scenario exactly (pun intended :). Although in your app you may not have stateful logic, it is still necessary to enable transactional messaging if you are using consumer/producer, or just enable EOS if you are using streams. Guoz

Re: Can't see topics anymore after upgrade from 1.1 to 2.2.1

2019-06-03 Thread M. Manna
Zookeeper hosted topics are often not displayed if you use bootstrap-server; aka new configs. Try using zookeeper. You should still see your topics. Thanks, On Mon, 3 Jun 2019 at 17:12, j.lamme...@chello.nl wrote: > Hi, > > Just upgraded my Kafka test environment from 1.1 to 2.2.1. > What I di

Re: [ANNOUNCE] Apache Kafka 2.2.1

2019-06-03 Thread Jonathan Santilli
That's fantastic! thanks a lot Vahid for managing the release. -- Jonathan On Mon, Jun 3, 2019 at 5:18 PM Mickael Maison wrote: > Thank you Vahid > > On Mon, Jun 3, 2019 at 5:12 PM Wladimir Schmidt > wrote: > > > > Thanks Vahid! > > > > On Mon, Jun 3, 2019, 16:23 Vahid Hashemian wrote: > >

Re: [ANNOUNCE] Apache Kafka 2.2.1

2019-06-03 Thread Mickael Maison
Thank you Vahid On Mon, Jun 3, 2019 at 5:12 PM Wladimir Schmidt wrote: > > Thanks Vahid! > > On Mon, Jun 3, 2019, 16:23 Vahid Hashemian wrote: > > > The Apache Kafka community is pleased to announce the release for Apache > > Kafka 2.2.1 > > > > This is a bugfix release for Kafka 2.2.0. All of t

Re: [ANNOUNCE] Apache Kafka 2.2.1

2019-06-03 Thread Wladimir Schmidt
Thanks Vahid! On Mon, Jun 3, 2019, 16:23 Vahid Hashemian wrote: > The Apache Kafka community is pleased to announce the release for Apache > Kafka 2.2.1 > > This is a bugfix release for Kafka 2.2.0. All of the changes in this > release can be found in the release notes: > https://www.apache.org/

Can't see topics anymore after upgrade from 1.1 to 2.2.1

2019-06-03 Thread j . lammerts
Hi, Just upgraded my Kafka test environment from 1.1 to 2.2.1. What I did: 1) Untarred Scala 2.11-Kafka 2.2.1 file in /opt directory (BTW: OS = CentOS 7.6) which creates directory kafka_2.11-2.2.1 2) Removed symbolic link "kafka" from old environment kafka_2.11-1.1.0 3) Created a new symbolic lin

[ANNOUNCE] Apache Kafka 2.2.1

2019-06-03 Thread Vahid Hashemian
The Apache Kafka community is pleased to announce the release for Apache Kafka 2.2.1 This is a bugfix release for Kafka 2.2.0. All of the changes in this release can be found in the release notes: https://www.apache.org/dist/kafka/2.2.1/RELEASE_NOTES.html You can download the source and binary re

Re: Transactional markers are not deleted from log segments when policy is compact

2019-06-03 Thread Jonathan Santilli
Hello Pranavi, according to the changes, that should be the case: "The producer is no longer active, which means we can delete all records for that producer." https://github.com/apache/kafka/pull/6715/files#diff-d7330411812d23e8a34889bee42fedfeR622 Cheers! -- Jonathan On Mon, Jun 3, 2019 at