Re: Partitions reassignment is failing in Kafka 1.1.0

I am generating the reassignent.json like below /home/ubuntu/deploy/kafka/bin/kafka-reassign-partitions.sh --zookeeper 127.0.0.1:2181 --generate --topics-to-move-json-file /home/ubuntu/deploy/kafka/topics_to_move.json --broker-list '%s' |tail -1 > /home/ubuntu/deploy/kafka/reassignment.json"

[VOTE] 1.0.2 RC1

Hello Kafka users, developers and client-developers, This is the second candidate for release of Apache Kafka 1.0.2. This is a bug fix release addressing 27 tickets: https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+1.0.2 Release notes for the 1.0.2 release:

Re: Partitions reassignment is failing in Kafka 1.1.0

Please find the server.properties from one of the broker. broker.id=0 port=9092 num.network.threads=3 num.io.threads=8 socket.send.buffer.bytes=102400 socket.receive.buffer.bytes=102400 socket.request.max.bytes=104857600 log.dirs=/var/lib/kafka/kafka-logs num.recovery.threads.per.data.dir=1

Re: Partitions reassignment is failing in Kafka 1.1.0

Seems to be related to KIP-113. server.properties didn't go thru. Do you mind pastebin'ing its content ? If you can pastebin logs from broker, that should help. Thanks On Fri, Jun 29, 2018 at 10:37 AM, Debraj Manna wrote: > Hi > > I altered a topic like below in kafka 1.1.0 > >

Re: Partitions reassignment is failing in Kafka 1.1.0

Hi Anyone any thoughts? On Fri 29 Jun, 2018, 11:07 PM Debraj Manna, wrote: > Hi > > I altered a topic like below in kafka 1.1.0 > > /home/ubuntu/deploy/kafka/bin/kafka-topics.sh --zookeeper 127.0.0.1:2181 > --alter --topic Topic3 --config min.insync.replicas=2 > > But whenever I am trying to

Re: Visible intermediate state for KGroupedTable aggregation

I see what you are saying -- this is what I meant by eventual consistency guarantee. What is unclear to me is, why you need to re-group the KTable? The issue you describe only occurs for this operation. -Matthias On 6/29/18 3:44 PM, Thilo-Alexander Ginkel wrote: > On Sat, Jun 30, 2018 at 12:16

Re: [kafka-clients] [VOTE] 0.11.0.3 RC0

Hi Matthias, +1 (binding) Verified binary using quick start, verified source by building and running tests, checked release notes. Thanks for running the release! Regards, Rajini On Fri, Jun 29, 2018 at 11:07 PM, Jun Rao wrote: > Hi, Matthias, > > Thanks for running the release. Verified

Re: Possible bug? Duplicates when searching kafka stream state store with caching

Hello Christian, Since you are calling fetch(key, start, end) I'm assuming that duplicateStore is a WindowedStore. With a windowed store, it is possible that a single key can fall into multiple windows, and hence be returned from the WindowStoreIterator, note its type is , V> So I'd first want

Re: [kafka-clients] [VOTE] 1.1.1 RC2

Hi Dong, +1 (binding) Verified binary using quick start, ran tests from source, checked release notes. Thanks for running the release! Regards, Rajini On Fri, Jun 29, 2018 at 11:11 PM, Jun Rao wrote: > Hi, Dong, > > Thanks for running the release. Verified quickstart on scala 2.12 binary.

Re: Visible intermediate state for KGroupedTable aggregation

On Sat, Jun 30, 2018 at 12:16 AM Matthias J. Sax wrote: > You cannot suppress those records, because both are required for > correctness. Note, that each event might go to a different instance in > the downstream aggregation -- that's why both records are required. > > Not sure what the problem

Re: Visible intermediate state for KGroupedTable aggregation

Hi, You cannot suppress those records, because both are required for correctness. Note, that each event might go to a different instance in the downstream aggregation -- that's why both records are required. Not sure what the problem for your business logic is. Note, that Kafka Streams provides

Re: [kafka-clients] [VOTE] 1.1.1 RC2

Hi, Dong, Thanks for running the release. Verified quickstart on scala 2.12 binary. +1 Jun On Thu, Jun 28, 2018 at 6:12 PM, Dong Lin wrote: > Hello Kafka users, developers and client-developers, > > This is the second candidate for release of Apache Kafka 1.1.1. > > Apache Kafka 1.1.1 is a

Re: [kafka-clients] [VOTE] 0.11.0.3 RC0

Hi, Matthias, Thanks for running the release. Verified quickstart on scala 2.12 binary. +1 Jun On Fri, Jun 22, 2018 at 3:14 PM, Matthias J. Sax wrote: > Hello Kafka users, developers and client-developers, > > This is the first candidate for release of Apache Kafka 0.11.0.3. > > This is a bug

Re: [kafka-clients] [VOTE] 0.10.2.2 RC1

Hi, Matthias, Thanks for running the release. Verified quickstart on scala 2.12 binary. +1 Jun On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax wrote: > Hello Kafka users, developers and client-developers, > > This is the second candidate for release of Apache Kafka 0.10.2.2. > > Note, that

Re: [VOTE] 1.0.2 RC0

Thanks for pointing out Jason. I double checked and there was a bug in the release script. The artifact were not built. I'll roll a new RC. -Matthias On 6/29/18 2:01 PM, Jason Gustafson wrote: > Hey Matthias, > > I don't see the artifacts for scala 2.12. Did they not get uploaded? > >

Re: [VOTE] 0.10.2.2 RC1

+1 Ran test suite. Checked signatures. On Fri, Jun 29, 2018 at 10:21 AM, Jason Gustafson wrote: > +1 (binding). I checked release notes, documentation, and went through the > quickstart. > > Thanks Matthias! > > On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax > wrote: > > > Hello Kafka

Visible intermediate state for KGroupedTable aggregation

Hello everyone, I have implemented a Kafka Streams service using the Streams DSL. Within the topology I am using A KGroupedTable, on which I perform an aggregate using an adder and subtractor. AFAICS (at least when using TopologyTestDriver) the intermediate state created by the subtractor is

Kafka cannot connect to broker

Hey Everyone, I have been experiencing some problems and have not been able to find sufficient documentation online to help me figure out the root cuase. I have a 3 node kafka cluster set up on 3 different Windows 2012 servers. The cluster runs perfectly fine, ingesting data that is being sent

RE: [VOTE] 0.10.2.2 RC1

Sorry everyone, I meant to change the subject of this email but forgot to before I sent it. I did not mean to hijack this thread. I apologize for the interruption. -Steve -Original Message- From: Coluccio, Stephen Sent: Friday, June 29, 2018 2:05 PM To: Kafka Users Cc: dev ;

Re: [VOTE] 0.10.2.2 RC1

+1 (binding). Verified java docs, and ran the unit tests with the source tgz. Guozhang On Fri, Jun 29, 2018 at 10:22 AM Jason Gustafson wrote: > +1 (binding). I checked release notes, documentation, and went through the > quickstart. > > Thanks Matthias! > > On Fri, Jun 22, 2018 at 6:43 PM,

Possible bug? Duplicates when searching kafka stream state store with caching

Hi all, I'll first describe a simplified view of relevant parts of our setup (which should be enough to repro), describe the behavior we're seeing, and then note some information I've come across after digging in a bit. We have a kafka stream application, and one of our transform steps keeps a

[VOTE] 2.0.0 RC1

Hello Kafka users, developers and client-developers, This is the second candidate for release of Apache Kafka 2.0.0. This is a major version release of Apache Kafka. It includes 40 new KIPs and several critical bug fixes. Please see the 2.0.0 release plan for more details:

RE: [VOTE] 0.10.2.2 RC1

Hey Everyone, I have been experiencing some problems and have not been able to find sufficient documentation online to help me figure out the root cuase. I have a 3 node kafka cluster set up on 3 different Windows 2012 servers. The cluster runs perfectly fine, ingesting data that is being sent

Partitions reassignment is failing in Kafka 1.1.0

Hi I altered a topic like below in kafka 1.1.0 /home/ubuntu/deploy/kafka/bin/kafka-topics.sh --zookeeper 127.0.0.1:2181 --alter --topic Topic3 --config min.insync.replicas=2 But whenever I am trying to verify the reassignment it is showing the below exception

Re: [VOTE] 0.10.2.2 RC1

+1 (binding). I checked release notes, documentation, and went through the quickstart. Thanks Matthias! On Fri, Jun 22, 2018 at 6:43 PM, Matthias J. Sax wrote: > Hello Kafka users, developers and client-developers, > > This is the second candidate for release of Apache Kafka 0.10.2.2. > >