Re: Kafka Connect gets into a rebalance loop

2017-02-15 Thread Willy Hoang
umer as well -- it sounds > like it is getting hung up and not actually getting in sync to the end of > the log, but obviously that shouldn't happen since the consumer should be > continuously trying to read any new messages on the topic. > > -Ewen > > On Wed, Jan 4, 201

Re: Kafka Connect gets into a rebalance loop

2017-01-04 Thread Willy Hoang
I'm also running into this issue whenever I try to scale up from 1 worker to multiple. I found that I can sometimes hack around this by (1) waiting for the second worker to come up and start spewing out these log messages and then (2) sending a request to the REST API to update one of my connectors

Per-topic retention.bytes uses kilobytes not bytes?

2015-04-02 Thread Willy Hoang
Hello, I’ve been having trouble using the retention.bytes per-topic configuration (using Kafka version 0.8.2.1). I had the same issue that users described in these two threads where logs were growing to sizes larger than retention.bytes. I couldn’t find an explanation to explain the issue in ei