Re: Kafka won't replicate from a specific broker

Unfortunately I think you hit this bug: https://issues.apache.org/jira/browse/KAFKA-4477 The only option I know of is to reboot the affected broker. And upgrade to 0.10.1.1 as quickly as possible. We haven't seen this issue on 0.10.1.1.RC0. Re

Consumer failover issue when coordinator dies (e.g. broker restart)

Hey guys, We're running Kafka 0.9.0.1 with Java 7 on FreeBSD. We are experiencing unrecoverable issues in our consumers, e.g. when restarting brokers. The consumers start reporting that the coordinator died (which in general is correct, because the coordinator was restarted). However, the consu

Re: To find the Lag of consumer offset using kafka client library

Hi Gourab, Check this out: https://github.com/linkedin/Burrow Regards Jan > On 29 Sep 2016, at 15:47, Gourab Chowdhury wrote: > > I can get the *Lag* of offsets with the following command:- > > bin/kafka-run-class.sh kafka.admin.ConsumerGroupCommand --z

Re: Offset Tools

Hi Joerg, We recently built a tool for fetching current offsets (per partition) for a given consumer group. Also for setting the group to a specific offset. It even allows to reset a consumer group to a given timestamp by running bisect (binary search) on the messages. Unfortunately we're usin

Re: [DISCUSS] Java 8 as a minimum requirement

Hi Ismael, Unfortunately Java 8 doesn't play nice with FreeBSD. We have seen a lot of JVM crashes running our 0.9 brokers on Java 8... Java 7 on the other hand is totally stable. Until these issues have been addressed, this would cause some serious issues for us. Regards Jan

Re: Three consumers on a single partition

Hi Rami, Each consumer will receive every single message if they belong to different consumer groups. Messages will only be distributed between consumers of the same consumer group. So make sure they are in the same consumer group, beware in your case this means 2 of the 3 consumers will be

Re: Can we delete topic in kafka

You have to allow topic deletion in server.properties first. delete.topic.enable = true Regards Jan > On 11 May 2016, at 09:48, Snehalata Nagaje > wrote: > > > > Hi , > > Can we delete certain topic in kafka? > > I have deleted using command > > ./kafka-topics.sh --delete --topic top

Re: How to deserialize the object without avro schema?

Hi, avro Schemas imply a pretty big overhead, if you would include them in every message. It's good practice to include a schema id with the message... Then you need a schema repository to lookup the matching schema based on the id. Have a look at confluent.io. They offer a schema repo among o

Re: Consumers doesn't always poll first messages

Hi Robin, Why would you expect it to start from the first message? You're comitting the read offsets automatically every second. The offset is persisted, next time you consume again, it will start at the persisted offset again. consumerProperties.put(ConsumerConfig.ENABLE_AUTO_COMMIT_CONFIG,

Kafka Rest Proxy

Hey guys, Is someone using the kafka rest proxy from confluent? We have an issue, that all messages for a certain topic end up in the same partition. Has anyone faced this issue before? We're not using a custom partitioner class, so it's using the default partitioner. We're sending