Re: Cannot read messages using a specific group

2018-12-26 Thread Karim Lamouri
Hi all, I set the log level to INFO and here are the logs. I’m not sure why those logs say that the Group coordinator is unavailable or invalid because the brokers are all up (including the ones with the ip specified in the log) and just changing the consumer group makes it work. If anybody had a

Re: Cannot read messages using a specific group

2018-12-20 Thread Karim Lamouri
Hi Ryanne, Here is the output of the command: bin/kafka-consumer-groups --bootstrap-server server --describe --group group_name Error: Executing consumer group command failed due to The consumer group command timed out while waiting for group to initialize The group_name consumer group is not ru

Re: Cannot read messages using a specific group

2018-12-20 Thread Karim Lamouri
The new consumer was reading from latest. What is interesting is that the consumer group that is stuck cannot be reset by the CLI (to either latest or earliest) and is still not working way past the retention period of all the topics (from the consumers with latest or earliest auto.offset.reset).

Re: Cannot read messages using a specific group

2018-12-19 Thread M. Manna
what Is your offset reset point (earliest/latest) ? Just because you can read it by changing consumer group doesn’t mean you are reading the latest data, but may be from the beginning. On Wed, 19 Dec 2018 at 13:54, Karim Lamouri wrote: > Hi, > > One of our brokers went down and when it came b

Cannot read messages using a specific group

2018-12-19 Thread Karim Lamouri
Hi, One of our brokers went down and when it came back up the consumer of one topic couldn’t read using the original consumer group. This doesn’t output anything: bin/kafka-console-consumer --bootstrap-server server --topic ASSETS --group group_name However, if I change the name of the group it

Re: Cannot read messages using a specific group

2018-12-18 Thread Ryanne Dolan
Karim, can you inspect the offsets using kafka-consumer-groups.sh and let us know what you see? Also, is it possible that "group_name" is being used by a consumer group that is still running? For example, say you have a topic with one partition and a consumer with "group_name" already. In that cas

Cannot read messages using a specific group

2018-12-18 Thread Karim Lamouri
Hi, One of our brokers went down and when it came back up the consumer of one topic couldn’t read using the original consumer group. This doesn’t output anything: bin/kafka-console-consumer --bootstrap-server server --topic ASSETS --group group_name However, if I change the name of the group it

Cannot read messages using a specific group.

2018-12-18 Thread Karim Lamouri
Hi, One of our brokers went down and when it came back up the consumer of one topic couldn’t read using the original consumer group. This doesn’t output anything: bin/kafka-console-consumer --bootstrap-server server --topic ASSETS --group group_name However, if I change the name of the group it