Having "no active members" is expected since the assignment of partitions is controlled by Spout instead of Kafka. However, the consumer group must be present in Kafka in a healthy system Have you check the broker logs for any errors?
On Mon, Mar 25, 2024, 19:03 Juan Pablo Garbora <j...@senseware.co> wrote: > is not present. > > ~ kafka-consumer-groups.sh --command-config > ~/.kafka/kafka.production.properties --bootstrap-server > xxx.confluent.cloud:9092 --describe --grou Consumer group 'zzz' has no > active members. > > > On Mon, Mar 25, 2024 at 11:25 AM Rui Abreu <rui.ab...@gmail.com> wrote: > > > > Can you query your Kafka broker using Kafka's binaries and check if the > consumer group is present? (something like ./kafka-consumer-groups.sh > --bootstrap-server $broker:9092 --describe --consumer-group $consumerGroup) > > > > And also check the broker side logs? > > > > > > On Mon, 25 Mar 2024 at 16:19, Juan Pablo Garbora <j...@attuneiot.com> > wrote: > >> > >> got a Storm 2.6.0 with Kafka Spout (setting 32 parallelismHint) and > sometimes I'm getting: > >> > >> Is this normal ? > >> > >> Error > >> java.lang.RuntimeException: org.apache.kafka.common.KafkaException: > Unexpected error in commit: The group id does not exist. > >> at org.apache.storm.utils.Utils$1.run(Utils.java:413) > ~[storm-client-2.6.0.jar:2.6.0] > >> at java.base/java.lang.Thread.run(Thread.java:1583) [?:?] > >> Caused by: org.apache.kafka.common.KafkaException: Unexpected error in > commit: The group id does not exist. > >> at > org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:1482) > ~[stormjar.jar:?] > >> at > org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:1376) > ~[stormjar.jar:?] > >> at > org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:1270) > ~[stormjar.jar:?] > >> at > org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:1245) > ~[stormjar.jar:?] > >> at > org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:206) > ~[stormjar.jar:?] > >> at > org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:169) > ~[stormjar.jar:?] > >> at > org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:129) > ~[stormjar.jar:?] > >> at > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.fireCompletion(ConsumerNetworkClient.java:617) > ~[stormjar.jar:?] > >> at > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.firePendingCompletedRequests(ConsumerNetworkClient.java:427) > ~[stormjar.jar:?] > >> at > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:312) > ~[stormjar.jar:?] > >> at > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:230) > ~[stormjar.jar:?] > >> at > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:214) > ~[stormjar.jar:?] > >> at > org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.commitOffsetsSync(ConsumerCoordinator.java:1189) > ~[stormjar.jar:?] > >> at > org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1450) > ~[stormjar.jar:?] > >> at > org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1397) > ~[stormjar.jar:?] > >> at > org.apache.storm.kafka.spout.KafkaSpout.pollKafkaBroker(KafkaSpout.java:367) > ~[stormjar.jar:?] > >> at > org.apache.storm.kafka.spout.KafkaSpout.nextTuple(KafkaSpout.java:287) > ~[stormjar.jar:?] > >> at > org.apache.storm.executor.spout.SpoutExecutor$2.call(SpoutExecutor.java:187) > ~[storm-client-2.6.0.jar:2.6.0] > >> at > org.apache.storm.executor.spout.SpoutExecutor$2.call(SpoutExecutor.java:153) > ~[storm-client-2.6.0.jar:2.6.0] > >> at org.apache.storm.utils.Utils$1.run(Utils.java:398) > ~[storm-client-2.6.0.jar:2.6.0] > >> ... 1 more >
