Thank you for answering RUI. Yeah, groups existes, one per partition. No yet, trying to get access to them.
On Mon, Mar 25, 2024 at 3:41 PM Rui Abreu <rui.ab...@gmail.com> wrote: > > Having "no active members" is expected since the assignment of partitions is > controlled by Spout instead of Kafka. However, the consumer group must be > present in Kafka in a healthy system > Have you check the broker logs for any errors? > > On Mon, Mar 25, 2024, 19:03 Juan Pablo Garbora <j...@senseware.co> wrote: >> >> is not present. >> >> ~ kafka-consumer-groups.sh --command-config >> ~/.kafka/kafka.production.properties --bootstrap-server >> xxx.confluent.cloud:9092 --describe --grou Consumer group 'zzz' has no >> active members. >> >> >> On Mon, Mar 25, 2024 at 11:25 AM Rui Abreu <rui.ab...@gmail.com> wrote: >> > >> > Can you query your Kafka broker using Kafka's binaries and check if the >> > consumer group is present? (something like ./kafka-consumer-groups.sh >> > --bootstrap-server $broker:9092 --describe --consumer-group $consumerGroup) >> > >> > And also check the broker side logs? >> > >> > >> > On Mon, 25 Mar 2024 at 16:19, Juan Pablo Garbora <j...@attuneiot.com> >> > wrote: >> >> >> >> got a Storm 2.6.0 with Kafka Spout (setting 32 parallelismHint) and >> >> sometimes I'm getting: >> >> >> >> Is this normal ? >> >> >> >> Error >> >> java.lang.RuntimeException: org.apache.kafka.common.KafkaException: >> >> Unexpected error in commit: The group id does not exist. >> >> at org.apache.storm.utils.Utils$1.run(Utils.java:413) >> >> ~[storm-client-2.6.0.jar:2.6.0] >> >> at java.base/java.lang.Thread.run(Thread.java:1583) [?:?] >> >> Caused by: org.apache.kafka.common.KafkaException: Unexpected error in >> >> commit: The group id does not exist. >> >> at >> >> org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:1482) >> >> ~[stormjar.jar:?] >> >> at >> >> org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:1376) >> >> ~[stormjar.jar:?] >> >> at >> >> org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:1270) >> >> ~[stormjar.jar:?] >> >> at >> >> org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:1245) >> >> ~[stormjar.jar:?] >> >> at >> >> org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:206) >> >> ~[stormjar.jar:?] >> >> at >> >> org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:169) >> >> ~[stormjar.jar:?] >> >> at >> >> org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:129) >> >> ~[stormjar.jar:?] >> >> at >> >> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.fireCompletion(ConsumerNetworkClient.java:617) >> >> ~[stormjar.jar:?] >> >> at >> >> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.firePendingCompletedRequests(ConsumerNetworkClient.java:427) >> >> ~[stormjar.jar:?] >> >> at >> >> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:312) >> >> ~[stormjar.jar:?] >> >> at >> >> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:230) >> >> ~[stormjar.jar:?] >> >> at >> >> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:214) >> >> ~[stormjar.jar:?] >> >> at >> >> org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.commitOffsetsSync(ConsumerCoordinator.java:1189) >> >> ~[stormjar.jar:?] >> >> at >> >> org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1450) >> >> ~[stormjar.jar:?] >> >> at >> >> org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1397) >> >> ~[stormjar.jar:?] >> >> at >> >> org.apache.storm.kafka.spout.KafkaSpout.pollKafkaBroker(KafkaSpout.java:367) >> >> ~[stormjar.jar:?] >> >> at >> >> org.apache.storm.kafka.spout.KafkaSpout.nextTuple(KafkaSpout.java:287) >> >> ~[stormjar.jar:?] >> >> at >> >> org.apache.storm.executor.spout.SpoutExecutor$2.call(SpoutExecutor.java:187) >> >> ~[storm-client-2.6.0.jar:2.6.0] >> >> at >> >> org.apache.storm.executor.spout.SpoutExecutor$2.call(SpoutExecutor.java:153) >> >> ~[storm-client-2.6.0.jar:2.6.0] >> >> at org.apache.storm.utils.Utils$1.run(Utils.java:398) >> >> ~[storm-client-2.6.0.jar:2.6.0] >> >> ... 1 more
