Hi, What are the ACLs for the topics and groups concerned?
btw my kafka-console-consumer.sh supports offset, were you using some other command? Cheers, Tom On 2 August 2017 at 15:31, Alisa Bohac <[email protected]> wrote: > Hello, > > I recently integrated my Kafka broker with SSL authentication. I now am > able to use SSL to authenticate the producer and consumer to the broker, > and they can communicate as intended. Additionally, I implemented an > access control list to limit access to the topics on the broker. However, > when I try to consume all the messages from a specific topic using the > --from-beginning flag, I only get the messages that have not yet been > consumed. > > I did some researching and found this post: > https://jeqo.github.io/post/2017-01-31-kafka-rewind-consumers-offset/ > > This man was able to circumvent the issue by using the --offset flag, but > our version of Kafka says that --offset is not a recognized option. > > I have been playing around with this issue for a while and have been unable > to find a way around this problem. I need to be able to view all messages > from a topic, regardless of if they have been consumed or not. > > I noticed that I cannot remove the consumer from a group because > authorizer.class.name=kafka.security.auth.SimpleAclAuthorizer then denies > the consumer's requests. > > Is there a way to view all messages, while still using consumer groups, an > access control list, and SSL authentication? > > Thanks, > > Alisa > > -- > Alisa Bohac > University of Nebraska at Omaha > Undergraduate- Information Assurance >
