Two doubts about the use of kafka

1.When I started kafka, I saw that the root directory registered in zookeeper is "/",but my zookeeper has other applications in use, so I want to modify it as "/kafka01". How should I configure it or document it? 2.Our machine scale is relatively large, so we need to monitor the changes of kafka

Re: Kafka ACL: topic with wildcard (*)

Thanks. it worked. Dhirendra. On Tue, Jul 13, 2021 at 6:48 PM Ran Lupovich wrote: > As you can see, using only *, it will create some trash 🗑 authorizations > which you might want to delete > > בתאריך יום ג׳, 13 ביולי 2021, 16:16, מאת Ran Lupovich ‏< > ranlupov...@gmail.com>: > > > Hello 👋 in o

Apache Kafka 2.8.0 and Zookeeper

We are planning on upgrading to Apache Kafka 2.8.0, but are running an older version of Zookeeper, which is 3.4.12. Based on any of the release notes for Apache Kafka it is not clear if we need to upgrade to Zookeeper 3.5.7, or can we still run with v3.4.12. Any thoughts or recommendations around

Re: Kafka Consumer Retries Failing

Apologies ... gmail is adding a link to : - Format error with copy paste. The HTTP protocol is NOT present in the logs. Adding logs without the link here: org.apache.kafka.common.errors.DisconnectException: null {"time":"2021-07-07T22:13:37,385","severity":"INFO","component":"org.apache.kafka.cl

Re: Kafka Consumer Retries Failing

I would suggest you will check you bootstrap definition and server.properties, somehow it looks for http://ip:9092 , kafka is not using http protocol, seems something not configured correctly בתאריך יום ג׳, 13 ביולי 2021, 21:46, מאת Rahul Patwari ‏< rahulpatwari8...@gmail.com>: > Hi, > > We are f

Re: does kafka streams guarantee EOS with external producer used in application?

If you want to use EOS, you cannot use your own producer, but you need to use a "sink node" (via `addSink()` or `to()`). For at-least-once, if you use sync-writes, you should still get at-least-once guarantees. -Matthias On 7/9/21 4:12 AM, Pushkar Deole wrote: > Matthias, > > Do you have any in

Re: Add Jira ID To Kafka Contributor group

Added you. On 7/7/21 12:19 AM, nannft...@outlook.com wrote: > Hello ! I want to add my Jira ID Nannf to Kafka Contributor group. >

Kafka Consumer Retries Failing

Hi, We are facing an issue in our application where Kafka Consumer Retries are failing whereas a restart of the application is making the Kafka Consumers work as expected again. Kafka Server version is 2.5.0 - confluent 5.5.0 Kafka Client Version is 2.4.1 - {"component":"org.apache.kafka.common.u

Re: Jira ticket assignment

Hi Laxminarayan, Can you provide your user name? Thanks, Bill On Sat, Jul 10, 2021 at 12:53 PM Laxminarayan Choudhury < choudhury.laxminara...@gmail.com> wrote: > Hi , > Could you please add the below Jira user to contributor list so that a jira > ticket can be assigned . > jira user name : > >

Re: Kafka ACL: topic with wildcard (*)

As you can see, using only *, it will create some trash 🗑 authorizations which you might want to delete בתאריך יום ג׳, 13 ביולי 2021, 16:16, מאת Ran Lupovich ‏< ranlupov...@gmail.com>: > Hello 👋 in order to grant READ access to all topics like you did instead > of just * , which in this case will

Re: Kafka ACL: topic with wildcard (*)

Hello 👋 in order to grant READ access to all topics like you did instead of just * , which in this case will take the files in current directory and as the name of the topic, use "*" with the " before and after.. good luck בתאריך יום ג׳, 13 ביולי 2021, 15:40, מאת Dhirendra Singh ‏< dhirendr...@gma

Re: Kafka ACL: topic with wildcard (*)

Use "*" בתאריך יום ג׳, 13 ביולי 2021, 15:40, מאת Dhirendra Singh ‏< dhirendr...@gmail.com>: > Hi All, > I am trying to add an acl for a user to have read permission on all topics. > I executed the following command. > > kafka-acls.sh --bootstrap-server kafka-dev:9092 --command-config > client.pro

Kafka ACL: topic with wildcard (*)

Hi All, I am trying to add an acl for a user to have read permission on all topics. I executed the following command. kafka-acls.sh --bootstrap-server kafka-dev:9092 --command-config client.properties --add --allow-principal User:kafka-consumer --operation read --topic * The output i got from the

Re: disappearing messages with kafka streams

Hi Günter, What is the timestamp of the records? The difference between the system time on the brokers and the record timestamp is used to decide whether a record segment should be removed because its retention time is exceeded. So if the retention time of the topic is set to 1.5 days, the re

disappearing messages with kafka streams

Hi, we come across a mysterious behavior with Kafka streams clients. After writing about 4 messages to a topic, they are suddenly no longer available and the topic is empty. The client is still alive. We use the following defaults as properties for the topic     - retention.ms=129600