Re: [Question] About Kafka producer design decision making

Hi. I also guess the main reason for using Future was for JDK1.7 support which is no longer necessary in the current Kafka version. Actually, there's a KIP about this: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=100829459 but it seems it's not active now. > I wonder if it is

Re: Question about kafka log retention

Hello Xiaochi , I am not sure if I have understood the problem correctly but beware the fact that only old log segments and not the current log segment are taken into account for deletions. So if you want the data to be deleted in a timely manner, you also need to configure a tighter interval

Re: Question about Kafka ACL

You should investigate why person-b can create user and grant ACLs. Here might be some good reading on ACL related setup: https://docs.confluent.io/platform/current/kafka/authorization.html [image: Confluent] Wu Shilin Solution Architect +6581007012 Follow us: [image:

Re: Question about Kafka TLS

trust-store AKA $JAVA_HOME/lib/security/cacerts is the system-wide location for all of your certificates when your CA-server starts up unless otherwise specified CA-Server will lookup root cert(s) in truststore/cacerts if you have not installed all your root-certs into cacerts you should do so

Re: Question about Kafka TLS

Hi Thomas, We recently fixed a bug https://issues.apache.org/jira/browse/KAFKA-8191 , which allows users to configure their own KeyManager, TrustManager. One can implement these KeyManagers and pass them as configs and these Keymanagers can make a call to service to fetch a certif

Re: question about kafka topic

PM > To: users@kafka.apache.org > Subject: Re: question about kafka topic > > Writes, must always go to the partition leader, ie, if an error occurs, the > message cannot simply be delivered to a different broker. > > However, if a broker is in bad shape, it could get leaderhship r

RE: question about kafka topic

Sorry I did not mention one point. I am seeing this error on consumer side. -Original Message- From: Matthias J. Sax [mailto:matth...@confluent.io] Sent: Sunday, March 10, 2019 11:01 PM To: users@kafka.apache.org Subject: Re: question about kafka topic Writes, must always go to the

Re: question about kafka topic

Writes, must always go to the partition leader, ie, if an error occurs, the message cannot simply be delivered to a different broker. However, if a broker is in bad shape, it could get leaderhship revoked and a healthy broker would get leadership assigned. The producer can detect this automaticall

Re: Question about Kafka Streams error message when a message is larger than the maximum size the server will accept

Yes that is correlated, thanks for the reminder. I've updated the JIRA to reflect your observations as well. Guozhang On Wed, Mar 28, 2018 at 12:41 AM, Mihaela Stoycheva < mihaela.stoych...@gmail.com> wrote: > Hello Guozhang, > > Thank you for the answer, that could explain what is happening.

Re: Question about Kafka Streams error message when a message is larger than the maximum size the server will accept

Hello Guozhang, Thank you for the answer, that could explain what is happening. Is it possible that this is related in some way to https://issues.apache.org/jira/browse/KAFKA-6538? Mihaela On Wed, Mar 28, 2018 at 2:21 AM, Guozhang Wang wrote: > Hello Mihaela, > > It is possible that when you h

Re: Question about Kafka Streams error message when a message is larger than the maximum size the server will accept

Hello Mihaela, It is possible that when you have caching enabled, the value of the record has already been serialized before sending to the changelogger while the key was not. Admittedly it is not very friendly for trouble-shooting related log4j entries.. Guozhang On Tue, Mar 27, 2018 at 5:25

Re: Question about Kafka

mon.errors.TimeoutException: Expiring 61 record(s) > for due to 30001 ms has passed since batch creation plus linger time " > > Thanks in advance > Maha > > > From: "MAHA ALSAYASNEH" > To: "users" > Sent: Tuesday, September 19, 2

Re: Question about Kafka

ms has passed since batch creation plus linger time " > > Thanks in advance > Maha > > > From: "MAHA ALSAYASNEH" > To: "users" > Sent: Tuesday, September 19, 2017 6:18:25 PM > Subject: Re: Question about Kafka > > Well I

Re: Question about Kafka

t: Tuesday, September 19, 2017 6:18:25 PM Subject: Re: Question about Kafka Well I kept the defualt: log.retention.hours=168 Here are my broker configurations: # Server Basics # # The id of the broker. This must be set to a

Re: Question about Kafka

; Sent: Tuesday, September 19, 2017 6:11:05 PM Subject: Re: Question about Kafka What is the retention time on the topic you are publishing to? From: MAHA ALSAYASNEH Sent: Tuesday, September 19, 2017 10:25:15 AM To: users@kafka.apache.org Subject: Qu

Re: Question about Kafka

What is the retention time on the topic you are publishing to? From: MAHA ALSAYASNEH Sent: Tuesday, September 19, 2017 10:25:15 AM To: users@kafka.apache.org Subject: Question about Kafka Hello, I'm using Kafka 0.10.1.1 I set up my cluster Kafka + zookeeper on

Re: Question about kafka-streams task load balancing

Hi Karthik, I think in the current trunk we do effectively load balance across processes (they are named as "clients" in the partition assignor) already. More specifically: 1. Consumer clients embedded a "client UUID" in its subscription so that the leader can group them into a single client, who

Re: Question about kafka-streams task load balancing

Hi, I guess, it's currently not possible to load balance between different machines. It might be a nice optimization to add into Streams though. Right now, you should reduce the number of threads. Load balancing is based on threads, and thus, if Streams place tasks to all threads of one machine,

Re: question about Kafka

og to Kafka's producer? > >Thanks >Liang > >-Original Message- >From: Jiangjie Qin [mailto:j...@linkedin.com.INVALID] >Sent: Monday, April 06, 2015 11:46 AM >To: users@kafka.apache.org >Subject: Re: question about Kafka > >Hey Liang, > >

RE: question about Kafka

users@kafka.apache.org Subject: Re: question about Kafka Hey Liang, Have you looked at the quick start here: https://kafka.apache.org/documentation.html#quickstart In Kafka, on the producer side, there is no concept of ³commit². If you are producing using KafkaProducer, you can do a send.get(), this

Re: question about Kafka

Also if you are using Kafka from the latest trunk, KafkaProducer has a flush() interface that you may call. This will ensure all the message previously sent from send() methods are sent to Kafka server. On 4/3/15, 3:38 PM, "Sun, Joey" wrote: >Hello, group > >I am a newbie to Kafka. I am research

Re: question about Kafka

Hey Liang, Have you looked at the quick start here: https://kafka.apache.org/documentation.html#quickstart In Kafka, on the producer side, there is no concept of ³commit². If you are producing using KafkaProducer, you can do a send.get(), this is a synchronized send so if no exception was thrown,

Re: Question about kafka consumer stream/partition

> My question is, does the number of kafka consumers mean the number of > kafka streams? > Yes. To know the total number of consumers/streams in a group, you need to add up the number of streams on every consumer instance > For example, I have one broker with one partition. What if I create > th