[jira] [Created] (KAFKA-13437) Broker parameter optimization: security.inter.broker.protocol and num.network.threads

RivenSun created KAFKA-13437: Summary: Broker parameter optimization: security.inter.broker.protocol and num.network.threads Key: KAFKA-13437 URL: https://issues.apache.org/jira/browse/KAFKA-13437 Project

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #555

See Changes: -- [...truncated 5187186 lines...] [2021-11-09T04:49:19.578Z] [2021-11-09T04:49:19.578Z] PlaintextProducerSendTest > testSendCompressedMessageWithLogAppendTim

Re: [DISCUSS] KIP-778 KRaft Upgrades

Hello David, Thanks for the very nice writeup! It helped me a lot to refresh my memory on KIP-630/590/584 :) I just had two clarification questions after reading through the KIP: 1. For the initialization procedure, do we guarantee that all the quorum nodes (inactive candidates and leaders, a.k.

Re: [DISCUSS] KIP-794: Strictly Uniform Sticky Partitioner

Hi Luke, Justine, Thank you for feedback and questions. I've added clarification to the KIP. > there will be some period of time the distribution is not even. That's correct. There would be a small temporary imbalance, but over time the distribution should be uniform. > 1. This paragraph is a

Re: Kafka : High avaialability settings

Hi, You can try reducing min.insynch replicas to 1 On Tue, 9 Nov 2021 at 1:56 AM, Kafka Life wrote: > Dear Kafka experts > > i have a 10 broker kafka cluster with all topics having replication factor > as 3 and partition 50 > > min.in.synch replicas is 2. > > > One broker went down for a hardw

Re: [VOTE] KIP-791: Add Record Metadata to State Store Context

+1, thanks Patrick! Guozhang On Mon, Nov 8, 2021 at 5:44 AM Vasiliki Papavasileiou wrote: > Hi Patrick, > > Having the recordMetadata available in the state stores is fundamental for > the consistency work and the proposed approach is reasonable. > > +1 (non-binding) > > Thank you, > Vicky > >

Kafka : High avaialability settings

Dear Kafka experts i have a 10 broker kafka cluster with all topics having replication factor as 3 and partition 50 min.in.synch replicas is 2. One broker went down for a hardware failure, but many applications complained they are not able to produce /consume messages. I request you to please

Re: [DISCUSS] KIP-794: Strictly Uniform Sticky Partitioner

Hi Artem, Thanks for working on improving the Sticky Partitioner! I had a few questions about this portion: *The batching will continue until either an in-flight batch completes or we hit the N bytes and move to the next partition. This way it takes just 5 records to get to batching mode, not 5

Re: Automation Script : Kafka topic creation

Thank you Men and Ran On Sat, Nov 6, 2021 at 7:23 PM Men Lim wrote: > I'm currently using Kafka-gitops. > > On Sat, Nov 6, 2021 at 3:35 AM Kafka Life wrote: > > > Dear Kafka experts > > > > does anyone have ready /automated script to create /delete /alter topics > in > > different environment

[VOTE] KIP-779: Allow Source Tasks to Handle Producer Exceptions

Good morning, I'd like to start a vote for KIP-779: Allow Source Tasks to Handle Producer Exceptions: https://cwiki.apache.org/confluence/display/KAFKA/KIP-779%3A+Allow+Source+Tasks+to+Handle+Producer+Exceptions The purpose of this KIP is to allow Source Tasks the option to "ignore" kafka produc

[DISCUSS] KIP-795: Add public APIs for AbstractCoordinator

Hi Kafka devs, I would like to start the discussion of KIP-795: Add public APIs for AbstractCoordinator https://cwiki.apache.org/confluence/display/KAFKA/KIP-795%3A+Add+public+APIs+for+AbstractCoordinator Looking forward for some feedback from the community. Regards, Hector

DISMISS - Re:[DISCUSS] KIP-784: Add public APIs for AbstractCoordinator

Please dismiss this message, as the KIP number is wrong. I'll send a new message with the correct KIP shortly. Apologies From: dev@kafka.apache.org At: 11/08/21 08:45:22 UTC-5:00To: dev@kafka.apache.org Subject: [DISCUSS] KIP-784: Add public APIs for AbstractCoordinator Hi Kafka devs, I would

[DISCUSS] KIP-784: Add public APIs for AbstractCoordinator

Hi Kafka devs, I would like to start the discussion of KIP-784: Add public APIs for AbstractCoordinator https://cwiki.apache.org/confluence/display/KAFKA/KIP-784%3A+Add+public+APIs+for+AbstractCoordinator Looking forward for some feedback from the community. Regards, Hector

Re: [VOTE] KIP-791: Add Record Metadata to State Store Context

Hi Patrick, Having the recordMetadata available in the state stores is fundamental for the consistency work and the proposed approach is reasonable. +1 (non-binding) Thank you, Vicky On Mon, Nov 8, 2021 at 10:00 AM Luke Chen wrote: > Hi Patrick, > Thanks for the KIP. > Adding RecordMetadata i

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

Hi Dongjin, Thanks for working on the update to log4j2, it's definitively something we should complete. I have a couple of comments: 1) Is the KIP proposing to replace the existing log4-appender or simply add a new one for log4j2? Reading the KIP and with its current title, it's not entirely expl

Re: [VOTE] KIP-791: Add Record Metadata to State Store Context

Hi Patrick, Thanks for the KIP. Adding RecordMetadata into StateStoreContext for offset updating makes sense to me. +1 (non-binding) Thank you. Luke On Mon, Nov 8, 2021 at 5:18 PM Patrick Stuedi wrote: > Hi all, > > Thanks for the feedback on KIP-791, I have updated the KIP and would like > t

Re: [DISCUSS] KIP-794: Strictly Uniform Sticky Partitioner

Thanks Artem, It's much better now. I've got your idea. In KIP-480: Sticky Partitioner, we'll change partition (call partitioner) when either 1 of below condition match 1. the batch is full 2. when linger.ms is up But, you are changing the definition, into a "partitioner.sticky.batch.size" size is

[VOTE] KIP-791: Add Record Metadata to State Store Context

Hi all, Thanks for the feedback on KIP-791, I have updated the KIP and would like to start the voting. The KIP can be found here: https://cwiki.apache.org/confluence/x/I5BnCw Please vote in this thread. Thanks! -Patrick