Re: [DISCUSS] KIP-794: Strictly Uniform Sticky Partitioner

2021-11-05 Thread Artem Livshits
Hi Luke, Thank you for your feedback. I've updated the KIP with your suggestions. 1. Updated with a better example. 2. I removed the reference to ClassicDefaultPartitioner, it was probably confusing. 3. The logic doesn't rely on checking batches, I've updated the proposal to make it more

Re: [DISCUSS] KIP-778 KRaft Upgrades

2021-11-05 Thread Jun Rao
Hi, David, Thanks for the reply. 16. My first concern is that the KIP picks up meta.version inconsistently during the deployment. If a new cluster is started, we pick up the highest version. If we upgrade, we leave the feature version unchanged. Intuitively, it seems that independent of how a

Re: [DISCUSS] KIP-791: Add Record Metadata to State Store Context

2021-11-05 Thread John Roesler
Thanks for the KIP, Patrick! It looks like you addressed Guozhang's and Bruno's very good feeback, and I like the result. The example especially helps clarify how this property might be useful. I'm in favor of this proposal. Thanks, -John On Fri, 2021-11-05 at 12:03 +0100, Bruno Cadonna wrote:

Re: New Kafka Consumer : unknown member id

2021-11-05 Thread Kafka Life
Hello Luke i have build a new kafka environment with kafka 2.8.0 the consumer is a new consumer set up to this environment is throwing the below error... the old consumers for the same applications for the same environment -2.8.0 is working fine.. . could you please advise 2021-11-02 12:25:24

[jira] [Created] (KAFKA-13435) Group won't consume partitions added after static member restart

2021-11-05 Thread Ryan Leslie (Jira)
Ryan Leslie created KAFKA-13435: --- Summary: Group won't consume partitions added after static member restart Key: KAFKA-13435 URL: https://issues.apache.org/jira/browse/KAFKA-13435 Project: Kafka

[jira] [Created] (KAFKA-13434) Add a public API for AbstractCoordinatos

2021-11-05 Thread Hector G (Jira)
Hector G created KAFKA-13434: Summary: Add a public API for AbstractCoordinatos Key: KAFKA-13434 URL: https://issues.apache.org/jira/browse/KAFKA-13434 Project: Kafka Issue Type: Improvement

Re: [DISCUSS] KIP-778 KRaft Upgrades

2021-11-05 Thread David Arthur
Colin and Jun, thanks for the additional comments! Colin: > We've been talking about having an automated RPC compatibility checker Do we have a way to mark fields in schemas as deprecated? It can stay in the RPC, it just complicates the logic a bit. > It would be nice if the active controller

RE: Re: [VOTE] KIP-714: Client Metrics and Observability

2021-11-05 Thread Igor Buzatovic
+1 We also have a lot of clients using our central Kafka cluster, and it would be great to have client metrics so we can provide end-to-end monitoring. Igor Buzatović Porsche Digital On 2021/11/01 20:19:20 J Rivers wrote: > +1 > > Thank you for the KIP! > > Our organization runs kafka at large

Re: [DISCUSS] KIP-779: Allow Source Tasks to Handle Producer Exceptions

2021-11-05 Thread Knowles Atchison Jr
Good morning, If there is no additional feedback, I am going to call a vote for this KIP on Monday. Knowles On Tue, Nov 2, 2021 at 10:00 AM Knowles Atchison Jr wrote: > Third time's the charm. > > I've added a getter for the RetryWithToleranceOperator to get the > ToleranceType. I've updated

Re: [DISCUSS] KIP-791: Add Record Metadata to State Store Context

2021-11-05 Thread Bruno Cadonna
Hi Patrick, Thank you for the KIP! - Maybe some more details in the motivation would help to better understand the background of the KIP. Currently, it is hard to judge whether record metadata should be exposed or not. Can you maybe give an example? - Could you please replace RYW

Re: [VOTE] KIP-782: Expandable batch size in producer

2021-11-05 Thread Luke Chen
Hi Mickael, Thanks for the good comments! Answering them below: - When under load, the producer may allocate extra buffers. Are these buffers ever released if the load drops? --> This is a good point that I've never considered before. Yes, after introducing the "batch.max.size", we should release