Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #522

See Changes: -- [...truncated 493658 lines...] [2021-10-15T04:05:43.784Z] [2021-10-15T04:05:43.784Z] ConsumerBounceTest > testCloseDuringRebalance() PASSED

Re: [SPAM] Re: Why does Kafka have a higher throughput than Redis?

Hi Vitor, I'm not the expert, either, but I think Andrew's answer is pretty much the reasons why Kafka is doing good. And I'm not too familiar with Redis, either. But I'd say, there are many configurations in each product to increase the throughput, and the use cases are different, the comparison

Re: Kafka client 2.7.1 missing JaasUtils.isZkSecurityEnabled() method

Hi Alexandre Yes, you're right. We renamed the `isZkSecurityEnabled` method name into `isZkSaslEnabled`, because it checked sasl config only. You can check here . If you want

Re: [DISCUSS] KIP-778 KRaft Upgrades

Kowshik, thanks for the review! 7001. An enum sounds like a good idea here. Especially since setting Upgrade=false and Force=true doesn't really make sense. An enum would avoid confusing/invalid combinations of flags 7002. How about adding --force-downgrade as an alternative to the --downgrade

RE: [SPAM] Re: Why does Kafka have a higher throughput than Redis?

Thanks for the response, Andrew, i appreciate the help! Just i few thoughts that came up while reading your points: 1. In theory, Redis is also handling/storing data in memory which makes me wonder why is that Kafka does it better? Perhaps it has to do with the API contract, where, as you

[jira] [Created] (KAFKA-13378) lost links after deleting partition

Maciej Malecki created KAFKA-13378: -- Summary: lost links after deleting partition Key: KAFKA-13378 URL: https://issues.apache.org/jira/browse/KAFKA-13378 Project: Kafka Issue Type: Bug

Re: [VOTE] KIP-768: Extend SASL/OAUTHBEARER with Support for OIDC

Hi Ismael, Thanks for reviewing the KIP. I've made a first pass at updating based on your feedback. Questions/comments inline... On Thu, Oct 14, 2021, at 6:20 AM, Ismael Juma wrote: > Hi Kirk, > > Thanks for the KIP. It looks good overall to me. A few nits: > > 1. "sasl.login.retry.wait.ms":

Re: Why does Kafka have a higher throughput than Redis?

Hi Vitor, I'm not an expert and probably some more knowledgeable folks can also chime in (and correct me) but a few things came to mind: 1) On the write side (i.e. when using the publisher), Kafka does not flush data to disk by default. It writes to the page cache so all writes are sort of

Re: [DISCUSS] KIP-778 KRaft Upgrades

On Tue, Oct 12, 2021 at 10:57 AM Colin McCabe wrote: > > 11. For downgrades, it would be useful to describe how to determine the > > downgrade process (generating new snapshot, propagating the snapshot, etc) > > has completed. We could block the UpdateFeature request until the process > > is

Re: [DISCUSS] KIP-778 KRaft Upgrades

On Thu, Oct 7, 2021 at 5:20 PM Jun Rao wrote: > 7. Jose, what control records were you referring? > Hey Jun, in KRaft we have 3 control records. - LeaderChangeMessage - this is persistent in the replica log when a new leader gets elected and the epoch increases. We never included this record in

Why does Kafka have a higher throughput than Redis?

Hi everyone, i'm doing a benchmark comparison between Kafka and Redis for my final bachelor paper and would like to understand more about why Kafka have higher throughput if compared to Redis. I noticed Redis has lower overall latency (and makes sense since it's stored in memory) but cant

Re: [DISCUSS] KIP-778 KRaft Upgrades

On Tue, Oct 5, 2021 at 8:53 AM David Arthur wrote: > 2. Generate snapshot on downgrade > > > Metadata snapshot is generated and sent to the other inactive > > controllers and to brokers (this snapshot may be lossy!) > > Why do we need to send this downgraded snapshot to the brokers? The > >

Re: [DISCUSS] Apache Kafka 3.1.0 release

Hi Luke, Added it to the plan. Thanks, David On Thu, Oct 14, 2021 at 10:09 AM Luke Chen wrote: > Hi David, > KIP-766 is merged into trunk. Please help add it into the release plan. > > Thank you. > Luke > > On Mon, Oct 11, 2021 at 10:50 PM David Jacot > wrote: > > > Hi Michael, > > > > Sure.

Kafka client 2.7.1 missing JaasUtils.isZkSecurityEnabled() method

Hello, When upgrading from Kafka client 2.4.0 our dependencies to Kafka client 2.7.1, we noticed that JaasUtils.isZkSecurityEnabled() method no longer exists. Is there an equivalent method in Kafka client 2.7.1 which could use instead ? Kind regards, Alexandre

[jira] [Resolved] (KAFKA-8375) Offset jumps back after commit

[ https://issues.apache.org/jira/browse/KAFKA-8375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Markus Dybeck resolved KAFKA-8375. -- Fix Version/s: 2.4.2 Resolution: Later We have not encountered the issue after

Re: [VOTE] KIP-768: Extend SASL/OAUTHBEARER with Support for OIDC

Hi Kirk, Thanks for the KIP. It looks good overall to me. A few nits: 1. "sasl.login.retry.wait.ms": these configs are typically called `backoff` in Kafka. For example "retry.backoff.ms". The default for `retry.backoff.ms` is 100ms. Is there a reason why we are using a different value for this

[jira] [Created] (KAFKA-13377) Fix

lujie created KAFKA-13377: - Summary: Fix Key: KAFKA-13377 URL: https://issues.apache.org/jira/browse/KAFKA-13377 Project: Kafka Issue Type: Improvement Reporter: lujie -- This

Re: [VOTE] KIP-768: Extend SASL/OAUTHBEARER with Support for OIDC

+1 (binding). Thanks for the KIP! On Fri, Oct 8, 2021 at 10:54 AM Rajini Sivaram wrote: > +1 (binding) > Thanks for the KIP, Kirk! > > Regards, > > Rajini > > > On Thu, Sep 30, 2021 at 12:33 PM Manikumar > wrote: > > > Hi Kirk, > > > > Thanks for the KIP! > > > > +1 (binding) > > > > > >

[jira] [Created] (KAFKA-13376) Allow MirrorMaker producer and consumer customization per replication flow

Ivan Yurchenko created KAFKA-13376: -- Summary: Allow MirrorMaker producer and consumer customization per replication flow Key: KAFKA-13376 URL: https://issues.apache.org/jira/browse/KAFKA-13376

Re: [DISCUSS] Apache Kafka 3.1.0 release

Hi David, KIP-766 is merged into trunk. Please help add it into the release plan. Thank you. Luke On Mon, Oct 11, 2021 at 10:50 PM David Jacot wrote: > Hi Michael, > > Sure. I have updated the release plan to include it. Thanks for the > heads up. > > Best, > David > > On Mon, Oct 11, 2021 at

[jira] [Created] (KAFKA-13375) Kafka streams apps w/EOS unable to start at InitProducerId

Lerh Chuan Low created KAFKA-13375: -- Summary: Kafka streams apps w/EOS unable to start at InitProducerId Key: KAFKA-13375 URL: https://issues.apache.org/jira/browse/KAFKA-13375 Project: Kafka

Re: Wiki permission to author a KIP

Hi Igor, I have added you. I am looking forward to your KIP. Best, David On Thu, Oct 14, 2021 at 12:16 AM Igor Soarez wrote: > Hi, > > Could someone please grant me access in the wiki to create a KIP? > > username: soarez > > Thanks, > > -- > Igor > >