Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1120

See

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1119

See

[jira] [Created] (KAFKA-14140) Ensure a fenced or in-controlled-shutdown replica is not eligible to become leader in ZK mode

Justine Olshan created KAFKA-14140: -- Summary: Ensure a fenced or in-controlled-shutdown replica is not eligible to become leader in ZK mode Key: KAFKA-14140 URL: https://issues.apache.org/jira/browse/KAFKA-14140

[jira] [Created] (KAFKA-14139) Replaced disk can lead to loss of committed data even with non-empty ISR

Jason Gustafson created KAFKA-14139: --- Summary: Replaced disk can lead to loss of committed data even with non-empty ISR Key: KAFKA-14139 URL: https://issues.apache.org/jira/browse/KAFKA-14139

Re: [VOTE] KIP-859: Add Metadata Log Processing Error Related Metrics

Thanks, Niket. +1 (binding) Colin On Wed, Aug 3, 2022, at 15:24, Niket Goel wrote: > Thanks for the explanation Colin. > >> ForceRenounceCount => >> kafka.controller:type=KafkaController,name=MetadataErrorCount >> publisher-error-count => metadata-load-error-count >>

ARM/PowerPC builds

Just a quick note. Today we committed https://github.com/apache/kafka/pull/12380 , "MINOR: Remove ARM/PowerPC builds from Jenkinsfile #12380". This PR removes the ARM and PowerPC builds from the Jenkinsfile. The rationale is that these builds seem to be failing all the time, and this is very

[jira] [Created] (KAFKA-14138) The Exception Throwing Behavior of Transactional Producer is Inconsistent

Guozhang Wang created KAFKA-14138: - Summary: The Exception Throwing Behavior of Transactional Producer is Inconsistent Key: KAFKA-14138 URL: https://issues.apache.org/jira/browse/KAFKA-14138 Project:

Re: [VOTE] KIP-859: Add Metadata Log Processing Error Related Metrics

Thanks for the explanation Colin. > ForceRenounceCount => > kafka.controller:type=KafkaController,name=MetadataErrorCount > publisher-error-count => metadata-load-error-count > listener-batch-load-error-count => metadata-apply-error-count Yeah, this makes sense. I have made the changes in

[GitHub] [kafka-site] bbejeck commented on pull request #433: MINOR: Add placeholder images that will load iframe.

bbejeck commented on PR #433: URL: https://github.com/apache/kafka-site/pull/433#issuecomment-1204506779 Ping @vvcephei @mimaison @divijvaidya for review. Once this PR is approved, I'll do a mirror PR for the Apache Kafka repo -- This is an automated message from the Apache

[GitHub] [kafka-site] bbejeck opened a new pull request, #433: MINOR: Add placeholder images that will load iframe.

bbejeck opened a new pull request, #433: URL: https://github.com/apache/kafka-site/pull/433 This PR is a follow-up from #430 and https://github.com/apache/kafka-site/pull/427. This PR adds a clickable image that will load an iframe for each one of the Kafka Streams videos. This aligns

Re: [VOTE] KIP-859: Add Metadata Log Processing Error Related Metrics

I think there are a few different cases here: 1a. We hit an ApiException PREPARING metadata records on the active controller. This is normal and expected. For example, someone tried to create a topic that already exists. We translate the ApiException to an ApiError and return the appropriate

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #21

See Changes: -- [...truncated 495993 lines...] [Pipeline] } [Pipeline] // stage [Pipeline] } Failed in branch JDK 17 and Scala 2.12 [2022-08-03T20:30:13.737Z]

Re: [DISCUSS] KIP-848: The Next Generation of the Consumer Rebalance Protocol

Hey All! Thanks for the KIP, it's wonderful to see cooperative rebalancing making it down the stack! I had a few questions: 1. The 'Rejected Alternatives' section describes how member epoch should advance in step with the group epoch and assignment epoch values. I think that this is a good idea

[jira] [Created] (KAFKA-14137) Security Vulnerabilities reported in CVE-2021-45046 and CVE-2021-45046

venkat created KAFKA-14137: -- Summary: Security Vulnerabilities reported in CVE-2021-45046 and CVE-2021-45046 Key: KAFKA-14137 URL: https://issues.apache.org/jira/browse/KAFKA-14137 Project: Kafka

Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman

Congrats Sophie! On Wed, Aug 3, 2022 at 9:25 AM David Arthur wrote: > > Well done! Congrats! > > -David > > On Wed, Aug 3, 2022 at 9:48 AM Sagar wrote: > > > Congratulations Sophie ! > > > > On Wed, 3 Aug 2022 at 6:37 PM, José Armando García Sancio > > wrote: > > > > > Congratulations Sophie!

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1117

See Changes: -- [...truncated 409257 lines...] [2022-08-03T19:01:29.388Z] > Task :connect:api:testJar [2022-08-03T19:01:29.388Z] > Task :connect:api:testSrcJar

Re: [DISCUSS] KIP-854 Separate configuration for producer ID expiry

Hi Justine, That all seems reasonable to me, thanks! On Wed, 3 Aug 2022 at 19:14, Justine Olshan wrote: > Hi Tom and Ismael, > > 1. Yes, there are definitely many ways to improve this issue and I plan to > write followup KIPs to address some of the larger changes. > Just wanted to get this

[jira] [Created] (KAFKA-14136) AlterConfigs in KRaft does not generate records for unchanged values

David Arthur created KAFKA-14136: Summary: AlterConfigs in KRaft does not generate records for unchanged values Key: KAFKA-14136 URL: https://issues.apache.org/jira/browse/KAFKA-14136 Project: Kafka

Re: [DISCUSS] KIP-854 Separate configuration for producer ID expiry

Hi Tom and Ismael, 1. Yes, there are definitely many ways to improve this issue and I plan to write followup KIPs to address some of the larger changes. Just wanted to get this simple fix in as a short term measure to prevent issues with too many producer IDs in the cache. Stay tuned :) 2. I did

[jira] [Resolved] (KAFKA-14111) Dynamic config update fails for "password" configs in KRaft

[ https://issues.apache.org/jira/browse/KAFKA-14111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur resolved KAFKA-14111. -- Resolution: Fixed > Dynamic config update fails for "password" configs in KRaft >

Re: [DISCUSS] KIP-854 Separate configuration for producer ID expiry

Regarding 1, more can certainly be done, but I think it would be complementary. As such, I think this KIP stands on its own and additional improvements can be handled via future KIPs (unless Justine wants to combine things, of course). Ismael On Wed, Aug 3, 2022 at 9:12 AM Tom Bentley wrote: >

[jira] [Resolved] (KAFKA-13877) Flaky RackAwarenessIntegrationTest.shouldDistributeStandbyReplicasOverMultipleClientTags

[ https://issues.apache.org/jira/browse/KAFKA-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-13877. --- Resolution: Fixed > Flaky >

Re: [DISCUSS] KIP-854 Separate configuration for producer ID expiry

Hi Justine, Thanks for the KIP! I can see that this is a pragmatic attempt to address a nasty problem. I have a few questions: 1. The KIP makes the problem significantly harder to trigger, but doesn't eliminate it entirely. How confident are you that it will be sufficient in practice? We can

Re: [ANNOUNCE] Apache Kafka 3.2.1

Thanks for driving this, David! On Mon, Aug 1, 2022, at 4:45 PM, David Arthur wrote: > The Apache Kafka community is pleased to announce the release for > Apache Kafka 3.2.1 > > This is a bugfix release with several fixes since the release of > 3.2.0. A few of the major issues include: > > *

Re: [DISCUSS] KIP-856: KRaft Disk Failure Recovery

Hi José Thanks for the KIP. 1. In the motivation section you refer to a possible scenario where "it is possible for the cluster metadata partition to establish a leader with inconsistency or data loss" and that "the user needs to make sure that the new voter node has a superset of the

Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman

Well done! Congrats! -David On Wed, Aug 3, 2022 at 9:48 AM Sagar wrote: > Congratulations Sophie ! > > On Wed, 3 Aug 2022 at 6:37 PM, José Armando García Sancio > wrote: > > > Congratulations Sophie! > > -- > > -José > > > -- -David

Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman

Congratulations Sophie, all the best. From: Mickael Maison Sent: Tuesday, August 2, 2022 10:24 AM To: Users ; dev Subject: Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman Congratulations Sophie! On Tue, Aug 2, 2022 at 8:52 AM Josep Prat wrote: > >

Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman

Congratulations Sophie ! On Wed, 3 Aug 2022 at 6:37 PM, José Armando García Sancio wrote: > Congratulations Sophie! > -- > -José >

Re: [ANNOUNCE] New Kafka PMC Member: A. Sophie Blee-Goldman

Congratulations Sophie! -- -José

[jira] [Created] (KAFKA-14135) KafkaConfig value sasl.server.callback.handler.class is set to null even when custom class is used

Gábor Nagy created KAFKA-14135: -- Summary: KafkaConfig value sasl.server.callback.handler.class is set to null even when custom class is used Key: KAFKA-14135 URL: https://issues.apache.org/jira/browse/KAFKA-14135

Re: [DISCUSS] KIP-848: The Next Generation of the Consumer Rebalance Protocol

Hi Guozhang/David, I created a confluence page to discuss how Connect would need to change based on the new rebalance protocol. Here's the page: https://cwiki.apache.org/confluence/display/KAFKA/%5BDRAFT%5DIntegrating+Kafka+Connect+With+New+Consumer+Rebalance+Protocol It's also pretty longish

Question about plugins / extension API

Hi colleagues, I tried to find the answer in the mail list archive and the Internet, but found nothing. I see that kafka project doesn't introduce general extension/ plugin API for three major releases. I mean the top-level plugin/extension that allow to add some user-specific code at the

Re: Recent commit causes Gradle to load significantly slowly?

Thanks for figuring it out and following up. Ismael On Wed, Aug 3, 2022, 12:06 AM Matthew Benedict de Detrich wrote: > So I figured out the problem, it has nothing to do with Kafka itself. > > I was trying out another IDE that used LSP with Java and when it index’ed > Kafka it created a

Re: Recent commit causes Gradle to load significantly slowly?

So I figured out the problem, it has nothing to do with Kafka itself. I was trying out another IDE that used LSP with Java and when it index’ed Kafka it created a massive amount of files that Gradle ended up scanning on startup. I just deleted all of these temporarily files and now all is fine!