Re: [DISCUSS] KIP-894: Use incrementalAlterConfigs API for syncing topic configurations

2023-02-06 Thread Luke Chen
Hi Tina, Thanks for the KIP to fix the issue. Some comments: 1. In the compatibility section, you said: `By default, the new setting will be set to false so it does not change the current behaviour.` I'm confused, what is the config we need to set to `false` to avoid breaking compatibility? All

[GitHub] [kafka-site] mumrah opened a new pull request, #486: Update website for 3.4.0 release

2023-02-06 Thread via GitHub
mumrah opened a new pull request, #486: URL: https://github.com/apache/kafka-site/pull/486 This PR updates the "33" template references to "34" for the 3.4.0 release. It also adds the released artifacts to the downloads page and points the documentation page at the 3.4 documentation page

[jira] [Created] (KAFKA-14686) MockAdminClient.createTopics does not provide TopicMetadataAndConfig

2023-02-06 Thread Kirk True (Jira)
Kirk True created KAFKA-14686: - Summary: MockAdminClient.createTopics does not provide TopicMetadataAndConfig Key: KAFKA-14686 URL: https://issues.apache.org/jira/browse/KAFKA-14686 Project: Kafka

[jira] [Created] (KAFKA-14685) TierStateMachine interface for building remote aux log

2023-02-06 Thread Matthew Wong (Jira)
Matthew Wong created KAFKA-14685: Summary: TierStateMachine interface for building remote aux log Key: KAFKA-14685 URL: https://issues.apache.org/jira/browse/KAFKA-14685 Project: Kafka Issue

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.4 #75

2023-02-06 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1560

2023-02-06 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-14684) Replace EasyMock and PowerMock with Mockito in WorkerSinkTaskThreadedTest

2023-02-06 Thread Hector Geraldino (Jira)
Hector Geraldino created KAFKA-14684: Summary: Replace EasyMock and PowerMock with Mockito in WorkerSinkTaskThreadedTest Key: KAFKA-14684 URL: https://issues.apache.org/jira/browse/KAFKA-14684

Re: [DISCUSS] KIP-877: Mechanism for plugins and connectors to register metrics

2023-02-06 Thread Chris Egerton
Hi Mickael, I agree that adding a getter method for Monitorable isn't great. A few alternatives come to mind: 1. Introduce a new ConfiguredInstance (name subject to change) interface that wraps an instance of type T, but also contains a getter method for any PluginMetrics instances that the

[jira] [Created] (KAFKA-14683) Replace EasyMock and PowerMock with Mockito in WorkerSinkTaskTest

2023-02-06 Thread Hector Geraldino (Jira)
Hector Geraldino created KAFKA-14683: Summary: Replace EasyMock and PowerMock with Mockito in WorkerSinkTaskTest Key: KAFKA-14683 URL: https://issues.apache.org/jira/browse/KAFKA-14683 Project:

[jira] [Created] (KAFKA-14682) Unused stubbings are not reported by Mockito during CI builds

2023-02-06 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-14682: - Summary: Unused stubbings are not reported by Mockito during CI builds Key: KAFKA-14682 URL: https://issues.apache.org/jira/browse/KAFKA-14682 Project: Kafka

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.4 #74

2023-02-06 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-14681) Refreshing Kerberos TGT is not using CallbackHandler (causing failure to refresh)

2023-02-06 Thread Vlad D. (Jira)
Vlad D. created KAFKA-14681: --- Summary: Refreshing Kerberos TGT is not using CallbackHandler (causing failure to refresh) Key: KAFKA-14681 URL: https://issues.apache.org/jira/browse/KAFKA-14681 Project:

[jira] [Resolved] (KAFKA-13972) Reassignment cancellation causes stray replicas

2023-02-06 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-13972. - Resolution: Fixed > Reassignment cancellation causes stray replicas >

Re: [DISCUSS] KIP-877: Mechanism for plugins and connectors to register metrics

2023-02-06 Thread Mickael Maison
Hi Chris, I envisioned plugins to be responsible for closing the PluginMetrics instance. This is mostly important for Connect connector plugins as they can be closed while the runtime keeps running (and keeps its Metrics instance). As far as I can tell, other plugins should only be closed when

[jira] [Created] (KAFKA-14680) Gradle version upgrade 7 -->> 8

2023-02-06 Thread Jira
Dejan Stojadinović created KAFKA-14680: -- Summary: Gradle version upgrade 7 -->> 8 Key: KAFKA-14680 URL: https://issues.apache.org/jira/browse/KAFKA-14680 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-858: Handle JBOD broker disk failure in KRaft

2023-02-06 Thread Igor Soarez
Hi David, Thank you for your suggestions and for having a look at this KIP. 1. Yes, that should be OK. I have updated the section "Migrating a cluster in ZK mode running with JBOD" to reflect this. 2. I've updated the motivation section to state that. Best, -- Igor

[jira] [Resolved] (KAFKA-14663) High throughput topics can starve low-throughput MM2 offset syncs

2023-02-06 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-14663. --- Resolution: Duplicate > High throughput topics can starve low-throughput MM2 offset syncs >

Re: [DISCUSS] KIP-793: Sink Connectors: Support topic-mutating SMTs for async connectors (preCommit users)

2023-02-06 Thread Chris Egerton
Hi Yash, I've had some time to think on this KIP and I think I'm in agreement about not blocking it on an official compatibility library or adding the "ack" API for sink records. I only have two more thoughts: 1. Because it is possible to manipulate sink record partitions and offsets with the

Re: [DISCUSS] KIP-877: Mechanism for plugins and connectors to register metrics

2023-02-06 Thread Mickael Maison
Hi Yash, I added a sentence to the sensor() method mentioning the sensor name must only be unique per plugin. Regarding having getters for sensors and metrics I considered this not strictly necessary as I expect the metrics logic in most plugins to be relatively simple. If you have a use case

Re: [DISCUSS] KIP-898: Modernize Connect plugin discovery

2023-02-06 Thread Chris Egerton
Hi Greg, Thanks for the updates. Unless stated below, I agree with your responses. A few more thoughts: 1. IMO it's not worth it to have separate commands for adding/removing manifests, mostly because it adds complexity to the tool and might make it harder for users to understand. I think a

Re: [VOTE] 3.4.0 RC2

2023-02-06 Thread Ismael Juma
Thanks David and Sophie! Ismael On Mon, Feb 6, 2023, 7:22 AM David Arthur wrote: > I'd like to go ahead and close out this vote. There were three binding > votes and one non-binding vote. > > Binding +1 PMC votes: > * David Jacot > * Bill Bejeck > * Mickael Maison > > Non-binding community

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1559

2023-02-06 Thread Apache Jenkins Server
See

Re: [VOTE] 3.4.0 RC2

2023-02-06 Thread David Arthur
I'd like to go ahead and close out this vote. There were three binding votes and one non-binding vote. Binding +1 PMC votes: * David Jacot * Bill Bejeck * Mickael Maison Non-binding community votes: * Federico Valeri There were no -1 votes. The vote for Apache Kafka 3.4.0 RC2 passes. Thanks

[jira] [Created] (KAFKA-14679) Add new __consumer_offsets records

2023-02-06 Thread David Jacot (Jira)
David Jacot created KAFKA-14679: --- Summary: Add new __consumer_offsets records Key: KAFKA-14679 URL: https://issues.apache.org/jira/browse/KAFKA-14679 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-14678) Move __consumer_offsets records from core to group-coordinator

2023-02-06 Thread David Jacot (Jira)
David Jacot created KAFKA-14678: --- Summary: Move __consumer_offsets records from core to group-coordinator Key: KAFKA-14678 URL: https://issues.apache.org/jira/browse/KAFKA-14678 Project: Kafka

Re: [DISCUSS] Add "Security Implications" section to KIP template

2023-02-06 Thread Chris Egerton
Hi Bruno, Apologies for the delay; covid paid me a visit recently and took me away from this discussion for a bit. I'm fine with adding specific examples to help flesh out the questions we want to think about while writing/reviewing KIPs, but IMO it's important to emphasize that they are not

[DISCUSS] KIP-904 Kafka Streams - Guarantee subtractor is called before adder if key has not changed

2023-02-06 Thread Fq Public
Hi everyone, I'd like to share a new KIP for discussion: https://cwiki.apache.org/confluence/x/P5VbDg This could be considered mostly as a "bug fix" but we wanted to raise a KIP for discussion because it involves changes to the serialization format of an internal topic which raises backward

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1558

2023-02-06 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-14677) Dependency conversion error

2023-02-06 Thread Jan Hendriks (Jira)
Jan Hendriks created KAFKA-14677: Summary: Dependency conversion error Key: KAFKA-14677 URL: https://issues.apache.org/jira/browse/KAFKA-14677 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-14676) Token endpoint URL used for OIDC cannot be set on the JAAS config

2023-02-06 Thread Rajini Sivaram (Jira)
Rajini Sivaram created KAFKA-14676: -- Summary: Token endpoint URL used for OIDC cannot be set on the JAAS config Key: KAFKA-14676 URL: https://issues.apache.org/jira/browse/KAFKA-14676 Project: Kafka

Re: [DISCUSS] KIP-899: Allow clients to rebootstrap

2023-02-06 Thread Ivan Yurchenko
Hi! There seems to be not much more discussion going, so I'm planning to start the vote in a couple of days. Thanks, Ivan On Wed, 18 Jan 2023 at 12:06, Ivan Yurchenko wrote: > Hello! > I would like to start the discussion thread on KIP-899: Allow clients to > rebootstrap. > This KIP proposes