Re: [DISCUSS] KIP-988 Streams Standby Task Update Listener

2023-10-23 Thread Sophie Blee-Goldman
Just want to checkpoint the current state of this KIP and make sure we're on track to get it in to 3.7 (we still have a few weeks) -- looks like there are two remaining open questions, both relating to the middle/intermediate callback: 1. What to name it: seems like the primary candidates are

Re: Apache Kafka 3.7.0 Release

2023-10-23 Thread Sophie Blee-Goldman
Actually I have a few questions about the schedule: 1. Why is the KIP freeze deadline on a Saturday? Traditionally this has been on a Wednesday, which is nice because it gives people until Monday to kick off the vote and give people a full 3 working days to review and vote on it. Also, 2. Why are

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.5 #87

2023-10-23 Thread Apache Jenkins Server
See

Re: Apache Kafka 3.7.0 Release

2023-10-23 Thread Sophie Blee-Goldman
Can you add the 3.7 plan to the release schedule page? (this --> https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan) Thanks! On Sun, Oct 15, 2023 at 2:27 AM Stanislav Kozlovski wrote: > Hey Chris, > > Thanks for the catch! It was indeed copied and I wasn't sure what to make

[jira] [Created] (KAFKA-15675) Fix flaky ConnectorRestartApiIntegrationTest.testMultiWorkerRestartOnlyConnector() test

2023-10-23 Thread Kirk True (Jira)
Kirk True created KAFKA-15675: - Summary: Fix flaky ConnectorRestartApiIntegrationTest.testMultiWorkerRestartOnlyConnector() test Key: KAFKA-15675 URL: https://issues.apache.org/jira/browse/KAFKA-15675

[jira] [Created] (KAFKA-15674) Consider making RequestLocal thread safe

2023-10-23 Thread Justine Olshan (Jira)
Justine Olshan created KAFKA-15674: -- Summary: Consider making RequestLocal thread safe Key: KAFKA-15674 URL: https://issues.apache.org/jira/browse/KAFKA-15674 Project: Kafka Issue Type:

[jira] [Resolved] (KAFKA-15657) Unexpected errors when producing transactionally in 3.6

2023-10-23 Thread Travis Bischel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Bischel resolved KAFKA-15657. Resolution: Duplicate Closing this as a different manifestation (and thus, duplicate of)

[jira] [Resolved] (KAFKA-15656) Frequent INVALID_RECORD on Kafka 3.6

2023-10-23 Thread Travis Bischel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Bischel resolved KAFKA-15656. Resolution: Duplicate Closing this as a different manifestation of (and thus, duplicate

[jira] [Created] (KAFKA-15673) Define new client_metrics resource type configuration to store metric config.

2023-10-23 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-15673: - Summary: Define new client_metrics resource type configuration to store metric config. Key: KAFKA-15673 URL: https://issues.apache.org/jira/browse/KAFKA-15673

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #100

2023-10-23 Thread Apache Jenkins Server
See Changes: -- [...truncated 308886 lines...] > Task :connect:json:copyDependantLibs UP-TO-DATE > Task :connect:json:jar UP-TO-DATE > Task

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.4 #170

2023-10-23 Thread Apache Jenkins Server
See Changes: -- [...truncated 526270 lines...] Gradle Test Run :core:integrationTest > Gradle Test Executor 176 > KafkaZkClientTest > testLogDirEventNotificationsDeletion()

Re: [VOTE] KIP-979 Allow independently stop KRaft processes

2023-10-23 Thread Hailey Ni
Hi Ron, I've added the "Rejected Alternatives" section in the KIP. Thanks for the comments and +1 vote! Thanks, Hailey On Mon, Oct 23, 2023 at 6:33 AM Ron Dagostino wrote: > Hi Hailey. I'm +1 (binding), but could you add a "Rejected > Alternatives" section to the KIP and mention the

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2322

2023-10-23 Thread Apache Jenkins Server
See

Re: Development with Git Worktree

2023-10-23 Thread Ismael Juma
Greg, Thanks for making the change and sharing the benefit with the overall group. Ismael On Mon, Oct 23, 2023 at 10:03 AM Greg Harris wrote: > Hey Kafka Developers, > > This is a small announcement that the gradle build now supports the > git-worktree subcommand [1] on the 3.4, 3.5, 3.6, and

Re: [VOTE] KIP-967: Support custom SSL configuration for Kafka Connect RestServer

2023-10-23 Thread Greg Harris
Hey Taras, Thanks for the KIP! The design you propose follows the conventions started in KIP-519, and should feel natural to operators familiar with the broker feature. I also like that we're able to clean up some connect-specific functionality and make the codebase more consistent. +1

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #86

2023-10-23 Thread Apache Jenkins Server
See Changes: -- [...truncated 5179 lines...] You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or

Development with Git Worktree

2023-10-23 Thread Greg Harris
Hey Kafka Developers, This is a small announcement that the gradle build now supports the git-worktree subcommand [1] on the 3.4, 3.5, 3.6, and trunk branches [2]. If you've needed to check out multiple copies of Kafka concurrently, you previously needed to manage multiple full clones of the

Re: UncleanLeaderElectionsPerSec metric and Raft

2023-10-23 Thread Justine Olshan
Hey Neil, I was taking a look at this code, and noticed that some unclean leader election params were not implemented. https://github.com/apache/kafka/blob/4612fe42af0df0a4c1affaf66c55d01eb6267ce3/metadata/src/main/java/org/apache/kafka/controller/ConfigurationControlManager.java#L499 I know you

Re: [DISCUSS] KIP-992 Proposal to introduce IQv2 Query Types: TimestampedKeyQuery and TimestampedRangeQuery

2023-10-23 Thread Bill Bejeck
Hey Hanyu, Thanks for the KIP, it's a welcomed addition. Overall, the KIP looks good to me, I just have one comment. Can you discuss the expected behavior when a user executes a timestamped query against a non-timestamped store? I think it should throw an exception vs. using some default value.

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #99

2023-10-23 Thread Apache Jenkins Server
See Changes: -- [...truncated 307422 lines...] > Task :connect:json:jar UP-TO-DATE > Task :connect:api:compileTestJava UP-TO-DATE > Task :connect:api:testClasses UP-TO-DATE >

Re: [DISCUSS] Road to Kafka 4.0

2023-10-23 Thread Mickael Maison
Hi Luke, Thanks for starting this discussion. I think it's very important that we communicate our plans and progress to send a clear message to users. Regarding KRaft missing features, I tend to agree with Christopher that it would be much better to get them merged and declared production ready

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2321

2023-10-23 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-15666) Добавить функцию поиска по почте

2023-10-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-15666. - Resolution: Invalid [~noraverba] – We can only take tickets in English. – Also piped

[jira] [Created] (KAFKA-15672) Add 3.6 to streams system tests

2023-10-23 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-15672: --- Summary: Add 3.6 to streams system tests Key: KAFKA-15672 URL: https://issues.apache.org/jira/browse/KAFKA-15672 Project: Kafka Issue Type: Test

Re: Re: [DISCUSS] KIP-905: Broker interceptors

2023-10-23 Thread Andrew Otto
FWIW, this would be very useful for the Wikimedia Foundation's Event Platform. We have some requirements for our event stream producers, and not having to re-implement this logic in multiple programming languages and

Re: [VOTE] KIP-988 Streams StandbyUpdateListener

2023-10-23 Thread Bill Bejeck
This is a great addition +1(binding) -Bill On Fri, Oct 20, 2023 at 2:29 PM Almog Gavra wrote: > +1 (non-binding) - great improvement, thanks Colt & Eduwer! > > On Tue, Oct 17, 2023 at 11:25 AM Guozhang Wang > > wrote: > > > +1 from me. > > > > On Mon, Oct 16, 2023 at 1:56 AM Lucas Brutschy >

Re: [VOTE] KIP-979 Allow independently stop KRaft processes

2023-10-23 Thread Ron Dagostino
Hi Hailey. I'm +1 (binding), but could you add a "Rejected Alternatives" section to the KIP and mention the "--required-config " option that we decided against and the reason why we made the decision to reject it? There were some other small things (dash instead of dot in the parameter names,

[jira] [Created] (KAFKA-15671) Flaky test RemoteIndexCacheTest.testClearCacheAndIndexFilesWhenResizeCache

2023-10-23 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-15671: Summary: Flaky test RemoteIndexCacheTest.testClearCacheAndIndexFilesWhenResizeCache Key: KAFKA-15671 URL: https://issues.apache.org/jira/browse/KAFKA-15671 Project:

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #98

2023-10-23 Thread Apache Jenkins Server
See Changes: -- [...truncated 308045 lines...] > Task :connect:json:testJar > Task :connect:api:generateMetadataFileForMavenJavaPublication > Task

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #85

2023-10-23 Thread Apache Jenkins Server
See Changes: -- [...truncated 4564 lines...] Required by: project :streams:upgrade-system-tests-35 * Try: > Run with --stacktrace option to get the stack trace.

[jira] [Resolved] (KAFKA-15093) Add 3.5.0 to broker/client and streams upgrade/compatibility tests

2023-10-23 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-15093. Fix Version/s: 3.5.2 3.7.0 3.6.1 Resolution:

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2320

2023-10-23 Thread Apache Jenkins Server
See Changes: -- [...truncated 423553 lines...] Gradle Test Run :core:test > Gradle Test Executor 88 > ZkMigrationClientTest > testClaimAbsentController() PASSED Gradle

[jira] [Created] (KAFKA-15670) KRaft controller using wrong listener to send RPC to brokers in dual-write mode

2023-10-23 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15670: - Summary: KRaft controller using wrong listener to send RPC to brokers in dual-write mode Key: KAFKA-15670 URL: https://issues.apache.org/jira/browse/KAFKA-15670 Project:

[jira] [Resolved] (KAFKA-15457) Add support for OffsetFetch version 9 in admin

2023-10-23 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15457. - Fix Version/s: 3.7.0 Resolution: Fixed > Add support for OffsetFetch version 9 in admin

[jira] [Resolved] (KAFKA-15664) Add 3.4.0 streams upgrade/compatibility tests

2023-10-23 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-15664. Resolution: Fixed > Add 3.4.0 streams upgrade/compatibility tests >

[jira] [Created] (KAFKA-15669) Implement telemetry naming strategy

2023-10-23 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-15669: - Summary: Implement telemetry naming strategy Key: KAFKA-15669 URL: https://issues.apache.org/jira/browse/KAFKA-15669 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-15668) Add Opentelemetry Proto library with shadowed classes

2023-10-23 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-15668: - Summary: Add Opentelemetry Proto library with shadowed classes Key: KAFKA-15668 URL: https://issues.apache.org/jira/browse/KAFKA-15668 Project: Kafka

[jira] [Created] (KAFKA-15667) preCheck the invalid configuration for tiered storage replication factor

2023-10-23 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15667: - Summary: preCheck the invalid configuration for tiered storage replication factor Key: KAFKA-15667 URL: https://issues.apache.org/jira/browse/KAFKA-15667 Project: Kafka

[jira] [Created] (KAFKA-15666) Добавить функцию поиска по почте

2023-10-23 Thread Eleonora (Jira)
Eleonora created KAFKA-15666: Summary: Добавить функцию поиска по почте Key: KAFKA-15666 URL: https://issues.apache.org/jira/browse/KAFKA-15666 Project: Kafka Issue Type: Improvement

Re: [VOTE] KIP-979 Allow independently stop KRaft processes

2023-10-23 Thread Federico Valeri
+1 (non binding) Thanks. On Mon, Oct 23, 2023 at 9:48 AM Kamal Chandraprakash wrote: > > +1 (non-binding). Thanks for the KIP! > > On Mon, Oct 23, 2023, 12:55 Hailey Ni wrote: > > > Hi all, > > > > I'd like to call a vote on KIP-979 that will allow users to independently > > stop KRaft

Re: [VOTE] KIP-979 Allow independently stop KRaft processes

2023-10-23 Thread Kamal Chandraprakash
+1 (non-binding). Thanks for the KIP! On Mon, Oct 23, 2023, 12:55 Hailey Ni wrote: > Hi all, > > I'd like to call a vote on KIP-979 that will allow users to independently > stop KRaft processes. > > >

[VOTE] KIP-979 Allow independently stop KRaft processes

2023-10-23 Thread Hailey Ni
Hi all, I'd like to call a vote on KIP-979 that will allow users to independently stop KRaft processes. https://cwiki.apache.org/confluence/display/KAFKA/KIP-979%3A+Allow+independently+stop+KRaft+processes Thanks, Hailey

Re: [DISCUSS] KIP-975 Docker Image for Apache Kafka

2023-10-23 Thread Vedarth Sharma
Hi Ismael, Thanks for the correction. We will be following the same EOL policy as Apache Kafka, hence we have removed it from the KIP. Thanks and regards, Vedarth On Mon, Oct 23, 2023 at 12:17 PM Ismael Juma wrote: > Sorry, I noticed a typo in my message. I meant "Additionally, we should not

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2319

2023-10-23 Thread Apache Jenkins Server
See Changes: -- [...truncated 320393 lines...] > Task :connect:json:testJar > Task :connect:api:copyDependantLibs UP-TO-DATE > Task :connect:json:testSrcJar > Task

Re: [DISCUSS] KIP-975 Docker Image for Apache Kafka

2023-10-23 Thread Ismael Juma
Sorry, I noticed a typo in my message. I meant "Additionally, we should not specify the EOL policy in this KIP" since it doesn't propose changing it. Ismael On Sun, Oct 22, 2023 at 10:56 PM Vedarth Sharma wrote: > Hi Ismael, > Thanks for the valuable feedback. > >1. No docker image