Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #25

2023-09-05 Thread Apache Jenkins Server
See

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2176

2023-09-05 Thread Apache Jenkins Server
See

Re: Unable to start the Kafka with Kraft in Windows 11

2023-09-05 Thread ziming deng
It seems this is related to KAFKA-14273, there is already a pr for this problem, but it’s not merged. https://github.com/apache/kafka/pull/12763 -- Ziming > On Sep 6, 2023, at 07:25, Greg Harris wrote: > > Hey Sumanshu, > > Thanks for trying out Kraft! I hope that you can get it working :)

Re: Re: Re: Re: [DISCUSS] KIP-971 Expose replication-offset-lag MirrorMaker2 metric

2023-09-05 Thread hudeqi
Hey, Viktor. As far as my implementation is concerned, the default setting is 30s, but I added it to `MirrorConnectorConfig`, which can be adjusted freely according to the load of the source cluster and the number of tasks. best, hudeqi Viktor Somogyi-Vass

Re: KIP-976: Cluster-wide dynamic log adjustment for Kafka Connect

2023-09-05 Thread Sagar
Hey Chris, Thanks for making the updates. The updated definition of last_modified looks good to me. As a continuation to point number 2, could we also mention that this could be used to get insights into the propagation of the cluster wide log level updates. It is implicit but probably better to

[jira] [Created] (KAFKA-15438) Review exception caching logic used for reset/validate positions in async consumer

2023-09-05 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-15438: -- Summary: Review exception caching logic used for reset/validate positions in async consumer Key: KAFKA-15438 URL: https://issues.apache.org/jira/browse/KAFKA-15438

Re: [VOTE] KIP-953: partition method to be overloaded to accept headers as well.

2023-09-05 Thread Sagar
Hey Jack, The way I interpreted this thread, it seems like there's more alignment on the DTO based approach. I spent some time on the suggestion that Ismael had regarding the usage of ProducerRecord. Did you get a chance to look at the reply I had posted and whether that makes sense? Also,

Re: Apache Kafka 3.6.0 release

2023-09-05 Thread Satish Duggana
Hi David, Thanks for bringing this issue to this thread. I marked https://issues.apache.org/jira/browse/KAFKA-15435 as a blocker. Thanks, Satish. On Tue, 5 Sept 2023 at 21:29, David Arthur wrote: > > Hi Satish. Thanks for running the release! > > I'd like to raise this as a blocker for 3.6 >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #24

2023-09-05 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #70

2023-09-05 Thread Apache Jenkins Server
See Changes: -- [...truncated 283943 lines...] > Task :clients:generateMetadataFileForMavenJavaPublication > Task :connect:json:testSrcJar > Task :streams:srcJar > Task

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2175

2023-09-05 Thread Apache Jenkins Server
See Changes: -- [...truncated 409366 lines...] Gradle Test Run :streams:test > Gradle Test Executor 84 > TasksTest > shouldDrainPendingTasksToCreate() STARTED Gradle

Re: Unable to start the Kafka with Kraft in Windows 11

2023-09-05 Thread Greg Harris
Hey Sumanshu, Thanks for trying out Kraft! I hope that you can get it working :) I am not familiar with Kraft or Windows, but the error appears to mention that the file is already in use by another process so maybe we can start there. 1. Have you verified that no other Kafka processes are

[jira] [Created] (KAFKA-15437) Add metrics about open iterators

2023-09-05 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-15437: --- Summary: Add metrics about open iterators Key: KAFKA-15437 URL: https://issues.apache.org/jira/browse/KAFKA-15437 Project: Kafka Issue Type: New

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #69

2023-09-05 Thread Apache Jenkins Server
See Changes: -- [...truncated 283412 lines...] > Task :raft:testClasses UP-TO-DATE > Task :connect:json:testJar > Task :connect:json:testSrcJar > Task

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #23

2023-09-05 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2174

2023-09-05 Thread Apache Jenkins Server
See Changes: -- [...truncated 410419 lines...] Gradle Test Run :streams:test > Gradle Test Executor 85 > TasksTest > shouldDrainPendingTasksToCreate() PASSED Gradle Test

Re: [DISCUSS] KIP-939: Support Participation in 2PC

2023-09-05 Thread Alexander Sorokoumov
Hi Artem, Thanks for publishing this KIP! Can you please clarify the purpose of having broker-level transaction.two.phase.commit.enable config in addition to the new ACL? If the brokers are configured with transaction.two.phase.commit.enable=false, at what point will a client configured with

[jira] [Created] (KAFKA-15436) Custom ConfigDef validators are invoked with null when user-provided value does not match type

2023-09-05 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-15436: - Summary: Custom ConfigDef validators are invoked with null when user-provided value does not match type Key: KAFKA-15436 URL: https://issues.apache.org/jira/browse/KAFKA-15436

[jira] [Resolved] (KAFKA-9800) [KIP-580] Client Exponential Backoff Implementation

2023-09-05 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-9800. Fix Version/s: 3.7.0 Resolution: Fixed Merged [https://github.com/apache/kafka/pull/14111] to

[GitHub] [kafka-site] C0urante merged pull request #538: MINOR: Add missing entries for Kafka Connect to the documentation's table of contents

2023-09-05 Thread via GitHub
C0urante merged PR #538: URL: https://github.com/apache/kafka-site/pull/538 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: KIP-976: Cluster-wide dynamic log adjustment for Kafka Connect

2023-09-05 Thread Chris Egerton
Hi Sagar, Thanks for your thoughts! Responses inline: > 1) Considering that you have now clarified here that last_modified field would be stored in-memory, it is not mentioned in the KIP. Although that's something that's understandable, it wasn't apparent when reading the KIP. Probably, we could

[GitHub] [kafka-site] yashmayya commented on pull request #538: MINOR: Add missing entries for Kafka Connect to the documentation's table of contents

2023-09-05 Thread via GitHub
yashmayya commented on PR #538: URL: https://github.com/apache/kafka-site/pull/538#issuecomment-1707109599 cc @C0urante -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [kafka-site] yashmayya opened a new pull request, #538: MINOR: Add missing entries for Kafka Connect to the documentation's table of contents

2023-09-05 Thread via GitHub
yashmayya opened a new pull request, #538: URL: https://github.com/apache/kafka-site/pull/538 - https://github.com/apache/kafka/pull/14337 - Some of Kafka Connect's top level headings (``) and sub top level headings (``) in the documentation weren't added to the documentation's table of

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.6 #22

2023-09-05 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-15293) Update metrics doc to add tiered storage metrics

2023-09-05 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-15293. Resolution: Fixed > Update metrics doc to add tiered storage metrics >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2173

2023-09-05 Thread Apache Jenkins Server
See

RE: Need more clarity in documentation for upgrade/downgrade procedures and limitations across releases.

2023-09-05 Thread Kaushik Srinivas (Nokia)
Hi Team, Any help on this query ? Thanks. From: Kaushik Srinivas (Nokia) Sent: Tuesday, August 22, 2023 10:27 AM To: dev@kafka.apache.org Subject: Need more clarity in documentation for upgrade/downgrade procedures and limitations across releases. Hi Team, Referring to the upgrade

Re: Apache Kafka 3.6.0 release

2023-09-05 Thread David Arthur
Hi Satish. Thanks for running the release! I'd like to raise this as a blocker for 3.6 https://issues.apache.org/jira/browse/KAFKA-15435. It's a very quick fix, so I should be able to post a PR soon. Thanks! David On Mon, Sep 4, 2023 at 11:44 PM Justine Olshan wrote: > Thanks Satish. This is

[jira] [Created] (KAFKA-15435) KRaft migration record counts in log message are incorrect

2023-09-05 Thread David Arthur (Jira)
David Arthur created KAFKA-15435: Summary: KRaft migration record counts in log message are incorrect Key: KAFKA-15435 URL: https://issues.apache.org/jira/browse/KAFKA-15435 Project: Kafka

Re: KIP-976: Cluster-wide dynamic log adjustment for Kafka Connect

2023-09-05 Thread Sagar
Hey Chris, Thanks for the KIP. Seems like a useful feature. I have some more questions/comments: 1) Considering that you have now clarified here that last_modified field would be stored in-memory, it is not mentioned in the KIP. Although that's something that's understandable, it wasn't apparent

Re: KIP-976: Cluster-wide dynamic log adjustment for Kafka Connect

2023-09-05 Thread Chris Egerton
Hi all, Thank you so much for the generous review comments! Happy to see interest in this feature. Inline responses follow. Ashwin: > Don't you foresee a future scope type which may require cluster metadata ? In that case, isn't it better to forward the requests to the leader in the initial

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.6 #21

2023-09-05 Thread Apache Jenkins Server
See

Re: Re: Re: [DISCUSS] KIP-971 Expose replication-offset-lag MirrorMaker2 metric

2023-09-05 Thread Viktor Somogyi-Vass
Hey Elkhan and hudeqi, I'm reading your debate around the implementation. I also think a scheduled task would be better in overall accuracy and performance (compared to calling endOffsets with every poll). Hudeqi, do you have any experience of what works best for you in terms of time intervals? I

[jira] [Created] (KAFKA-15434) Tiered Storage Quotas

2023-09-05 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15434: -- Summary: Tiered Storage Quotas Key: KAFKA-15434 URL: https://issues.apache.org/jira/browse/KAFKA-15434 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-15433) Follower fetch from tiered offset

2023-09-05 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15433: -- Summary: Follower fetch from tiered offset Key: KAFKA-15433 URL: https://issues.apache.org/jira/browse/KAFKA-15433 Project: Kafka Issue Type:

Re: [VOTE] KIP-858: Handle JBOD broker disk failure in KRaft

2023-09-05 Thread ziming deng
Hi, Igor I’m +1(binding) for this, looking forward the PR. -- Best, Ziming > On Jul 26, 2023, at 01:13, Igor Soarez wrote: > > Hi everyone, > > Following a face-to-face discussion with Ron and Colin, > I have just made further improvements to this KIP: > > > 1. Every log directory gets a

[jira] [Created] (KAFKA-15432) RLM Stop partitions should not be invoked for non-tiered storage topics

2023-09-05 Thread Kamal Chandraprakash (Jira)
Kamal Chandraprakash created KAFKA-15432: Summary: RLM Stop partitions should not be invoked for non-tiered storage topics Key: KAFKA-15432 URL: https://issues.apache.org/jira/browse/KAFKA-15432

Re: [DISCUSS] KIP-940: Broker extension point for validating record contents at produce time

2023-09-05 Thread Edoardo Comar
Hi all, we have opened the VOTE thread a few weeks ago as we hoped that this DISCUSS thread exchange had been exhaustive. If so, we would you like any interested party to. cast a vote there. Of course we're happy to further progress the KIP discussion if needed. Thanks Edo & Adrian On Wed, 5

[jira] [Resolved] (KAFKA-15261) ReplicaFetcher thread should not block if RLMM is not initialized

2023-09-05 Thread Abhijeet Kumar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhijeet Kumar resolved KAFKA-15261. Resolution: Fixed > ReplicaFetcher thread should not block if RLMM is not initialized >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2172

2023-09-05 Thread Apache Jenkins Server
See