Re: [DISCUSS] Adding non-committers as Github collaborators

2023-04-27 Thread Luke Chen
Hi David, Thanks for the suggestion. I'm +1. This is also a good way to show appreciation from Kafka community to some great contributors who haven't qualified to become committers. Luke On Fri, Apr 28, 2023 at 2:45 AM David Arthur wrote: > Hey folks, > > I stumbled across this wiki page from

[DISCUSS] Recommendations for managing long-running projects

2023-04-27 Thread Kirk True
Hi all, A handful of engineers are collaborating on a fairly sizable project to improve the Java consumer client [1]. We are using as many ASF tools as possible for the work (wiki, Jira, mailing list, and Slack thus far). There are yet two areas where we need recommendations: 1. Project

[jira] [Resolved] (KAFKA-14942) CopyOnWriteMap implements ConcurrentMap but does not implement required default methods

2023-04-27 Thread Steven Schlansker (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Schlansker resolved KAFKA-14942. --- Resolution: Invalid > CopyOnWriteMap implements ConcurrentMap but does not

[jira] [Created] (KAFKA-14950) Implement assign() and assignment()

2023-04-27 Thread Philip Nee (Jira)
Philip Nee created KAFKA-14950: -- Summary: Implement assign() and assignment() Key: KAFKA-14950 URL: https://issues.apache.org/jira/browse/KAFKA-14950 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-14949) Add Streams upgrade tests from AK 3.4

2023-04-27 Thread Victoria Xia (Jira)
Victoria Xia created KAFKA-14949: Summary: Add Streams upgrade tests from AK 3.4 Key: KAFKA-14949 URL: https://issues.apache.org/jira/browse/KAFKA-14949 Project: Kafka Issue Type: Task

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1803

2023-04-27 Thread Apache Jenkins Server
See Changes: -- [...truncated 4471 lines...] [2023-04-27T20:15:26.598Z] > Task :jmh-benchmarks:compileTestJava NO-SOURCE [2023-04-27T20:15:26.598Z] > Task

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1802

2023-04-27 Thread Apache Jenkins Server
See Changes: -- [...truncated 504805 lines...] [2023-04-27T15:19:52.854Z] [2023-04-27T15:19:52.854Z] Gradle Test Run :streams:integrationTest > Gradle Test Executor 181

Re: [DISCUSS] Apache Kafka 3.4.1 release

2023-04-27 Thread Kenneth Eversole
+1, Thanks for leading the charge. On Thu, Apr 27, 2023 at 2:54 PM Sophie Blee-Goldman wrote: > +1, thanks Luke! > > On Wed, Apr 26, 2023 at 10:53 AM Bruno Cadonna wrote: > > > Thanks a lot, Luke! > > > > +1 > > > > Best, > > Bruno > > > > On 26.04.23 16:11, Bill Bejeck wrote: > > > Thanks

Re: [DISCUSS] Apache Kafka 3.4.1 release

2023-04-27 Thread Sophie Blee-Goldman
+1, thanks Luke! On Wed, Apr 26, 2023 at 10:53 AM Bruno Cadonna wrote: > Thanks a lot, Luke! > > +1 > > Best, > Bruno > > On 26.04.23 16:11, Bill Bejeck wrote: > > Thanks for volunteering! > > > > +1 > > > > On Wed, Apr 26, 2023 at 8:33 AM Mickael Maison > > > wrote: > > > >> Thanks Luke > >>

[GitHub] [kafka-site] vcrfxia commented on pull request #507: MINOR: update docs note about spurious stream-stream join results

2023-04-27 Thread via GitHub
vcrfxia commented on PR #507: URL: https://github.com/apache/kafka-site/pull/507#issuecomment-1526201667 @mjsax can you review? Looks like I don't have permissions to add reviewers. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [kafka-site] vcrfxia opened a new pull request, #507: MINOR: update docs note about spurious stream-stream join results

2023-04-27 Thread via GitHub
vcrfxia opened a new pull request, #507: URL: https://github.com/apache/kafka-site/pull/507 Make changes from https://github.com/apache/kafka/pull/13642 live. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Resolved] (KAFKA-14948) Broker fails to rejoin cluster when cluster is in dual write mode

2023-04-27 Thread Proven Provenzano (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Proven Provenzano resolved KAFKA-14948. --- Resolution: Cannot Reproduce I updated my code to tip of master and cannot

Re: [DISCUSS] Apache Kafka 3.5.0 release

2023-04-27 Thread David Arthur
Hey Mickael, I have one major ZK migration improvement (KAFKA-14805) that landed in trunk this week that I'd like to merge to 3.5 (once we fix some test failures it introduced). After that, I have another PR for KAFKA-14840 which is essentially a huge bug in the ZK migration logic that needs to

[DISCUSS] Adding non-committers as Github collaborators

2023-04-27 Thread David Arthur
Hey folks, I stumbled across this wiki page from the infra team that describes the various features supported in the ".asf.yaml" file: https://cwiki.apache.org/confluence/display/INFRA/Git+-+.asf.yaml+features One section that looked particularly interesting was

Re: Adding reviewers with Github actions

2023-04-27 Thread David Arthur
I just merged the "reviewers" script I wrote a while ago: https://github.com/apache/kafka/pull/11096 It works by finding previous occurrences of "Reviewers: ...", so it only works for people who have reviewed something before. I do suspect this is largely the common case. E.g., searching for

Re: KIP-919: Allow AdminClient to Talk Directly with the KRaft Controller Quorum

2023-04-27 Thread Colin McCabe
On Wed, Apr 26, 2023, at 22:08, Luke Chen wrote: > Hi Colin, > > Some comments: > 1. I agree we should set "top-level" errors for metadata response > > 2. In the "brokers" field of metadata response from controller, it'll > respond with "Controller endpoint information as given in >

[jira] [Resolved] (KAFKA-7735) StateChangeLogMerger tool can not work due to incorrect topic regular matches

2023-04-27 Thread Federico Valeri (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Federico Valeri resolved KAFKA-7735. Resolution: Won't Fix > StateChangeLogMerger tool can not work due to incorrect topic

Re: KIP-922: Add the traffic metric of the partition dimension

2023-04-27 Thread Edoardo Comar
Hi hudeqi, thanks for the KIP. For the purpose of monitoring if partitions of a topic are used "fairly", the log end offset metric offers a good hint. Of course, it only expresses a message count, not bytes, but I find it sufficient and do not need the actual throughput per partition. Perhaps

[jira] [Created] (KAFKA-14948) Broker fails to rejoin cluster when cluster is in dual write mode

2023-04-27 Thread Proven Provenzano (Jira)
Proven Provenzano created KAFKA-14948: - Summary: Broker fails to rejoin cluster when cluster is in dual write mode Key: KAFKA-14948 URL: https://issues.apache.org/jira/browse/KAFKA-14948 Project:

[jira] [Resolved] (KAFKA-14929) Flaky KafkaStatusBackingStoreFormatTest#putTopicStateRetriableFailure

2023-04-27 Thread Viktor Somogyi-Vass (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viktor Somogyi-Vass resolved KAFKA-14929. - Resolution: Fixed > Flaky

Re: Requesting permissions to contribute to Apache Kafka

2023-04-27 Thread Mickael Maison
Hi, I granted you permissions. Thanks, Mickael On Thu, Apr 27, 2023 at 3:23 PM aaron ai wrote: > > Hello, > > I'm following > https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals#KafkaImprovementProposals-GettingStarted > and have reached step 4. > > wiki ID: aaronai >

Requesting permissions to contribute to Apache Kafka

2023-04-27 Thread aaron ai
Hello, I'm following https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals#KafkaImprovementProposals-GettingStarted and have reached step 4. wiki ID: aaronai Jira ID: aaronai

Re: Requesting permissions to contribute to Apache Kafka

2023-04-27 Thread Luke Chen
Hi Keith, Your accounts are all set. Thanks. Luke On Thu, Apr 27, 2023 at 8:44 PM Keith Wall wrote: > Hello, > > I'm following > https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals#KafkaImprovementProposals-GettingStarted > and have reached step 4. > > wiki ID: kwall

Requesting permissions to contribute to Apache Kafka

2023-04-27 Thread Keith Wall
Hello, I'm following https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals#KafkaImprovementProposals-GettingStarted and have reached step 4. wiki ID: kwall Jira ID: kwall Keith Wall.

Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

2023-04-27 Thread Nick Telford
Hi everyone, I find myself (again) considering removing the offset management from StateStores, and keeping the old checkpoint file system. The reason is that the StreamPartitionAssignor directly reads checkpoint files in order to determine which instance has the most up-to-date copy of the local

Re: Consumer offset value -Apache kafka 3.2.3

2023-04-27 Thread ziming deng
Hello, It seems kafka.tools.ConsumerOffsetChecker has been deprecated in 0.9.0, in the new version, please use kafka-consumer-groups.sh -- Best, Ziming > On Apr 26, 2023, at 18:21, Kafka Life wrote: > > Dear Kafka Experts > > How can we check for a particular offset number in Apache kafka

[jira] [Created] (KAFKA-14947) Duplicate records are getting created in the topic.

2023-04-27 Thread krishnendu Das (Jira)
krishnendu Das created KAFKA-14947: -- Summary: Duplicate records are getting created in the topic. Key: KAFKA-14947 URL: https://issues.apache.org/jira/browse/KAFKA-14947 Project: Kafka

[jira] [Created] (KAFKA-14946) Kafka Node Shutting Down Automatically

2023-04-27 Thread Akshay Kumar (Jira)
Akshay Kumar created KAFKA-14946: Summary: Kafka Node Shutting Down Automatically Key: KAFKA-14946 URL: https://issues.apache.org/jira/browse/KAFKA-14946 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-921 OpenJDK CRaC support

2023-04-27 Thread Radim Vansa
Thank you for those questions, as I've mentioned, my knowledge of Kafka is quite limited so these are the things that need careful thinking! Comments inline. On 26. 04. 23 16:28, Mickael Maison wrote: Hi Radim, Thanks for the KIP! CRaC is an interesting project and it could be a useful