Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3132

2024-07-22 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.8 #73

2024-07-22 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-16791) Add thread detection to ClusterTestExtensions

2024-07-22 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16791. Fix Version/s: 3.9.0 Resolution: Fixed > Add thread detection to ClusterTestExtensi

[DISCUSS] KIP-512: make Record Headers available in onAcknowledgement

2024-07-22 Thread Rich C.
Hi Everyone, I hope this email finds you well. I would like to start a discussion on KIP-512. The initial version of KIP-512 was created in 2019, and I have resurrected it in 2024 with more details about the motivation behind it. You can view the current version of the KIP here: KIP-512: Make Re

RE: [DISCUSS] KIP-1052: Enable warmup in producer performance test

2024-07-22 Thread Welch, Matt
Hi Federico, Bumping for visibility. I've had some additional thoughts on below over the last couple weeks. I really don't think we need the option to have combined/separated stats and I think printing warmup-only, followed by steady-state only at the end of the run would be my preferred choi

Re: [DISCUSS] KIP-1059: Enable the Producer flush() method to clear the latest send() error

2024-07-22 Thread Matthias J. Sax
Thanks Greg, Apologize if we gave the impression that we did not try to address your concerns. It was not my intention to just minimize them. Of course, I just don't see it your way, but that's ok. We don't have to agree. That's why we have a DISCUSS thread to begin with. I don't know the pr

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
soarez commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1687161313 ## blog.html: ## @@ -22,6 +22,98 @@ Blog + + + +Apache Kafka 3.8.0

[jira] [Created] (KAFKA-17182) Consumer's fetch sessions are evicted too quickly

2024-07-22 Thread Kirk True (Jira)
Kirk True created KAFKA-17182: - Summary: Consumer's fetch sessions are evicted too quickly Key: KAFKA-17182 URL: https://issues.apache.org/jira/browse/KAFKA-17182 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-17183) New consumer system tests pass for subset of tests, but fail if running all tests

2024-07-22 Thread Kirk True (Jira)
Kirk True created KAFKA-17183: - Summary: New consumer system tests pass for subset of tests, but fail if running all tests Key: KAFKA-17183 URL: https://issues.apache.org/jira/browse/KAFKA-17183 Project:

Re: Subscribe to Kafka dev mailing list

2024-07-22 Thread Justine Olshan
Hey there, Please send a message to dev-subscr...@kafka.apache.org to subscribe. After sending an email, be on the lookout for a follow up to confirm the subscription. Thanks, Justine On Mon, Jul 22, 2024 at 1:59 AM 徐植君 wrote: > Dear Kafka Team, > > I'd like to subscribe to the Kafka developme

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3130

2024-07-22 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-1059: Enable the Producer flush() method to clear the latest send() error

2024-07-22 Thread Greg Harris
Hi Alieh, Yes, I think you understand my intent for the prepare() method. Thanks, Greg On Mon, Jul 22, 2024 at 2:54 AM Alieh Saeedi wrote: > Hi Greg, > > > I appreciate your concerns and comprehensive answer. > > > I am not sure whether I fully understood what you meant or not. You mean, > at

Re: [VOTE] KIP-939: Support Participation in 2PC

2024-07-22 Thread Jun Rao
Hi, Artem, Thanks for the KIP. +1 from me. Jun On Wed, May 29, 2024 at 9:41 AM Jason Gustafson wrote: > +1 Thanks for the KIP! > > On Wed, Mar 13, 2024 at 5:13 AM Omnia Ibrahim > wrote: > > > I had a look at the discussion thread and the KIP looks exciting. > > +1 non-binding > > > > Best > >

[jira] [Resolved] (KAFKA-17159) Make sure kafka-cluster-test-kit-executor get down when closing KafkaClusterTestKit

2024-07-22 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17159. Fix Version/s: 3.9.0 Resolution: Fixed > Make sure kafka-cluster-test-kit-executor

Re: [VOTE] 3.8.0 RC2

2024-07-22 Thread Josep Prat
Thanks Chia-Ping, I'm cancelling this Vote thread. I'll be generating the next RC tomorrow morning CEST. Best, -- Josep Prat Open Source Engineering Director, Aiven josep.p...@aiven.io | +491715557497 | aiven.io Aiven Deutschland GmbH Alexanderufer 3-7, 10117 Berlin Geschäfts

Re: [VOTE] 3.8.0 RC2

2024-07-22 Thread Chia-Ping Tsai
hi Josep, Sorry for bringing this news. There is a correctness issue (https://github.com/apache/kafka/pull/16641) and the fix should be backport to 3.8. Thanks, Chia-Ping On 2024/07/18 09:19:06 Josep Prat wrote: > Hello Kafka users, developers and client-developers, > > This is the third cand

Re: [DISCUSS] KIP-1065: Add "retry" return-option to ProductionExceptionHandler

2024-07-22 Thread Alieh Saeedi
Hi all, Thanks for the KIP, Matthias. Yes, adding the `RETRY` option to `ProductionExceptionhandler` enables us to have a further fix in order to make KAFKA-16508 backward compatible. @Sophie: Regarding other built-in handlers: Do you mean 1) adding `RETRY` to `DeserializationExceptionHandler` i

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686806813 ## 38/upgrade.html: ## @@ -28,7 +28,8 @@ Notable changes in 3 If READ is not authorized, checkpointing is limited to offsets mirrorred after the start of

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686804388 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
soarez commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686799171 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [VOTE]: KIP-1032: Upgrade to Jakarta and JavaEE 10 in Kafka 4.0

2024-07-22 Thread Christopher Shannon
Hi Everyone, I forgot to add my explicit +1 (non-binding) as well. The vote passes with: * 3 binding votes (Chris Egerton, Mickael Maison, Greg Harris) * 1 non-binding vote (Christopher Shannon) I'll update the wiki. I should have some time coming up to work on a PR for this if no one else take

[jira] [Resolved] (KAFKA-15368) Test ZK JBOD to KRaft migration

2024-07-22 Thread Igor Soarez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Soarez resolved KAFKA-15368. - Resolution: Fixed This was done as part of https://github.com/apache/kafka/pull/15394 > Test ZK

[jira] [Resolved] (KAFKA-15359) Support log.dir.failure.timeout.ms configuration for JBOD

2024-07-22 Thread Igor Soarez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Soarez resolved KAFKA-15359. - Resolution: Fixed > Support log.dir.failure.timeout.ms configuration for JBOD >

Re: [VOTE]: KIP-1032: Upgrade to Jakarta and JavaEE 10 in Kafka 4.0

2024-07-22 Thread Mickael Maison
Hi Christopher, +1 (binding) Thanks for the KIP! Mickael On Mon, Jul 22, 2024 at 5:01 PM Christopher Shannon wrote: > > We still need another binding vote so I am bumping this vote. > > On Tue, Jul 9, 2024 at 6:15 PM Chris Egerton > wrote: > > > +1 (binding), thanks for the KIP! > > > > On Tu

Re: [DISCUSS] Apache Kafka 3.9.0 release

2024-07-22 Thread Loic Greffier
Hello, Can KIP-1033 https://cwiki.apache.org/confluence/display/KAFKA/KIP-1033%3A+Add+Kafka+Streams+exception+handler+for+exceptions+occurring+during+processing be included in this release? Most of the PRs related to this KIP have been reviewed and merged. There are 3 additional less complex P

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686703063 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [VOTE]: KIP-1032: Upgrade to Jakarta and JavaEE 10 in Kafka 4.0

2024-07-22 Thread Christopher Shannon
We still need another binding vote so I am bumping this vote. On Tue, Jul 9, 2024 at 6:15 PM Chris Egerton wrote: > +1 (binding), thanks for the KIP! > > On Tue, Jul 9, 2024 at 11:35 AM Greg Harris > wrote: > > > While breaking compatibility is always undesirable, this is > unfortunately a > >

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686672928 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686658050 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
mimaison commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686644487 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8

[jira] [Created] (KAFKA-17181) Fix possible partial write in writing snapshot (ProducerStateManager)

2024-07-22 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17181: -- Summary: Fix possible partial write in writing snapshot (ProducerStateManager) Key: KAFKA-17181 URL: https://issues.apache.org/jira/browse/KAFKA-17181 Project: Ka

[jira] [Resolved] (KAFKA-17165) Revisit LeaderEpochFileCache#writeToFileForTruncation

2024-07-22 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17165. Fix Version/s: 3.9.0 Resolution: Fixed > Revisit LeaderEpochFileCache#writeToFileFo

[jira] [Resolved] (KAFKA-17166) Use `NoOpScheduler` to rewrite LogManagerTest#testLogRecoveryMetrics

2024-07-22 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17166. Fix Version/s: 3.9.0 Resolution: Fixed > Use `NoOpScheduler` to rewrite LogManagerT

[jira] [Resolved] (KAFKA-16772) Introduce a type for kraft.version

2024-07-22 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-16772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-16772. Resolution: Fixed > Introduce a type for kraft.version > -

[jira] [Resolved] (KAFKA-16519) Expose the supported and finalized kraft.version in ApiVersions response

2024-07-22 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-16519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-16519. Resolution: Duplicate This was resolved as part of another issue a

[jira] [Created] (KAFKA-17180) Upgrade gradle from 8.8 to 8.9

2024-07-22 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17180: -- Summary: Upgrade gradle from 8.8 to 8.9 Key: KAFKA-17180 URL: https://issues.apache.org/jira/browse/KAFKA-17180 Project: Kafka Issue Type: Improvement

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686561076 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686561076 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686558361 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686558361 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686550070 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

Re: [DISCUSS] KIP-1062: Introduce Pagination for some requests used by Admin API

2024-07-22 Thread Omnia Ibrahim
Hi David, thanks for the feedback and sorry for taking long to respond as I was off for a week. > DA1: In "Public Interfaces" you say "max.request.pagination.size.limit" > controls the max items to return by default. It's not clear to me if this > is just a default, or if it is a hard limit. In

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
soarez commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686536228 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686495626 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686444663 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [DISCUSS] KIP-1071: Streams Rebalance Protocol

2024-07-22 Thread Andrew Schofield
Hi Lianet, I have a comment on your comment. I think that’s allowed. LM3. I quite like the idea of having an INVALID_GROUP_TYPE error code for RPCs which were applied to a group which turned out to be the wrong type. We might even be able to use INCONSISTENT_GROUP_PROTOCOL for this purpose. Howev

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686448577 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686444663 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686446175 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686443757 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686443788 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686443757 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686442326 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686393013 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

Re: [DISCUSS] KIP-1059: Enable the Producer flush() method to clear the latest send() error

2024-07-22 Thread Alieh Saeedi
Hi Greg, I appreciate your concerns and comprehensive answer. I am not sure whether I fully understood what you meant or not. You mean, at the end, the user can go for one of the following scenarios: Either 1) `beginTxn()` and `send(record)` and `commitTxn()` or 2) `beginTxn()` and `prepare(

[jira] [Created] (KAFKA-17179) Don't add `integration` tag when using `ClusterTestExtensions`

2024-07-22 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17179: -- Summary: Don't add `integration` tag when using `ClusterTestExtensions` Key: KAFKA-17179 URL: https://issues.apache.org/jira/browse/KAFKA-17179 Project: Kafka

Subscribe to Kafka dev mailing list

2024-07-22 Thread 徐植君
Dear Kafka Team, I'd like to subscribe to the Kafka development mailing list. Please find my email below for subscription. Best regards, 徐植君 xuzhi...@gmail.com

Re: [VOTE] 3.8.0 RC2

2024-07-22 Thread Jakub Scholz
+1 (non-binding). I used the staged Scala 2.13 binaries and the staged Maven artifacts. All seems to work fine. Thanks! Jakub On Thu, Jul 18, 2024 at 11:19 AM Josep Prat wrote: > Hello Kafka users, developers and client-developers, > > This is the third candidate for release of Apache Kafka 3.8