Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2661

2024-02-20 Thread Apache Jenkins Server
See Changes: -- [...truncated 2574 lines...] [2024-02-21T05:34:55.249Z] > Task :tools:spotbugsMain [2024-02-21T05:34:55.793Z] > Task :server-common:checkstyleMain

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2660

2024-02-20 Thread Apache Jenkins Server
See

Re: [VOTE] 3.7.0 RC4

2024-02-20 Thread Luke Chen
Hi all, I found there is a bug (KAFKA-16283 ) in the built-in `RoundRobinPartitioner`, and it will cause only half of the partitions receiving the records. (I'm surprised our tests didn't catch it!?) After further testing, I found this issue

[PR] KAFKA-16283: notify users about RoundRobinPartitioner bug [kafka-site]

2024-02-20 Thread via GitHub
showuon opened a new pull request, #585: URL: https://github.com/apache/kafka-site/pull/585 Add notes in "config doc" to notify users about the bug: KAFKA-16283 and not to use `RoundRobinPartitioner`. -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [VOTE] 3.7.0 RC4

2024-02-20 Thread Proven Provenzano
HI, I've downloaded, built from source and then validated JBOD with KRaft works along with migrating a cluster with JBOD from ZK to KRaft works. +1 (nonbinding) from me. --Proven On Tue, Feb 20, 2024 at 2:13 PM Justine Olshan wrote: > Hey folks, > > I've done the following to validate the

[jira] [Resolved] (KAFKA-6675) Connect workers should log plugin path and available plugins more clearly

2024-02-20 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-6675. Fix Version/s: 3.6.0 Assignee: Greg Harris (was: Valeria Vasylieva) Resolution:

[jira] [Created] (KAFKA-16289) Values.parseString on heterogeneous lists and maps sometimes corrupts data by inferring incorrect schema

2024-02-20 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16289: --- Summary: Values.parseString on heterogeneous lists and maps sometimes corrupts data by inferring incorrect schema Key: KAFKA-16289 URL:

Re: [Discuss] KIP-1019: Expose method to determine Metric Measurability

2024-02-20 Thread Jun Rao
Hi, Apoorv, Thanks for the KIP. Could we document how we plan to use the new isMeasurable() method? For example, gauge is another type of metric. Do we plan to add an isGauge() method too? If so, is it better to add a separate method for each metric type or is it better to have a single method

[jira] [Resolved] (KAFKA-15475) Request might retry forever even if the user API timeout expires

2024-02-20 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True resolved KAFKA-15475. --- Resolution: Fixed > Request might retry forever even if the user API timeout expires >

[jira] [Reopened] (KAFKA-16200) Enforce that RequestManager implementations respect user-provided timeout

2024-02-20 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True reopened KAFKA-16200: --- > Enforce that RequestManager implementations respect user-provided timeout >

Re: [VOTE] KIP-1019: Expose method to determine Metric Measurability

2024-02-20 Thread Matthias J. Sax
+1 (binding) On 2/20/24 2:55 AM, Manikumar wrote: +1 (binding). Thanks for the KIP. Manikumar On Tue, Feb 20, 2024 at 2:31 PM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: Hi Apoorv, Thanks for the KIP. +1 (non-binding) Thanks, Andrew On 19 Feb 2024, at 22:31, Apoorv

[jira] [Resolved] (KAFKA-16199) Prune the event queue if event timeout expired before starting

2024-02-20 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True resolved KAFKA-16199. --- Resolution: Duplicate > Prune the event queue if event timeout expired before starting >

[jira] [Resolved] (KAFKA-16200) Enforce that RequestManager implementations respect user-provided timeout

2024-02-20 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True resolved KAFKA-16200. --- Resolution: Duplicate > Enforce that RequestManager implementations respect user-provided timeout >

[jira] [Resolved] (KAFKA-16019) Some of the tests in PlaintextConsumer can't seem to deterministically invoke and verify the consumer callback

2024-02-20 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True resolved KAFKA-16019. --- Resolution: Fixed > Some of the tests in PlaintextConsumer can't seem to deterministically invoke

[jira] [Resolved] (KAFKA-16023) PlaintextConsumerTest needs to wait for reconciliation to complete before proceeding

2024-02-20 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True resolved KAFKA-16023. --- Resolution: Fixed {{testPerPartitionLagMetricsCleanUpWithSubscribe}} is now passing consistently,

[jira] [Resolved] (KAFKA-15993) Enable max poll integration tests that depend on callback invocation

2024-02-20 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True resolved KAFKA-15993. --- Resolution: Duplicate > Enable max poll integration tests that depend on callback invocation >

[jira] [Resolved] (KAFKA-16208) Design new Consumer timeout policy

2024-02-20 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True resolved KAFKA-16208. --- Resolution: Duplicate > Design new Consumer timeout policy > -- > >

[jira] [Created] (KAFKA-16288) Values.convertToDecimal throws ClassCastExceptions on String inputs

2024-02-20 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16288: --- Summary: Values.convertToDecimal throws ClassCastExceptions on String inputs Key: KAFKA-16288 URL: https://issues.apache.org/jira/browse/KAFKA-16288 Project: Kafka

[jira] [Created] (KAFKA-16287) Implement example test for common rebalance callback scenarios

2024-02-20 Thread Kirk True (Jira)
Kirk True created KAFKA-16287: - Summary: Implement example test for common rebalance callback scenarios Key: KAFKA-16287 URL: https://issues.apache.org/jira/browse/KAFKA-16287 Project: Kafka

Re: [DISCUSS] KIP-939: Support Participation in 2PC

2024-02-20 Thread Jun Rao
Hi, Artem, Thanks for the reply. 20. "Say if an application currently uses initTransactions() to achieve the current semantics, it would need to be rewritten to use initTransactions() + abort to achieve the same semantics if the config is changed. " This only takes care of the abort case. The

Re: [VOTE] 3.7.0 RC4

2024-02-20 Thread Justine Olshan
Hey folks, I've done the following to validate the release: -- validated the keys for all the artifacts -- built from source and started a ZK cluster -- ran a few workloads on it. -- ran 2.12 Kraft cluster and ran a few workloads on it I see there is a lot of ongoing discussion about the

[jira] [Created] (KAFKA-16286) KRaft doesn't always notify listener of latest leader

2024-02-20 Thread Jira
José Armando García Sancio created KAFKA-16286: -- Summary: KRaft doesn't always notify listener of latest leader Key: KAFKA-16286 URL: https://issues.apache.org/jira/browse/KAFKA-16286

Re: [PR] 37: remove jbod as missing feature in kraft [kafka-site]

2024-02-20 Thread via GitHub
divijvaidya commented on PR #584: URL: https://github.com/apache/kafka-site/pull/584#issuecomment-1954810785 Hey @gaurav-narula Thanks for making this change but I think we already got it covered in

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2659

2024-02-20 Thread Apache Jenkins Server
See

[PR] 37: remove jbod as missing feature in kraft [kafka-site]

2024-02-20 Thread via GitHub
gaurav-narula opened a new pull request, #584: URL: https://github.com/apache/kafka-site/pull/584 Thanks @divijvaidya for pointing this out in

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

2024-02-20 Thread via GitHub
divijvaidya commented on code in PR #578: URL: https://github.com/apache/kafka-site/pull/578#discussion_r1496098814 ## 37/upgrade.html: ## @@ -18,8 +18,85 @@

Re: [DISCUSS] KIP-932: Queues for Kafka

2024-02-20 Thread Andrew Schofield
Hi Manikumar, Thanks for your comments. 1. I believe that in general, there are not situations in which a dynamic config change is prevented because of the existence of a resource. So, if we prevented setting config `group.type=consumer` on resource G of GROUP type if there was a share group G in

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

2024-02-20 Thread via GitHub
soarez commented on code in PR #578: URL: https://github.com/apache/kafka-site/pull/578#discussion_r1495950924 ## 37/upgrade.html: ## @@ -18,8 +18,85 @@

Re: [VOTE] 3.7.0 RC4

2024-02-20 Thread Divij Vaidya
> I am a bit unclear on the precise process regarding what parts of this get merged at what time, and whether the release first needs to be done or not. The order is as follows: 1. Release approved as part of this vote. After this we follow the steps from here:

Re: [PR] 37: Add upgrade notes for the 3.7.0 release [kafka-site]

2024-02-20 Thread via GitHub
divijvaidya commented on code in PR #581: URL: https://github.com/apache/kafka-site/pull/581#discussion_r1495890168 ## 37/upgrade.html: ## @@ -18,8 +18,85 @@

Re: [VOTE] 3.7.0 RC4

2024-02-20 Thread Stanislav Kozlovski
Thanks for testing the release! And thanks for the review on the documentation. Good catch on the license too. I have addressed the comments in the blog PR, and opened a few other PRs to the website in relation to the release. - 37: Add download section for the latest 3.7 release

Re: [PR] 37: Add download section for the latest 3.7 release [kafka-site]

2024-02-20 Thread via GitHub
divijvaidya commented on PR #583: URL: https://github.com/apache/kafka-site/pull/583#issuecomment-1954277178 > But I assume also we have time between the actual release and the announcement. Yes, we can publish this PR *after* uploading artifacts to maven etc. -- This is an

Re: [PR] 37: Add download section for the latest 3.7 release [kafka-site]

2024-02-20 Thread via GitHub
divijvaidya commented on code in PR #583: URL: https://github.com/apache/kafka-site/pull/583#discussion_r1495864194 ## downloads.html: ## @@ -6,12 +6,45 @@ Download -3.6.1 is the latest release. The current stable version is 3.6.1 +3.7.0 is the latest

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

2024-02-20 Thread via GitHub
divijvaidya commented on code in PR #578: URL: https://github.com/apache/kafka-site/pull/578#discussion_r1495858647 ## blog.html: ## @@ -22,6 +22,125 @@ Blog + + + +Apache

Re: [PR] 37: Add download section for the latest 3.7 release [kafka-site]

2024-02-20 Thread via GitHub
stanislavkozlovski commented on code in PR #583: URL: https://github.com/apache/kafka-site/pull/583#discussion_r1495863880 ## downloads.html: ## @@ -6,12 +6,45 @@ Download -3.6.1 is the latest release. The current stable version is 3.6.1 +3.7.0 is the

Re: [PR] 37: Add download section for the latest 3.7 release [kafka-site]

2024-02-20 Thread via GitHub
stanislavkozlovski commented on PR #583: URL: https://github.com/apache/kafka-site/pull/583#issuecomment-1954264735 so far these links don't exist and i haven't verified any of them, since the release is not done. Not sure what the actual process is - whether we: 1) pre-approve,

Re: [PR] 37: Add download section for the latest 3.7 release [kafka-site]

2024-02-20 Thread via GitHub
stanislavkozlovski commented on code in PR #583: URL: https://github.com/apache/kafka-site/pull/583#discussion_r1495863565 ## downloads.html: ## @@ -6,12 +6,45 @@ Download -3.6.1 is the latest release. The current stable version is 3.6.1 +3.7.0 is the

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

2024-02-20 Thread via GitHub
divijvaidya commented on code in PR #578: URL: https://github.com/apache/kafka-site/pull/578#discussion_r1495858647 ## blog.html: ## @@ -22,6 +22,125 @@ Blog + + + +Apache

[PR] 37: Update default docs to point to the 3.7.0 release docs [kafka-site]

2024-02-20 Thread via GitHub
stanislavkozlovski opened a new pull request, #582: URL: https://github.com/apache/kafka-site/pull/582 This patch updates the default documentation links to link to the 3.7 documentation -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

2024-02-20 Thread via GitHub
stanislavkozlovski commented on code in PR #578: URL: https://github.com/apache/kafka-site/pull/578#discussion_r1495828306 ## blog.html: ## @@ -22,6 +22,125 @@ Blog + + + +

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

2024-02-20 Thread via GitHub
stanislavkozlovski commented on code in PR #578: URL: https://github.com/apache/kafka-site/pull/578#discussion_r1495827960 ## blog.html: ## @@ -22,6 +22,125 @@ Blog + + + +

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

2024-02-20 Thread via GitHub
stanislavkozlovski commented on code in PR #578: URL: https://github.com/apache/kafka-site/pull/578#discussion_r1495824410 ## blog.html: ## @@ -22,6 +22,125 @@ Blog + + + +

Re: [PR] MINOR: Update stale `upgrade_3_6_0` header links in documentation [kafka-site]

2024-02-20 Thread via GitHub
mimaison commented on code in PR #580: URL: https://github.com/apache/kafka-site/pull/580#discussion_r1495809050 ## blog.html: ## @@ -55,7 +55,7 @@ 10 Oct 2023 - Satish Duggana (https://twitter.com/0xeed;>@SatishDuggana) We

Re: [PR] MINOR: Update stale `upgrade_3_6_0` header links in documentation [kafka-site]

2024-02-20 Thread via GitHub
mimaison commented on code in PR #580: URL: https://github.com/apache/kafka-site/pull/580#discussion_r1495807353 ## 37/upgrade.html: ## @@ -19,9 +19,9 @@

Re: [PR] 37: Add upgrade notes for the 3.7.0 releaase [kafka-site]

2024-02-20 Thread via GitHub
stanislavkozlovski commented on code in PR #581: URL: https://github.com/apache/kafka-site/pull/581#discussion_r1495781312 ## 37/upgrade.html: ## @@ -18,8 +18,85 @@

[jira] [Created] (KAFKA-16285) Make group metadata available when a new assignment is set in async Kafka consumer

2024-02-20 Thread Bruno Cadonna (Jira)
Bruno Cadonna created KAFKA-16285: - Summary: Make group metadata available when a new assignment is set in async Kafka consumer Key: KAFKA-16285 URL: https://issues.apache.org/jira/browse/KAFKA-16285

[jira] [Created] (KAFKA-16284) Performance regression in RocksDB

2024-02-20 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-16284: -- Summary: Performance regression in RocksDB Key: KAFKA-16284 URL: https://issues.apache.org/jira/browse/KAFKA-16284 Project: Kafka Issue Type: Task

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

2024-02-20 Thread via GitHub
stanislavkozlovski commented on code in PR #578: URL: https://github.com/apache/kafka-site/pull/578#discussion_r1495737109 ## blog.html: ## @@ -22,6 +22,125 @@ Blog + + + +

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

2024-02-20 Thread via GitHub
stanislavkozlovski commented on code in PR #578: URL: https://github.com/apache/kafka-site/pull/578#discussion_r1495733083 ## blog.html: ## @@ -22,6 +22,125 @@ Blog + + + +

Re: [PR] MINOR: Update stale `upgrade_3_6_0` header links in documentation [kafka-site]

2024-02-20 Thread via GitHub
stanislavkozlovski commented on code in PR #580: URL: https://github.com/apache/kafka-site/pull/580#discussion_r1495732697 ## 37/upgrade.html: ## @@ -19,9 +19,9 @@

[PR] MINOR: Update stale `upgrade_3_6_0` header links in documentation [kafka-site]

2024-02-20 Thread via GitHub
stanislavkozlovski opened a new pull request, #580: URL: https://github.com/apache/kafka-site/pull/580 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

2024-02-20 Thread via GitHub
stanislavkozlovski commented on code in PR #578: URL: https://github.com/apache/kafka-site/pull/578#discussion_r1495710631 ## blog.html: ## @@ -22,6 +22,125 @@ Blog + + + +

Re: [DISCUSS] KIP-932: Queues for Kafka

2024-02-20 Thread Andrew Schofield
Hi Jun, Thanks for your comments. A couple of your questions I will leave unanswered for now because there is some research needed. 10. This area needs more work. Using a share group surely gets the broker to do more manipulation of the data that it fetches than a regular consumer. I want to

[jira] [Created] (KAFKA-16283) RoundRobinPartitioner will only send to half of the partitions in a topic

2024-02-20 Thread Luke Chen (Jira)
Luke Chen created KAFKA-16283: - Summary: RoundRobinPartitioner will only send to half of the partitions in a topic Key: KAFKA-16283 URL: https://issues.apache.org/jira/browse/KAFKA-16283 Project: Kafka

Re: [VOTE] KIP-1019: Expose method to determine Metric Measurability

2024-02-20 Thread Manikumar
+1 (binding). Thanks for the KIP. Manikumar On Tue, Feb 20, 2024 at 2:31 PM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Hi Apoorv, > Thanks for the KIP. > > +1 (non-binding) > > Thanks, > Andrew > > > On 19 Feb 2024, at 22:31, Apoorv Mittal > wrote: > > > > Hi, > > I’d like

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

2024-02-20 Thread via GitHub
stanislavkozlovski commented on code in PR #578: URL: https://github.com/apache/kafka-site/pull/578#discussion_r1495481232 ## blog.html: ## @@ -22,6 +22,125 @@ Blog + + + +

Community Over Code Asia 2024 Travel Assistance Applications now open!

2024-02-20 Thread Gavin McDonald
Hello to all users, contributors and Committers! The Travel Assistance Committee (TAC) are pleased to announce that travel assistance applications for Community over Code Asia 2024 are now open! We will be supporting Community over Code Asia, Hangzhou, China July 26th - 28th, 2024. TAC exists

[jira] [Created] (KAFKA-16282) Allow to get last stable offset (LSO) in kafka-get-offsets.sh

2024-02-20 Thread Luke Chen (Jira)
Luke Chen created KAFKA-16282: - Summary: Allow to get last stable offset (LSO) in kafka-get-offsets.sh Key: KAFKA-16282 URL: https://issues.apache.org/jira/browse/KAFKA-16282 Project: Kafka

Re: [VOTE] KIP-1019: Expose method to determine Metric Measurability

2024-02-20 Thread Andrew Schofield
Hi Apoorv, Thanks for the KIP. +1 (non-binding) Thanks, Andrew > On 19 Feb 2024, at 22:31, Apoorv Mittal wrote: > > Hi, > I’d like to start the voting for KIP-1019: Expose method to determine > Metric Measurability. > >

[REVIEW REQUEST] Tests of ConsoleGroupCommand moved to tools

2024-02-20 Thread Николай Ижиков
Hello. I’m working on moving `ConsoleGroupCommand` to `tools`. There are two PR’s that moves all tests of ConsoleGroupCommand to tools. Please, take a look. [1] https://github.com/apache/kafka/pull/15365 [2] https://github.com/apache/kafka/pull/15363 BIG PR here -

[jira] [Created] (KAFKA-16281) Probable IllegalState possible with KIP-966

2024-02-20 Thread Jack Vanlightly (Jira)
Jack Vanlightly created KAFKA-16281: --- Summary: Probable IllegalState possible with KIP-966 Key: KAFKA-16281 URL: https://issues.apache.org/jira/browse/KAFKA-16281 Project: Kafka Issue