Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2564

2024-01-11 Thread Apache Jenkins Server
See Changes: -- [...truncated 462326 lines...] Gradle Test Run :core:test > Gradle Test Executor 92 > ZooKeeperClientTest > testPipelinedGetData() PASSED Gradle Test Run

Re: DISCUSS KIP-1011: Use incrementalAlterConfigs when updating broker configs by kafka-configs.sh

2024-01-11 Thread ziming deng
Thank you for your clarification, Chris, I have spent some time to review KIP-894 and I think it's automatic way is better and bring no side effect, and I will also adopt this way here. As you mentioned, the changes in semantics is minor, the most important reason for this change is fixing bug

Re: [DISCUSS] KIP-1005: Add EarliestLocalOffset to GetOffsetShell

2024-01-11 Thread Luke Chen
Hi Christo, Thanks for the KIP! One question: What will the offset return if tiered storage is disabled? For "-4 or earliest-local", it should be the same as "-2 or earliest", right? For "-5 or latest-tiered", it will be...0? I think the result should be written in the KIP (or script help text)

[jira] [Resolved] (KAFKA-15760) org.apache.kafka.trogdor.coordinator.CoordinatorTest.testTaskRequestWithOldStartMsGetsUpdated is flaky

2024-01-11 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-15760. - Fix Version/s: 3.8.0 Assignee: David Mao Resolution: Fixed >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2563

2024-01-11 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-1005: Expose EarliestLocalOffset and TieredOffset

2024-01-11 Thread Boudjelda Mohamed Said
+1 (binding) On Fri, Jan 12, 2024 at 1:21 AM Satish Duggana wrote: > +1 (binding) > > Thanks, > Satish. > > On Thu, 11 Jan 2024 at 17:52, Divij Vaidya > wrote: > > > > +1 (binding) > > > > Divij Vaidya > > > > > > > > On Tue, Dec 26, 2023 at 7:05 AM Kamal Chandraprakash < > >

Re: [VOTE] KIP-1005: Expose EarliestLocalOffset and TieredOffset

2024-01-11 Thread Satish Duggana
+1 (binding) Thanks, Satish. On Thu, 11 Jan 2024 at 17:52, Divij Vaidya wrote: > > +1 (binding) > > Divij Vaidya > > > > On Tue, Dec 26, 2023 at 7:05 AM Kamal Chandraprakash < > kamal.chandraprak...@gmail.com> wrote: > > > +1 (non-binding). Thanks for the KIP! > > > > -- > > Kamal > > > > On

[jira] [Created] (KAFKA-16117) Add Integration test for checking if the correct assignor is chosen

2024-01-11 Thread Ritika Reddy (Jira)
Ritika Reddy created KAFKA-16117: Summary: Add Integration test for checking if the correct assignor is chosen Key: KAFKA-16117 URL: https://issues.apache.org/jira/browse/KAFKA-16117 Project: Kafka

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #59

2024-01-11 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-1014: Managing Unstable Metadata Versions in Apache Kafka

2024-01-11 Thread Artem Livshits
Hi Proven, I'd say that we should do 2 & 2. The idea is that for small features that can be done and stabilized within a short period of time (with one or very few commits) that's exactly what happens -- people interested in testing in-progress feature could take unstable code from a patch (or

[jira] [Created] (KAFKA-16116) AsyncKafkaConsumer: Add missing rebalance metrics

2024-01-11 Thread Philip Nee (Jira)
Philip Nee created KAFKA-16116: -- Summary: AsyncKafkaConsumer: Add missing rebalance metrics Key: KAFKA-16116 URL: https://issues.apache.org/jira/browse/KAFKA-16116 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-16115) AsyncKafkaConsumer: Add missing heartbeat metrics

2024-01-11 Thread Philip Nee (Jira)
Philip Nee created KAFKA-16115: -- Summary: AsyncKafkaConsumer: Add missing heartbeat metrics Key: KAFKA-16115 URL: https://issues.apache.org/jira/browse/KAFKA-16115 Project: Kafka Issue Type:

Re: [PROPOSAL] Add commercial support page on website

2024-01-11 Thread Francois Papon
Hi Justine, You're right, Kafka is a part of my business (training, consulting, architecture design, sla...) and most of the time, users/customers said that it was hard for them to find a commercial support (in France for my case) after searching on the Kafka website (Google didn't help

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2562

2024-01-11 Thread Apache Jenkins Server
See

Re: [PROPOSAL] Add commercial support page on website

2024-01-11 Thread fpapon
Hi Chris, I never said that the Apache Kafka community "has to" provide this kind of page and it's not an official policy of the ASF. I just listed other projects to show that this is something that already exist so this is potentially something that could be good for the community of an

Re: [PROPOSAL] Add commercial support page on website

2024-01-11 Thread Justine Olshan
Hey François, My point was that the companies on that page use kafka as part of their business. If you use Kafka as part of your business feel free to submit a PR to be added. I second Chris's point that other projects are not enough to require Kafka having such a support page. Justine On Thu,

Re: [PROPOSAL] Add commercial support page on website

2024-01-11 Thread Chris Egerton
Hi François, Is it an official policy of the ASF that projects provide a listing of commercial support options for themselves? I understand that other projects have chosen to provide one, but this doesn't necessarily imply that all projects should do the same, and I can't say I find this point

Re: [PROPOSAL] Add commercial support page on website

2024-01-11 Thread fpapon
Hi Justine, I'm not sure to see the difference between "happy users" and vendors that advertise their products in some of the company list in the "powered by" page. Btw, my initial purpose of my proposal was to help user to find support for production stuff rather than searching in google.

Re: [VOTE] KIP-1004: Enforce tasks.max property in Kafka Connect

2024-01-11 Thread Chris Egerton
Hi all, The vote for KIP-1004 passes with the following +1 votes and no +0 or -1 votes: - Hector Geraldino - Mickael Maison (binding) - Greg Harris (binding) - Yash Mayya (binding) - Federico Valeri With regards to the open discussion about whether to remove the deprecated tasks.max.enforce

Re: [PROPOSAL] Add commercial support page on website

2024-01-11 Thread Justine Olshan
I think there is a difference between the "Powered by" page and a page for vendors to advertise their products and services. The idea is that the companies on that page are "powered by" Kafka. They serve as examples of happy users of Kafka. I don't think it is meant only as a place just for those

[VOTE] 3.7.0 RC2

2024-01-11 Thread Stanislav Kozlovski
Hello Kafka users, developers, and client-developers, This is the first candidate for release of Apache Kafka 3.7.0. Note it's named "RC2" because I had a few "failed" RCs that I had cut/uploaded but ultimately had to scrap prior to announcing due to new blockers arriving before I could even

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

2024-01-11 Thread via GitHub
stanislavkozlovski commented on code in PR #578: URL: https://github.com/apache/kafka-site/pull/578#discussion_r1449250008 ## blog.html: ## @@ -22,6 +22,119 @@ Blog + + + +

Re: [DISCUSS] KIP-1014: Managing Unstable Metadata Versions in Apache Kafka

2024-01-11 Thread Proven Provenzano
We have two approaches here for how we update unstable metadata versions. 1. The update will only increase MVs of unstable features to a value greater than the new stable feature. The idea is that a specific unstable MV may support some set of features and in the future that set is

Re: [VOTE] KIP-994: Minor Enhancements to ListTransactions and DescribeTransactions APIs

2024-01-11 Thread Jason Gustafson
HI Raman, Thanks for the KIP! +1 from me. One small thing: we will probably have to overload the constructor for TransactionDescription in order to add the new update time field to avoid breaking the API. We might consider whether we need the overload to be public or not. Best, Jason On Tue,

Re: KIP-991: Allow DropHeaders SMT to drop headers by wildcard/regexp

2024-01-11 Thread Mickael Maison
Hi Roman, Thanks for the updates, this looks much better. Just a couple of small comments: - The type of the field is listed as "boolean". I think it should be string (or list) - Should the field be named "headers.patterns" instead of "headers.pattern" since it accepts a list of patterns?

Re: [PROPOSAL] Add commercial support page on website

2024-01-11 Thread fpapon
Hi, About the vendors list and neutrality, what is the policy of the "Powered by" page? https://kafka.apache.org/powered-by We can see company with logo, some are talking about their product (Agoora), some are offering services (Instaclustr, Aiven), and we can also see some that just put

Logging in Kafka

2024-01-11 Thread Clayton Wohl
If Kafka 4.0 is Java 11+, why would you use SLF4J instead of the Java 9+ logging facade System.Logger?

Re: [DISCUSS] KIP-1014: Managing Unstable Metadata Versions in Apache Kafka

2024-01-11 Thread Proven Provenzano
Hi Federico, Thank you for the suggestions. I've added them to the KIP. --Proven On Wed, Jan 10, 2024 at 4:16 AM Federico Valeri wrote: > Hi folks, > > > If you use an unstable MV, you probably won't be able to upgrade your > software. Because whenever something changes, you'll probably get >

Re: Kafka 3.0 support Java 8

2024-01-11 Thread Devinder Saggu
Hi, So, it means version 3.x will be supported maximum until this year 2024. Thanks On Wed, Jan 10, 2024 at 3:59 PM Josep Prat wrote: > Hi, > We attempt to support the last 3 non-patch versions. This would mean we > would try to Backport security vulnerabilities to a 3.x (probably 3.8) for >

Re: requesting permissions to contribute to Apache Kafka

2024-01-11 Thread Mickael Maison
Hi, I've granted you permissions in both Jira and the wiki. Thanks, Mickael On Thu, Jan 11, 2024 at 2:40 PM Szymon Scharmach wrote: > > Hi, > > based on: > https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals >

requesting permissions to contribute to Apache Kafka

2024-01-11 Thread Szymon Scharmach
Hi, based on: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals I'd like to request permission to contribute to Apache Kafka. wiki ID: theszym jira ID: theszym Szymon Scharmach

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #58

2024-01-11 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-1005: Expose EarliestLocalOffset and TieredOffset

2024-01-11 Thread Divij Vaidya
+1 (binding) Divij Vaidya On Tue, Dec 26, 2023 at 7:05 AM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > +1 (non-binding). Thanks for the KIP! > > -- > Kamal > > On Thu, Dec 21, 2023 at 2:23 PM Christo Lolov > wrote: > > > Heya all! > > > > KIP-1005 ( > > > > >

Re: Apache Kafka 3.7.0 Release

2024-01-11 Thread Luke Chen
Hi all, There is a bug KAFKA-16101 reporting that "Kafka cluster will be unavailable during KRaft migration rollback". The impact for this issue is that if brokers try to rollback to ZK mode during KRaft migration process, there will be a period

Re: KIP-991: Allow DropHeaders SMT to drop headers by wildcard/regexp

2024-01-11 Thread Roman Schmitz
Hi Mickael, Hi all, Thanks for the feedback! I have adapted the KIP description - actually much shorter and just reflecting the general functionality and interface/configuration changes. Kindly let me know if you have any comments, questions, or suggestions for this KIP! Thanks, Roman Am Fr.,

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

2024-01-11 Thread via GitHub
mimaison commented on code in PR #578: URL: https://github.com/apache/kafka-site/pull/578#discussion_r1448691656 ## blog.html: ## @@ -22,6 +22,119 @@ Blog + + + +Apache Kafka

Re: [PR] 3.7: Add blog post for Kafka 3.7 [kafka-site]

2024-01-11 Thread via GitHub
mimaison commented on code in PR #578: URL: https://github.com/apache/kafka-site/pull/578#discussion_r1448678795 ## blog.html: ## @@ -22,6 +22,119 @@ Blog + + + +Apache Kafka

Re: [DISCUSS] KIP-1005: Add EarliestLocalOffset to GetOffsetShell

2024-01-11 Thread Divij Vaidya
Thank you for making the change Christo. It looks good to me. -- Divij Vaidya On Thu, Jan 11, 2024 at 11:19 AM Christo Lolov wrote: > Thank you Divij! > > I have updated the KIP to explicitly state that the broker will have a > different behaviour when a timestamp of -5 is requested as part

Re: [VOTE] KIP-995: Allow users to specify initial offsets while creating connectors

2024-01-11 Thread Mickael Maison
Hi Ashwin, +1 (binding), thanks for the KIP Mickael On Tue, Jan 9, 2024 at 4:54 PM Chris Egerton wrote: > > Thanks for the KIP! +1 (binding) > > On Mon, Jan 8, 2024 at 9:35 AM Ashwin wrote: > > > Hi All, > > > > I would like to start a vote on KIP-995. > > > > > >

Re: [DISCUSS] KIP-1005: Add EarliestLocalOffset to GetOffsetShell

2024-01-11 Thread Christo Lolov
Thank you Divij! I have updated the KIP to explicitly state that the broker will have a different behaviour when a timestamp of -5 is requested as part of ListOffsets. Best, Christo On Tue, 2 Jan 2024 at 11:10, Divij Vaidya wrote: > Thanks for the KIP Christo. > > The shell command that you