[jira] [Created] (KAFKA-16314) Add the new ABORTABLE_ERROR

Sanskar Jhajharia created KAFKA-16314: - Summary: Add the new ABORTABLE_ERROR Key: KAFKA-16314 URL: https://issues.apache.org/jira/browse/KAFKA-16314 Project: Kafka Issue Type: Sub-task

Re: [DISCUSS] KIP-1021: Allow to get last stable offset (LSO) in kafka-get-offsets.sh

Hi Ahmed, Thanks for the KIP! Comments: 1. If we all agree with the suggestion from Andrew, you could update the KIP. Otherwise, LGTM! Thanks. Luke On Thu, Feb 29, 2024 at 1:32 AM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Hi Ahmed, > Could do. Personally, I find the

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

Hi, Justine, Thanks for the KIP. A few comments below. 10. Currently, MV controls records, inter-broker RPCs and code logic. With more features, would each of those be controlled by a separate feature or multiple features. For example, is the new transaction record format controlled only by MV

Re: Shortened URLs for KIPs?

Hi Kirk, Interesting proposal! I gave it a shot with one of my own prior KIPs and was able to generate https://s.apache.org/kip-618 for it. It looks like uppercase characters aren't permitted for URL IDs (even though the regex listed in that text box does claim to allow them). I can't commit to

Re: Newbie need some help

Hi Chia, Welcome! One suggestion is to look at the list of open Jiras that are marked with the “newbie” label: https://issues.apache.org/jira/issues/?jql=project %3D KAFKA AND labels IN (newbie%2C "newbie%2B%2B") AND status in (Open%2C Reopened) ORDER BY created DESC

Re: Shortened URLs for KIPs?

I just found https://s.apache.org/, which is an Apache shortened URL service. That might provide the needed infrastructure, but it requires a login, so someone (a committer(?)) to create that for each KIP :( > On Feb 28, 2024, at 2:40 PM, Kirk True wrote: > > Hi all, > > Is it possible to

[jira] [Created] (KAFKA-16313) Offline group protocol upgrade

Dongnuo Lyu created KAFKA-16313: --- Summary: Offline group protocol upgrade Key: KAFKA-16313 URL: https://issues.apache.org/jira/browse/KAFKA-16313 Project: Kafka Issue Type: Sub-task

Shortened URLs for KIPs?

Hi all, Is it possible to set up shortened URLs for KIPs? So instead of, say: https://cwiki.apache.org/confluence/display/KAFKA/KIP-966%3A+Eligible+Leader+Replicas We could refer to it as: https://cwiki.apache.org/confluence/display/KAFKA/KIP-966 Or maybe even go so far as to have something

Newbie need some help

Hi, team I’m a new member just joined the community. I work in the KLA as a software engineer. We use Kafka as part of our data pipeline. I’m currently looking for some issues to work on as my first step of contributing. Any recommending task I can look into it? Please let me know. JIRA

Re: [DISCUSS] KIP-966: Eligible Leader Replicas

Andrew/Jose, I like the suggested Flow API. It's also similar to the stream observers in GPRC. I'm not sure we should expose something as complex as the Flow API directly in KafkaAdminClient, but certainly we can provide a similar interface. --- Cancellations: Another thing not yet discussed is

Re: [DISCUSS] KIP-939: Support Participation in 2PC

Hi, Artem, Thanks for the reply. I understand your concern on having a timeout breaking the 2PC guarantees. However, the fallback plan to disable 2PC with an independent keepPreparedTxn is subject to the timeout too. So, it doesn't provide the same guarantees as 2PC either. To me, if we provide

Re: [ANNOUNCE] Apache Kafka 3.7.0

Thanks Stanislav for running the release! On Wed, Feb 28, 2024 at 10:36 PM Kirk True wrote: > Thanks Stanislav > > > On Feb 27, 2024, at 10:01 AM, Stanislav Kozlovski < > stanislavkozlov...@apache.org> wrote: > > > > The Apache Kafka community is pleased to announce the release of > >

Re: [ANNOUNCE] Apache Kafka 3.7.0

Thanks Stanislav > On Feb 27, 2024, at 10:01 AM, Stanislav Kozlovski > wrote: > > The Apache Kafka community is pleased to announce the release of > Apache Kafka 3.7.0 > > This is a minor release that includes new features, fixes, and > improvements from 296 JIRAs > > An overview of the

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

Hi, Abhijeet, Thanks for the reply. The issue with recording the throttle time as a gauge is that it's transient. If the metric is not read immediately, the recorded value could be reset to 0. The admin won't realize that throttling has happened. For client quotas, the throttle time is tracked

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

Hi Justine, Thank you for the KIP. I think the KIP is pretty clear and makes sense to me. Maybe it would be good to give a little more detail on the implementation of feature mapping and how the tool would validate the feature combinations. For example, I'd expect that bin/kafka-storage.sh

Re: [DISCUSS] KIP-1022 Formatting and Updating Features

Hey Andrew, Thanks for taking a look. I previously didn't include 1. We do plan to use these features immediately for KIP-890 and KIP-848. If we think it is easier to put the discussion in those KIP discussions we can, but I fear that it will easily get lost given the size of the KIPs. I named

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2683

See

[jira] [Created] (KAFKA-16312) ConsumerRebalanceListener.onPartitionsAssigned should be called after joining, even if empty

Kirk True created KAFKA-16312: - Summary: ConsumerRebalanceListener.onPartitionsAssigned should be called after joining, even if empty Key: KAFKA-16312 URL: https://issues.apache.org/jira/browse/KAFKA-16312

[jira] [Resolved] (KAFKA-16116) AsyncKafkaConsumer: Add missing rebalance metrics

[ https://issues.apache.org/jira/browse/KAFKA-16116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Nee resolved KAFKA-16116. Resolution: Fixed > AsyncKafkaConsumer: Add missing rebalance metrics >

Re: [PR] MINOR: Use archive repository for older releases [kafka-site]

mimaison commented on PR #589: URL: https://github.com/apache/kafka-site/pull/589#issuecomment-1969205238 Good catch! I pushed an update. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [VOTE] 3.7.0 RC4

Hi, mvnrepository doesn't matter, we should update the guidelines to remove it. All that matters is that it has reached the maven central repository. Ismael On Tue, Feb 27, 2024 at 9:49 AM Stanislav Kozlovski wrote: > The thinking is that it is available for use - and it is in maven central -

Re: [PR] MINOR: Use archive repository for older releases [kafka-site]

divijvaidya commented on PR #589: URL: https://github.com/apache/kafka-site/pull/589#issuecomment-1969186600 We need a similar change in blog as well please (e.g. https://github.com/apache/kafka-site/blob/7ae222e3a5a80252063f7bd068cada382b39812b/blog.html#L317) otherwise we will have

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

Hi Jun, Clarified the meaning of the two metrics. Also updated the KIP. kafka.log.remote:type=RemoteLogManager, name=RemoteFetchThrottleTime -> The duration of time required at a given moment to bring the observed fetch rate within the allowed limit, by preventing further reads.

Re: [DISCUSS] KIP-939: Support Participation in 2PC

Hi Artem, I totally agree that a timeout for the 2PC case is a bad idea. It does abandon the 2PC guarantee. Thanks, Andrew > On 28 Feb 2024, at 00:44, Artem Livshits > wrote: > > Hi Jun, > > Thank you for the discussion. > >> For 3b, it would be useful to understand the reason why an admin

Re: [DISCUSS] KIP-1021: Allow to get last stable offset (LSO) in kafka-get-offsets.sh

Hi Ahmed, Could do. Personally, I find the existing “--time -1” totally horrid anyway, which was why I suggested an alternative. I think your suggestion of a flag for isolation level is much better than -6. Maybe I should put in a KIP which adds: --latest (as a synonym for --time -1) --earliest

Re: [PR] MINOR: Use archive repository for older releases [kafka-site]

mimaison commented on code in PR #589: URL: https://github.com/apache/kafka-site/pull/589#discussion_r1506070292 ## downloads.html: ## @@ -109,16 +109,16 @@ 3.5.2 -https://downloads.apache.org/kafka/3.5.2/RELEASE_NOTES.html;>Release Notes +

Re: Assistance Needed with MM2 Heartbeat Topic Configuration

Hello, Thank you very much for your suggestions and assistance. I have tried your second method and successfully used `producer.override.bootstrap.servers` as the key, achieving the desired effect. I appreciate your warm response and valuable time. Thanks again! Best regards, On Tue, Feb 27,

[jira] [Resolved] (KAFKA-16311) [Debezium Informix Connector Unable to Commit Processed Log Position]

[ https://issues.apache.org/jira/browse/KAFKA-16311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hector Geraldino resolved KAFKA-16311. -- Resolution: Invalid Please try reporting this to

Re: [PR] MINOR: Use archive repository for older releases [kafka-site]

mimaison commented on code in PR #589: URL: https://github.com/apache/kafka-site/pull/589#discussion_r1506019540 ## downloads.html: ## @@ -109,16 +109,16 @@ 3.5.2 -https://downloads.apache.org/kafka/3.5.2/RELEASE_NOTES.html;>Release Notes +

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2682

See

Re: [PR] MINOR: Use archive repository for older releases [kafka-site]

divijvaidya commented on code in PR #589: URL: https://github.com/apache/kafka-site/pull/589#discussion_r1505961253 ## downloads.html: ## @@ -109,16 +109,16 @@ 3.5.2 -https://downloads.apache.org/kafka/3.5.2/RELEASE_NOTES.html;>Release Notes +

Re: [DISCUSS] KIP-853: KRaft Controller Membership Changes

> 2. After "RemoveVoter", what is the role of the node? > It looks like after the voter got removed from the voter set, it is not a > voter anymore. But I think it can still fetch with the leader. So it should > be an observer, with a "process.role=controller"? And if the node was > originally

Re: [PR] MINOR: Use archive repository for older releases [kafka-site]

mimaison commented on code in PR #589: URL: https://github.com/apache/kafka-site/pull/589#discussion_r1505877761 ## downloads.html: ## @@ -109,16 +109,16 @@ 3.5.2 -https://downloads.apache.org/kafka/3.5.2/RELEASE_NOTES.html;>Release Notes +

Re: [PR] MINOR: Use archive repository for older releases [kafka-site]

divijvaidya commented on code in PR #589: URL: https://github.com/apache/kafka-site/pull/589#discussion_r1505808343 ## downloads.html: ## @@ -109,16 +109,16 @@ 3.5.2 -https://downloads.apache.org/kafka/3.5.2/RELEASE_NOTES.html;>Release Notes +

Re: [PR] MINOR: Use archive repository for older releases [kafka-site]

divijvaidya commented on code in PR #589: URL: https://github.com/apache/kafka-site/pull/589#discussion_r1505808343 ## downloads.html: ## @@ -109,16 +109,16 @@ 3.5.2 -https://downloads.apache.org/kafka/3.5.2/RELEASE_NOTES.html;>Release Notes +

Re: [kafka-clients] Re: [ANNOUNCE] Apache Kafka 3.7.0

Thanks Stansilav for running the release. That must be exhausting but you executed it well. Regards, Apoorv Mittal +44 7721681581 On Wed, Feb 28, 2024 at 11:22 AM Divij Vaidya wrote: > Thank you Stanislav for running the release, especially fixing the whole > mess with out of sync site docs

Re: [kafka-clients] Re: [ANNOUNCE] Apache Kafka 3.7.0

Thank you Stanislav for running the release, especially fixing the whole mess with out of sync site docs in different branches. Really appreciate your hard work on this one. Thank you all contributors! Your contributions is what makes Apache Kafka community awesome <3 There are many impactful

Re: [kafka-clients] Re: [ANNOUNCE] Apache Kafka 3.7.0

Thanks Stanislav for running the release! On Wed, Feb 28, 2024 at 2:36 PM Satish Duggana wrote: > Thanks Stanislav for all your hard work on running the release. Thanks > to all the contributors to this release. > > > On Wed, 28 Feb 2024 at 13:43, Bruno Cadonna wrote: > > > > Thanks Stan and

[jira] [Created] (KAFKA-16311) [Debezium Informix Connector Unable to Commit Processed Log Position]

Maaheen Yasin created KAFKA-16311: - Summary: [Debezium Informix Connector Unable to Commit Processed Log Position] Key: KAFKA-16311 URL: https://issues.apache.org/jira/browse/KAFKA-16311 Project:

[jira] [Created] (KAFKA-16310) ListOffsets doesn't report the offset with maxTimestamp anymore

Emanuele Sabellico created KAFKA-16310: -- Summary: ListOffsets doesn't report the offset with maxTimestamp anymore Key: KAFKA-16310 URL: https://issues.apache.org/jira/browse/KAFKA-16310 Project:

[PR] MINOR: Use archive repository for older releases [kafka-site]

mimaison opened a new pull request, #589: URL: https://github.com/apache/kafka-site/pull/589 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [DISCUSS] KIP-1021: Allow to get last stable offset (LSO) in kafka-get-offsets.sh

Hi Andrew, Thanks for the hint! That sounds reasonable, do you think adding a conditional argument, something like "--time -1 --isolation -committed" and "--time -1 --isolation -uncommitted" would make sense to keep the consistency of getting the offset by time? or do you think having a special

Re: [DISCUSS] Apache Kafka 3.8.0 release

Thanks Josep, +1. On Tue, 27 Feb 2024 at 17:29, Divij Vaidya wrote: > > Thank you for volunteering Josep. +1 from me. > > -- > Divij Vaidya > > > > On Tue, Feb 27, 2024 at 9:35 AM Bruno Cadonna wrote: > > > Thanks Josep! > > > > +1 > > > > Best, > > Bruno > > > > On 2/26/24 9:53 PM, Chris

Re: [kafka-clients] Re: [ANNOUNCE] Apache Kafka 3.7.0

Thanks Stanislav for all your hard work on running the release. Thanks to all the contributors to this release. On Wed, 28 Feb 2024 at 13:43, Bruno Cadonna wrote: > > Thanks Stan and all contributors for the release! > > Best, > Bruno > > On 2/27/24 7:01 PM, Stanislav Kozlovski wrote: > > The

Re: [ANNOUNCE] Apache Kafka 3.7.0

Thanks Stan and all contributors for the release! Best, Bruno On 2/27/24 7:01 PM, Stanislav Kozlovski wrote: The Apache Kafka community is pleased to announce the release of Apache Kafka 3.7.0 This is a minor release that includes new features, fixes, and improvements from 296 JIRAs An