Re: [ANNOUNCE] New Kafka PMC Member: Bruno Cadonna

Thank you all! I am really honoured to have become a PMC member. Looking forward to contributing further to Apache Kafka. Best, Bruno On 02.11.22 17:02, Levani Kokhreidze wrote: Congrats Bruno, well deserved! On Wed, 2 Nov 2022, 11:11 Jorge Esteban Quilcate Otoya, <

Re: Kafka Stream Metrics (3.3 / KAFKA-13945) and Documentation

Hi Neil, I think you are right that the type is wrong. Thank you for spotting the mistake! Since there is a MBean name column, I do not think we need to introduce a new section. We just need to change "type=stream-processor-node-metrics" to "type=stream-topic-metrics" for metrics

Re: [ANNOUNCE] New Kafka PMC Member: Chris Egerton

Congrats, Chris! Bruno On 10.03.23 18:47, Guozhang Wang wrote: Congrats Chris! On Fri, Mar 10, 2023 at 8:41 AM Jeremy Custenborder wrote: Congrats buddy! On Fri, Mar 10, 2023 at 9:28 AM Randall Hauch wrote: Congratulations, Chris! Randall On Fri, Mar 10, 2023 at 9:07 AM David Arthur

Re: [VOTE] KIP-914 Join Processor Semantics for Versioned Stores

+1 (binding) Thanks Victoria! Best, Bruno On 20.03.23 17:13, Matthias J. Sax wrote: +1 (binding) On 3/20/23 9:05 AM, Guozhang Wang wrote: +1, thank you Victoria! On Sat, Mar 18, 2023 at 8:27 AM Victoria Xia wrote: Hi all, I'd like to start a vote on KIP-914 for updating the Kafka

Re: Creating a JIRA account

Hi Przemek, Thank you for your interest in Apache Kafka! In the Apache JIRA, there is a link to Apache's JIRA guidelines at the top of the page. This link will bring you to https://infra.apache.org/jira-guidelines.html#who There it says: If you need to open a Jira ticket for a particular

Re: Please help to create an JIRA account for me, thanks

Hi, I created a Jira account with user name naosense for you. You should get an e-mail with which you can set your password. Thanks for your interest in Apache Kafka! Best, Bruno On 01.03.23 11:41, naosense wrote: email: pingao...@gmail.com preferred username: naosense alternate username:

Re: Apache Kafka 3.6.0 release

Thanks Satish! +1 Best, Bruno On 16.04.23 20:02, Ismael Juma wrote: Thanks for volunteering Satish. +1. Ismael On Sun, Apr 16, 2023 at 10:08 AM Satish Duggana wrote: Hi, I would like to volunteer as release manager for the next release, which will be Apache Kafka 3.6.0. If there are no

Re: [ANNOUNCE] New PMC chair: Mickael Maison

Hi, Jun, Thanks a lot for all you have done for the project! Congrats Mickael and thank you for taking over the PMC chair! Best, Bruno On 21.04.23 17:09, Jun Rao wrote: Hi, everyone, After more than 10 years, I am stepping down as the PMC chair of Apache Kafka. We now have a new chair

Re: [DISCUSS] Apache Kafka 3.4.1 release

Thanks a lot, Luke! +1 Best, Bruno On 26.04.23 16:11, Bill Bejeck wrote: Thanks for volunteering! +1 On Wed, Apr 26, 2023 at 8:33 AM Mickael Maison wrote: Thanks Luke +1 On Wed, Apr 26, 2023 at 2:12 PM Chia-Ping Tsai wrote: +1 to Luke! David Jacot 於 2023年4月26日 下午6:44 寫道： +1

Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

Hi Nick, Thanks for the updates! I have a couple of questions/comments. 1. Why do you propose a configuration that involves max. bytes and max. reords? I think we are mainly concerned about memory consumption because we want to limit the off-heap memory used. I cannot think of a case where

Re: [DISCUSS] Apache Kafka 3.5.0 release

Thanks, Mickael! Best, Bruno On 09.02.23 03:15, Luke Chen wrote: Hi Mickael, Thanks for volunteering! Luke On Thu, Feb 9, 2023 at 6:23 AM Chris Egerton wrote: Thanks for volunteering, Mickael! On Wed, Feb 8, 2023 at 1:12 PM José Armando García Sancio wrote: Thanks for volunteering

Re: Can't creare a Jira

address. Please wait to be processed (see attached) On the first try, it must be another developer with the same name as me holding that username, but I am not entirely sure. How can I get the request accepted? Assane -Original Message- From: Bruno Cadonna Sent: Sunday, June 11,

Re: [kafka-clients] [ANNOUNCE] Apache Kafka 3.5.0

Mickael, Thanks for driving the release! Best, Bruno On 15.06.23 10:27, Mickael Maison wrote: The Apache Kafka community is pleased to announce the release for Apache Kafka 3.5.0. This is a minor release and it includes fixes and improvements from 201 JIRAs. All of the changes in this

Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

d expect that, behaviourally, it should make no difference. The branch is available at https://github.com/nicktelford/kafka/tree/KIP-892-c if anyone is interested in taking an early look. Regards, Nick On Thu, 22 Jun 2023 at 11:59, Bruno Cadonna wrote: Hi Nick, 1. Yeah, I agree with you.

Re: [DISCUSS] KIP-948: Allow custom prefix for internal topic names in Kafka Streams

Hi Igor, Thanks for the KIP! 1. Could you please elaborate why prefixing the application.id with the team's topic namespace is not always desirable. I would like to better understand the motivation of this KIP. 2. Could you please add type and default value for the proposed config

Re: Application for permission grants for contribution

Hi Abhinav, You should be all set now. Thanks for your interest in Apache Kafka! Best, Bruno On 7/14/23 9:04 AM, abhinav tripathi wrote: Hi Team, I would like to contribute to the Kafka community. I want to work on open issues and also have some ideas of my own. Requesting access and grants

Re: Requesting permissions to contribute to Apache Kafka

Hi Mital, You should be all set now. Thanks for your interest in Apache Kafka! Best, Bruno On 7/14/23 3:04 PM, Mital Awachat wrote: Hi Team, I am requesting permission to contribute to Apache Kafka. Wiki: Username: mital.awachat Email: mital.awacha...@gmail.com Jira: Username:

Re: Request permission to contribute

Hi Igor, You should be all set, now. Thank you for your interest in Apache Kafka! Best, Bruno On 7/18/23 1:53 PM, Igor Fomenko wrote: Hello, I would like to get permission to contribute to the Apache Kafka project. Specifically I would like to create KIP for Kafka Streams and to work on the

Re: [ANNOUNCE] New committer: Greg Harris

Congratulations Greg! Best, Bruno On 10.07.23 17:47, Matthias J. Sax wrote: Congrats! On 7/10/23 8:45 AM, Chris Egerton wrote: Hi all, The PMC for Apache Kafka has invited Greg Harris to become a committer, and we are happy to announce that he has accepted! Greg has been contributing to

Re: [DISCUSS] KIP-925: rack aware task assignment in Kafka Streams

Hi Hao, Thank you for the KIP! Really interesting! In general, I think the KIP is a bit too vague. You explain the main algorithm and different options. It is not clear to me on what option we will start voting. One way out of this situation would be to cut the KIP down to the simplest

Re: [DISCUSS] KIP-923: Add A Grace Period to Stream Table Join

ults, but increasing the table history retention should help that. 4) I can add some on the kip. But its pretty directly adding whatever the grace period is to the latency. I don't see a way around it. Walker On Thu, Jun 1, 2023 at 5:23 AM Bruno Cadonna wrote: Hi Walker, thanks for the KIP! Her

Re: [DISCUSS] Conventional commits

Hi Ismael, Thanks for bringing this up! In general, I am in favor of more structured commits. Even better if the conventional commits specification favors to split commits into smaller commits by concern as described in the FAQs. Additionally to Josep's questions, I have the following

Re: Requesting permissions to contribute/create KIPs for apache Kafka

Hi Arunav, You should be all setup now! Thank you for your interest in Apache Kafka! Best, Bruno On 02.06.23 23:30, Arunav Sanyal wrote: Wiki ID: arunav.sanyal91 JIRA ID: arunav.sanyal91

Re: [VOTE] KIP-925: rack aware task assignment in Kafka Streams

Hi Hao, +1 (binding) Thanks! Bruno On 30.05.23 21:16, Colt McNealy wrote: +1 (non-binding) Thank you Hao! Colt McNealy *Founder, LittleHorse.dev* On Tue, May 30, 2023 at 9:50 AM Hao Li wrote: Hi all, I'd like to open the vote for KIP-925: rack aware task assignment in Kafka Streams.

Re: [DISCUSS] KIP-923: Add A Grace Period to Stream Table Join

, yes, updated. 5. No there is no difference right now, everything gets processed as it comes in and tries to find a record for its time stamp. Walker On Fri, Jun 2, 2023 at 6:41 AM Bruno Cadonna wrote: Hi Walker, Thanks for the updates! 2. It is still not clear to me how a failure

Re: [VOTE] KIP-923: Add A Grace Period to Stream Table Join

Hi Walker, Thank you for the KIP! +1 (binding) Best, Bruno On 24.05.23 23:00, Walker Carlson wrote: Hello everybody, I'm opening the vote on KIP-923 here . If we have more to discus please continue the discussion on the existing thread

Re: [ANNOUNCE] Apache Kafka 3.4.1

Thanks Luke! On 07.06.23 07:55, Federico Valeri wrote: Thanks Luke! On Wed, Jun 7, 2023 at 5:56 AM Kamal Chandraprakash wrote: Thanks Luke for running this release! On Wed, Jun 7, 2023 at 8:08 AM Chia-Ping Tsai wrote: Thank Luke for this hard work!!! Chris Egerton 於 2023年6月7日 上午10:35

Re: [DISCUSS] KIP-923: Add A Grace Period to Stream Table Join

ed because the buffer contains records from the stream-side of the join, for which multiple records with the same key should be treated as separate updates will all must be tracked in the buffer, rather than updates which replace each other. Thanks, Victoria On Mon, Jun 5, 2023 at 1:47 AM Bru

Re: Can't creare a Jira

Hi Assane, I am sorry to hear that you are blocked! Did you submit a request through https://selfserve.apache.org/jira-account.html ? If yes, did you select Kafka as the ASF project? Where do you see that your request is pending? Best, Bruno On 09.06.23 20:12, Diop, Assane wrote: I am

Re: [DISCUSS] KIP-925: rack aware task assignment in Kafka Streams

Hi Hao, Thanks for the updates! What do you think about dropping config rack.aware.assignment.enabled and add value NONE to the enum for the possible values of config rack.aware.assignment.strategy? Best, Bruno On 31.05.23 23:31, Hao Li wrote: Hi all, I've updated the KIP based on the

Re: [DISCUSS] KIP-923: Add A Grace Period to Stream Table Join

Hi Walker, thanks for the KIP! Here my feedback: 1. It is still not clear to me when stream time for the buffer advances. What is the event that let the stream time advance? In the discussion, I do not understand what you mean by "The segment store already has an observed stream time, we

Re: [DISCUSS] KIP-923: Add A Grace Period to Stream Table Join

Hi, another idea that came to my mind. Instead of using a compacted topic, the buffer could use a non-compacted topic and regularly delete records before a given offset as Streams does for repartition topics. Best, Bruno On 05.06.23 21:48, Bruno Cadonna wrote: Hi Victoria, that is a good

Re: [ANNOUNCE] Apache Kafka 3.5.1

Thanks Divij! On 7/24/23 5:22 PM, Federico Valeri wrote: Thanks Divij :) On Mon, Jul 24, 2023 at 2:28 PM Luke Chen wrote: Thanks for running the release! Luke On Mon, Jul 24, 2023 at 6:35 PM Manyanda Chitimbo < manyanda.chiti...@gmail.com> wrote: Thanks for running the release Divij.

Re: Request permission to contribute

Hi Taras, I set you up for the Apache Kafka wiki. Let me know if you still miss permissions. Thank you for your interest in Apache Kafka! Best, Bruno On 7/25/23 9:49 AM, Taras Ledkov wrote: Hi Guozhang, Thanks for your attention. I'm a contributor of other Apache project (Ignite). Now I

Re: [DISCUSS] KIP-954: expand default DSL store configuration to custom types

Hi, Sorry for being late to the party! A1: I agree with Sophie, Guozhang, and Almog not to block the KIP on gaps in the implementation. A2: I am happy with not considering anything special w.r.t. versioned state stores in this KIP. A3: Here I agree with Sophie to deprecate the old config.

Re: [DISCUSS] KIP-960: Support interactive queries (IQv2) for versioned state stores

Hi Alieh, Thanks for the KIP! Here my feedback. 1. You can remove the private fields and constructors from the KIP. Those are implementation details. 2. Some proposals for renamings in VersionedKeyQuery withKeyWithTimestampBound() -> withKeyAndAsOf() withKeyWithTimestampRange() ->

Re: [DISCUSS] KIP-954: expand default DSL store configuration to custom types

ferred "DslStoreSuppliers" (I don't love DslStores as it resembles the Stores class to closely in name and they're a little different). A6. Yup, that's the suggestion. - Almog On Wed, Jul 26, 2023 at 6:38 AM Bruno Cadonna wrote: Hi, Sorry for being late to the party! A1: I agree wit

Re: [VOTE] KIP-954: expand default DSL store configuration to custom types

Hi Almog, +1 (binding) Last question: Did you consider to let interface DslStoreSuppliers extend Configurable? Thanks, Bruno On 7/30/23 5:53 AM, John Roesler wrote: Thanks for the KIP, Almog! I'm +1 (binding) I've reviewed the KIP and skimmed the discussion thread. I think this is going

Re: [DISCUSS] KIP-960: Support interactive queries (IQv2) for versioned state stores

p" and "untilTimestamp". - About point 5: Do we need system tests here? I assumed just integration tests were enough. - Regarding long vs timestamp instance: I think yes, that 's why I used Long as timestamp. Bests, Alieh On Thu, Jul 27, 2023 at 2:28 PM Bruno C

Re: [VOTE] KIP-759: Unneeded repartition canceling

Hi, +1 (binding) Thanks for the KIP! Best, Bruno On 8/2/23 1:19 AM, Bill Bejeck wrote: I caught up on the discussion thread and the KIP LGTM. +1(binding) On Tue, Aug 1, 2023 at 3:07 PM Walker Carlson wrote: +1 (binding) On Mon, Jul 31, 2023 at 10:43 PM Matthias J. Sax wrote: +1

Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

mean failing over an Active Task to an instance already hosting a Standby Task? Thanks again and sorry for the essay of a response! Regards, Nick On Tue, 20 Jun 2023 at 10:49, Bruno Cadonna wrote: Hi Nick, Thanks for the updates! I really appreciate that you simplified the KIP by remo

Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

Hi Nick, 1. Yeah, I agree with you. That was actually also my point. I understood that John was proposing the ingestion path as a way to avoid the early commits. Probably, I misinterpreted the intent. 2. I agree with John here, that actually it is public API. My question is how this usage

Re: Permission to contribute to Apache Kafka

Hi Gaurav, you should be all set up now! Thanks for your interest in Apache Kafka! Best, Bruno On 29.06.23 16:16, Gaurav Narula wrote: Hi, Can someone please have a look at this request. Please let me know if there's any further information required. Thanks, Gaurav On 2023/06/26 19:01:08

Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

y to VersionedStateStores. I will probably need to revise my implementation for transactional "segmented" stores, both to accommodate VersionedStateStore, and to clean up some other stuff. Regards, Nick On Tue, 2 May 2023 at 13:45, Bruno Cadonna wrote: Hi Nick, Thanks for the updates! I have

[ANNOUNCE] New committer: Divij Vaidya

Hi all, The PMC of Apache Kafka is pleased to announce a new Kafka committer Divij Vaidya. Divij's major contributions are: GDPR compliance enforcement of kafka-site - https://issues.apache.org/jira/browse/KAFKA-13868 Performance improvements: Improve performance of VarInt encoding and

Re: [DISCUSS] KIP-892: Transactional Semantics for StateStores

rks, and the complexity is drastically reduced, I may try bringing back Atomic Checkpoints into this KIP. Regards, Nick On Mon, 3 Jul 2023 at 15:27, Bruno Cadonna wrote: Hi Nick, Thanks for the insights! Very interesting! As far as I understand, you want to atomically update the state store from the

Re: Improve flaky test reporting (KAFKA-12216)

Hi David, I guess you meant to say "This does not mean that we should NOT continue our effort to reduce the number of flaky tests." I totally agree with what you wrote. I am also +1 on considering all failures for unit tests. Best, Bruno On 2/12/24 9:11 AM, David Jacot wrote: Hi folks,

Re: [DISCUSS] KIP-969: Support range interactive queries for versioned state stores

concise. Best, Bruno On 12/12/23 9:08 AM, Bruno Cadonna wrote: Hi Alieh, I think using TimestampedRangeQuery to query the latest versions is totally fine. If it is not, users will report it and we can add it then. Best, Bruno On 12/11/23 6:22 PM, Alieh Saeedi wrote: Thank you all. I decided

Re: [ANNOUNCE] New Kafka PMC Member: Divij Vaidya

Congratulations Divij! Well deserved! Best, Bruno On 12/27/23 12:45 PM, Luke Chen wrote: Hi, Everyone, Divij has been a Kafka committer since June, 2023. He has remained very active and instructive in the community since becoming a committer. It's my pleasure to announce that Divij is now a

Re: [ANNOUNCE] Apache Kafka 3.6.1

Thanks for managing the release, Mickael! Best, Bruno On 12/8/23 12:44 PM, Luke Chen wrote: Hi Mickael, Thanks for running this release! Luke On Thu, Dec 7, 2023 at 7:13 PM Mickael Maison wrote: The Apache Kafka community is pleased to announce the release for Apache Kafka 3.6.1 This is

Re: [ANNOUNCE] Apache Kafka 3.5.2

Congrats, Luke and thanks for running the release! Best, Bruno On 12/11/23 12:34 PM, Luke Chen wrote: The Apache Kafka community is pleased to announce the release for Apache Kafka 3.5.2 This is a bugfix release. It contains many bug fixes including upgrades the Snappy and Rocksdb

Re: [DISCUSS] KIP-969: Support range interactive queries for versioned state stores

eoffs I see. Not sure if three are other considerations that would tip the scale into either direction? -Matthias On 11/3/23 3:43 AM, Bruno Cadonna wrote: Hi Alieh, I like the examples! 1. Some terms like `asOf` in the descriptions still need to be replaced in the KIP. 2. In your last e-ma

Re: [DISCUSS] KIP-997 Support fetch(fromKey, toKey, from, to) to WindowRangeQuery and unify WindowKeyQuery and WindowRangeQuery

ult-time range would be "all / unbounded" ? 10: you mentioned that `WindowKeyQuery` functionality can be covered by `WindowRangeQuery`. I agree. For this case, it seems we want to deprecate `WindowKeyQuery` entirely? -Matthias On 11/16/23 1:19 AM, Bruno Cadonna wrote: Hi Hanyu, Tha

Re: [DISCUSS] KIP-968: Support single-key_multi-timestamp interactive queries (IQv2) for versioned state stores

napshots for a consistent view here, before dropping this useful guarantee. Cheers, Lucas On Tue, Nov 14, 2023 at 2:20 PM Bruno Cadonna wrote: Hi Alieh, Regarding the semantics/guarantees of the query type: Do we need a snapshot semantic or can we specify a weaker but still useful semantic? A

Re: [DISCUSS] KIP-997 Support fetch(fromKey, toKey, from, to) to WindowRangeQuery and unify WindowKeyQuery and WindowRangeQuery

Hi Hanyu, Thanks for the KIP! 1) Could you please mark the pieces that you want to add to the API in the code listing in the KIP? You can add a comment like "// newly added" or similar. That would make reading the KIP a bit easier because one does not need to compare your code with the code

Re: [VOTE] KIP-968: Support single-key_multi-timestamp interactive queries (IQv2) for versioned state stores

Thanks Alieh, I am +1 (binding). However, although we agreed on not specifying an order of the results by default, there is still the following sentence in the KIP: "The order of the returned records is by default ascending by timestamp. The method withDescendingTimestamps() can reverse

Re: [DISCUSS] KIP-968: Support single-key_multi-timestamp interactive queries (IQv2) for versioned state stores

s On 11/16/23 12:51 AM, Bruno Cadonna wrote: Hi, 80) We do not keep backwards compatibility with IQv1, right? I would even say that currently we do not need to keep backwards compatibility among IQv2 versions since we marked the API "Evolving" (do we only mean code compatibility here or

Re: [DISCUSS] KIP-968: Support single-key_multi-timestamp interactive queries (IQv2) for versioned state stores

guarantees as I described and if there is demand propose stricter guarantees in a follow-up KIP. Maybe there are also other simpler guarantees that make sense. Best, Bruno On 11/9/23 12:30 PM, Bruno Cadonna wrote: Hi, Thanks for the updates! First my take on previous comments: 50) I am in favor

Re: [VOTE] KIP-892: Transactional StateStores

Hi Nick! Thanks a lot for the KIP! Looking forward to the implementation! +1 (binding) Best, Bruno On 11/14/23 2:23 AM, Sophie Blee-Goldman wrote: +1 (binding) Thanks a lot for this KIP! On Mon, Nov 13, 2023 at 8:39 AM Lucas Brutschy wrote: Hi Nick, really happy with the final KIP.

Re: [DISCUSS] KIP-1035: StateStore managed changelog offsets

if they're not open. If the StateManager (aka. ProcessorStateManager/GlobalStateManager) proves too expensive to hold open for closed stores, we could always have a "StubStateManager" in its place, that enables the querying of offsets, but nothing else? IDK, what do you think? Regards, Nick On T

Re: [DISCUSS] KIP-1024: Make the restore behavior of GlobalKTables with custom processors configureable

this changes as well. -Matthias On 4/1/24 10:33 PM, Bruno Cadonna wrote: Hi Walker and Matthias, (2) That is exactly my point about having a compile time error versus a runtime error. The added flexibility as proposed by Matthias sounds good to me. Regarding the Named parameter, I was not aware

Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

ng along the same lines as Bruno. I'm wondering if we can make do with a task-level metric at the INFO level and the processor metric at DEBUG. IMHO, when it comes to tracking exceptions in processing, these two areas are where users will want to focus, higher level metrics wouldn't be as useful

Re: [DISCUSS] KIP-1035: StateStore managed changelog offsets

expensive, but the devil will be in the detail. I'll try to find some time to explore the idea to see if it's possible and report back, because we'll need to determine this before we can vote on the KIP. Regards, Nick On Wed, 10 Apr 2024 at 11:36, Bruno Cadonna wrote: Hi Nick

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

Hi, sorry, I am late to the party. I have a couple of comments: (1) I would prefer Client* instead of Node* in the names. In Kafka Streams we do not really have the concept of node but we have the concept of client (admittedly, we sometimes also use instance). I would like to avoid

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

probably why it doesn't follow the same naming pattern. Personally I'm fine either way (I do think ApplicationMetadata sounds a bit better but that's not a good enough reason :P) Thanks Bruno! On Wed, Apr 17, 2024 at 7:08 AM Bruno Cadonna wrote: Hi, sorry, I am late to the party. I have a c

Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

, I do think it makes sense to leverage it instead of creating a new metric. I will update the KIP to update the dropped-record-metric. 8. Regarding the DSL, I am aligned with Bruno, I think we could close the gaps in a future KIP. Cheers, Damien On Thu, 11 Apr 2024 at 11:56, Bruno Cadonna

Re: [DISCUSS] KIP-1035: StateStore managed changelog offsets

should consider the interface approach afterwards, though. Best, Bruno On 4/17/24 3:15 PM, Bruno Cadonna wrote: Hi Nick and Sophie, I think the task ID is not enough to create a state store that can read the offsets of non-assigned tasks for lag computation during rebalancing. The state

Re: [ANNOUNCE] New committer: Igor Soarez

Congrats! Best, Bruno Am 25. April 2024 05:18:19 MESZ schrieb Yash Mayya : >Congratulations Igor! > >On Wed, 24 Apr, 2024, 23:36 Colin McCabe, wrote: > >> Hi all, >> >> The PMC of Apache Kafka is pleased to announce a new Kafka committer, Igor >> Soarez. >> >> Igor has been a Kafka contributor

Re: [ANNOUNCE] New Kafka PMC Member: Greg Harris

Congratulations, Greg! Best, Bruno On 4/15/24 7:33 AM, Claude Warren wrote: Congrats Greg! All the hard work paid off. On Mon, Apr 15, 2024 at 6:58 AM Ivan Yurchenko wrote: Congrats Greg! On Sun, Apr 14, 2024, at 22:51, Sophie Blee-Goldman wrote: Congrats Greg! Happy to have you On

Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

100 Clermont-Ferrand ---- *De :* Bruno Cadonna *Envoyé :* mercredi 10 avril 2024 10:38 *À :* dev@kafka.apache.org *Objet :* [EXT] Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing Warning External sender Do not click on a

Re: [DISCUSS] KIP-1035: StateStore managed changelog offsets

the face the fact that KS is getting more and more adopted and as a more mature product should support this? -Matthias On 4/21/24 11:58 PM, Bruno Cadonna wrote: Hi all, How should we proceed here? 1. with the plain .checkpoint file 2. with a way to use the state store interface on

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

Hi all, I think we are converging! 117 a) fail: Since it is an invalid consumer assignment b) pass: I agree that not assigning a task might be reasonable in some situations c) fail: For the reasons Lucas pointed out. I am missing a good use case here. d) fail: It is invalid Somewhere in

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

Hi again, I forgot to ask whether you could add the agreement about handling invalid assignment to the KIP. Best, Bruno On 4/30/24 2:00 PM, Bruno Cadonna wrote: Hi all, I think we are converging! 117 a) fail: Since it is an invalid consumer assignment b) pass: I agree that not assigning

Re: [DISCUSS] KIP-1035: StateStore managed changelog offsets

d enough to justify the introduced complexity? In the, for soft failures it's still a win. Just want to make sure we understand the limitations and make an educated decision. Or do I miss something? -Matthias On 5/3/24 10:20 AM, Bruno Cadonna wrote: Hi Matthias, 200: I like the idea in general. Howe

Re: [DISCUSS] KIP-1035: StateStore managed changelog offsets

t we would get a large percentage of opened stores assigned as tasks anyway, this could work? -Matthias On 5/3/24 1:29 AM, Bruno Cadonna wrote: Hi Matthias, 101: Let's assume a RocksDB store, but I think the following might be true also for other store implementations. With this KIP, if Kaf

Re: [VOTE] KIP-924: customizable task assignment for Streams

Thanks for the KIP! Looking forward to a well-structured task assignor! +1 (binding) Best, Bruno On 5/3/24 2:44 AM, Matthias J. Sax wrote: I left one more nit on the discuss thread. But overall LGTM. +1 (binding) Thanks Rohan and Sophie for driving this KIP. -Matthias On 4/29/24 2:07

Re: [VOTE] KIP-1036: Extend RecordDeserializationException exception

Thanks! +1 (binding) Best, Bruno On 5/13/24 8:38 PM, Kirk True wrote: +1 (non-binding) Thanks Fred! On May 13, 2024, at 5:46 AM, Bill Bejeck wrote: Thanks for the KIP! +1 (binding) -Bill On Tue, May 7, 2024 at 6:16 PM Sophie Blee-Goldman wrote: +1 (binding) thanks for the KIP!

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

the TaskAssignmentUtils, I think that makes sense. LGTM. On Fri, May 3, 2024 at 2:26 AM Bruno Cadonna wrote: Hi Sophie, 117f: I think, removing the STATEFUL and STATELESS types is not enough to avoid the error Guozhang mentioned. The StreamsPartitionAssignor passes the information whethe

Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

Hi, the KIP looks great! public static final String PROCESS_EXCEPTION_HANDLER_CLASS_CONFIG = "process.exception.handler". needs to be changed to public static final String PROCESSING_EXCEPTION_HANDLER_CLASS_CONFIG = "processing.exception.handler". The name of the constant has been

Re: [VOTE] KIP-1033: Add Kafka Streams exception handler for exceptions occurring during processing

Hi Damien, Sébastien, and Loïc, Thanks for the KIP! +1 (binding) Best, Bruno On 4/26/24 4:00 PM, Damien Gasparina wrote: Hi all, We would like to start a vote for KIP-1033: Add Kafka Streams exception handler for exceptions occurring during processing The KIP is available on

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

hat we've discussed (and will fix the remaining #finalAssignment mention as well, thanks Bruno. Glad to have such good proof readers! :P) On Tue, Apr 30, 2024 at 8:35 AM Bruno Cadonna wrote: Hi again, I forgot to ask whether you could add the agreement about handling invalid assignment to

Re: [DISCUSS] KIP-1035: StateStore managed changelog offsets

stale (ie, still contains the checkpoint when we opened the store when we got a task assigned). -Matthias On 4/30/24 2:40 AM, Bruno Cadonna wrote: Hi all, 100 I think we already have such a wrapper. It is called AbstractReadWriteDecorator. 101 Currently, the position is checkpoint

Re: [DISCUSS] KIP-1024: Make the restore behavior of GlobalKTables with custom processors configureable

Hi Walker, Thanks for the KIP! Great that you are going to fix this long-standing issue! 1. I was wondering if we need the timestamp extractor as well as the key and value deserializer in Topology#addGlobalStore() that do not take a ProcessorSupplier? What about Consumed in

Re: [DISCUSS] Apache Kafka 3.6.2 release

Thanks Manikumar! +1 Best, Bruno On 3/13/24 5:56 PM, Josep Prat wrote: +1 thanks for volunteering! Best --- Josep Prat Open Source Engineering Director, aivenjosep.p...@aiven.io | +491715557497 | aiven.io Aiven Deutschland GmbH Alexanderufer 3-7, 10117 Berlin Geschäftsführer: Oskari

Re: [DISCUSS] KIP-1024: Make the restore behavior of GlobalKTables with custom processors configureable

Hi Walker, A couple of follow-up questions. 1. Why do you propose to explicitly pass a parameter "storeName" in StreamsBuilder#addGlobalStore? The StoreBuilder should already provide a name for the store, if I understand the code correctly. I would avoid using the same name for the source

Re: [EXT] Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

Hi Loïc, Damien, and Sébastien, Thanks for the KIP! I find it really great that you contribute back to Kafka Streams concepts you developed for kstreamplify so that everybody can take advantage from your improvements. I have a couple of questions/comments: 1. and 2. I am wondering whether

Re: [EXT] Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

/enums you want to add? Best, Bruno On 4/9/24 10:17 AM, Bruno Cadonna wrote: Hi Loïc, Damien, and Sébastien, Thanks for the KIP! I find it really great that you contribute back to Kafka Streams concepts you developed for kstreamplify so that everybody can take advantage from your improvements

Re: [DISCUSS] KIP-1035: StateStore managed changelog offsets

Hi Nick, Thanks for breaking out the KIP from KIP-892! Here a couple of comments/questions: 1. In Kafka Streams, we have a design guideline which says to not use the "get"-prefix for getters on the public API. Could you please change getCommittedOffsets() to committedOffsets()? 2. It is

Re: [DISCUSS] KIP-1024: Make the restore behavior of GlobalKTables with custom processors configureable

ore experience would have a sudden inspiration for how to solve both issues with one API! Anyway, I'll slide back into the lurking shadows for now and let the discussion continue :) Cheers, Almog On Tue, Mar 26, 2024 at 4:22 AM Bruno Cadonna wrote: Hi Almog, Do you mean a API to configure

Re: [DISCUSS] KIP-1024: Make the restore behavior of GlobalKTables with custom processors configureable

ore option should go for maximum flexibility. Best, Walker On Fri, Mar 22, 2024 at 10:01 AM Bruno Cadonna wrote: Hi Walker, A couple of follow-up questions. 1. Why do you propose to explicitly pass a parameter "storeName" in StreamsBuilder#addGlobalStore? The StoreBuilder should alread

Re: [DISCUSS] KIP-1024: Make the restore behavior of GlobalKTables with custom processors configureable

ught about it but I'm not convinced it is a necessary restriction. It might be useful for the already defined processors but then they might as well use the `globalTable` method. I think the add state store option should go for maximum flexibility. Best, Walker On Fri, Mar 22, 2024 at 10:01 AM Bru

Re: [ANNOUNCE] New committer: Christo Lolov

Congrats, Christo! Well deserved! Best, Bruno On 3/26/24 1:04 PM, Luke Chen wrote: Hi, Everyone, The PMC of Apache Kafka is pleased to announce a new Kafka committer: Christo Lolov. Christo has been a Kafka contributor since 2021. He has made over 50 commits. He authored KIP-902, KIP-963,

Re: [DISCUSS] Apache Kafka 3.8.0 release

Thanks Josep! +1 Best, Bruno On 2/26/24 9:53 PM, Chris Egerton wrote: Thanks Josep, I'm +1 as well. On Mon, Feb 26, 2024 at 12:32 PM Justine Olshan wrote: Thanks Joesp. +1 from me. On Mon, Feb 26, 2024 at 3:37 AM Josep Prat wrote: Hi all, I'd like to volunteer as release manager for

Re: [ANNOUNCE] Apache Kafka 3.7.0

, Arpit Goyal, Artem Livshits, Ashwin Pankaj, ashwinpankaj, atu-sharm, bachmanity1, Bob Barrett, Bruno Cadonna, Calvin Liu, Cerchie, chern, Chris Egerton, Christo Lolov, Colin Patrick McCabe, Colt McNealy, Crispin Bernier, David Arthur, David Jacot, David Mao, Deqi Hu, Dimitar Dimitrov, Divij Vaidya

Re: Subscribe to Developer mailing list

Hi LoÏC, subscription to the mailing lists is self-service. See details under https://kafka.apache.org/contact Best, Bruno On 2/29/24 9:48 AM, Loic Greffier wrote: Hi @dev@kafka.apache.org , I am working as a Software Engineer at Michelin, and would like to

Re: Permissions to contribute to Apache Kafka project

Hi Paul, I gave you the permission in JIRA. Currently, all Apache projects have this issue with the wiki account creation. There is a ongoing INFRA ticket about it: https://issues.apache.org/jira/browse/INFRA-25451 Sorry about that! In any case, thank you for your interest in Apache Kafka!

Re: [DISCUSS] KIP-1035: StateStore managed changelog offsets

week for feasibility and report back. I think that covers all the outstanding feedback, unless I missed anything? Regards, Nick On Mon, 6 May 2024 at 14:06, Bruno Cadonna wrote: Hi Matthias, I see what you mean. To sum up: With this KIP the .checkpoint file is written when the store c

Re: [DISCUSS] KIP-1034: Dead letter queue in Kafka Streams

Hi, since there was not too much activity in this thread recently, I was wondering what the status of this discussion is. I cannot find the examples in the KIP Sébastien mentioned in the last message to this thread. I can also not find the corresponding definition of the following method

Re: [VOTE] KIP-1049: Add config log.summary.interval.ms to Kafka Streams

Hi, +1 (binding) Since the voting was open for at least 72 hours and you got 4 binding +1 and no -1, you can close the vote and open a PR. Best, Bruno On 6/17/24 7:11 AM, jiang dou wrote: Thank you for voting： This KIP has received 3 binding votes. Can I assume that this KIP has been voted

Re: [VOTE] KIP-1035: StateStore managed changelog offsets

Thanks Nick! Great KIP! +1 (binding) Best, Bruno On 6/13/24 2:31 AM, Matthias J. Sax wrote: Thanks Nick. +1 (binding) Looking forward to get this all merged! -Matthias On 6/12/24 9:36 AM, Nick Telford wrote: Hi everyone, I'd like to call a vote on KIP-1035[1]. Regards, Nick 1:

<    1   2   3   4   5   6   7   >