Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-08-30 Thread Ayoub Omari
7;s good to > start a VOTE thread in 1-2 days. > > Thanks, > Bill > > On Mon, Aug 26, 2024 at 3:15 AM Ayoub Omari > wrote: > > > Hi Bill, > > > > I think all the points raised are now handled in the KIP. > > We just still have the 106) on which we sho

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-08-26 Thread Ayoub Omari
t; > forwarded by punctuation for example. > > > > > > 2. I'm not sure about using something other than the key for > identifying > > > dupllicate records. By doing so, one could end up missing a > > de-duplication > > > due to records with the same id characte

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-07-13 Thread Ayoub Omari
e de-duplication period to > clean out older records would be a clean approach for purging older > records. I'm not taking a hard stance on this approach and I'm willing to > discuss different methods. > > Thanks, > > Bill > > > > On 2024/06/25 18:44:06 Ayo

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-06-25 Thread Ayoub Omari
che.org/jira/browse/KAFKA-10844> which is not resolve > directly either. We do have KIP-759 > (https://cwiki.apache.org/confluence/display/KAFKA/KIP-759: Unneeded > repartition canceling< > https://cwiki.apache.org/confluence/display/KAFKA/KIP-759: Unneeded > repartition canceling>

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-06-11 Thread Ayoub Omari
t; > really need -- or add such a configuration later in case the semantics > > we pick don't work for some users. > > > > Another line of thinking, that did serve us well in the past: in doubt > > keep a record -- users can add operators to drop record (in case they >

[jira] [Created] (KAFKA-16925) stream-table join does not immediately forward expired records on restart

2024-06-10 Thread Ayoub Omari (Jira)
Ayoub Omari created KAFKA-16925: --- Summary: stream-table join does not immediately forward expired records on restart Key: KAFKA-16925 URL: https://issues.apache.org/jira/browse/KAFKA-16925 Project

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-06-06 Thread Ayoub Omari
t some more motivation and tradeoffs > discussed about the different strategies we could use. > > You also propose to drop _any_ late record: I am also not sure if that's > desired? Could this not lead to data loss? Assume we get a late record, > but in fact there was never a duplicate

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-05-29 Thread Ayoub Omari
Hi everyone, I've just made a (small) change to this KIP about an implementation detail. Please let me know your thoughts. Thank you, Ayoub Le lun. 20 mai 2024 à 21:13, Ayoub a écrit : > Hello, > > Following a discussion on community slack channel, I would like to revive > the discussion on th

[jira] [Created] (KAFKA-16573) Streams does not specify where a Serde is needed

2024-04-17 Thread Ayoub Omari (Jira)
Ayoub Omari created KAFKA-16573: --- Summary: Streams does not specify where a Serde is needed Key: KAFKA-16573 URL: https://issues.apache.org/jira/browse/KAFKA-16573 Project: Kafka Issue Type

[jira] [Created] (KAFKA-16458) Add contains method in KeyValue store interface

2024-04-02 Thread Ayoub Omari (Jira)
Ayoub Omari created KAFKA-16458: --- Summary: Add contains method in KeyValue store interface Key: KAFKA-16458 URL: https://issues.apache.org/jira/browse/KAFKA-16458 Project: Kafka Issue Type

[jira] [Created] (KAFKA-16434) ForeignKey INNER join does not unset join result when FK becomes null

2024-03-27 Thread Ayoub Omari (Jira)
Ayoub Omari created KAFKA-16434: --- Summary: ForeignKey INNER join does not unset join result when FK becomes null Key: KAFKA-16434 URL: https://issues.apache.org/jira/browse/KAFKA-16434 Project: Kafka

[jira] [Created] (KAFKA-16407) ForeignKey INNER join ignores FK change when its previous value is null

2024-03-22 Thread Ayoub Omari (Jira)
Ayoub Omari created KAFKA-16407: --- Summary: ForeignKey INNER join ignores FK change when its previous value is null Key: KAFKA-16407 URL: https://issues.apache.org/jira/browse/KAFKA-16407 Project: Kafka

[jira] [Created] (KAFKA-16394) ForeignKey LEFT join propagates null value on foreignKey change

2024-03-20 Thread Ayoub Omari (Jira)
Ayoub Omari created KAFKA-16394: --- Summary: ForeignKey LEFT join propagates null value on foreignKey change Key: KAFKA-16394 URL: https://issues.apache.org/jira/browse/KAFKA-16394 Project: Kafka

[jira] [Created] (KAFKA-16343) Improve tests of streams foreignkey package

2024-03-04 Thread Ayoub Omari (Jira)
Ayoub Omari created KAFKA-16343: --- Summary: Improve tests of streams foreignkey package Key: KAFKA-16343 URL: https://issues.apache.org/jira/browse/KAFKA-16343 Project: Kafka Issue Type