Re: Re-key by multiple properties without composite key

2024-01-30 Thread Karsten Stöckmann
Matthias, thanks for getting back on this. I'll try to illustrate my intent with an example as I'm not yet fully familiar with Kafka (Streams) and its idioms... Assume classes Person and Folder: class Person { Long id; String firstname; String lastname; // some content } class Folder {

Re: What does kafka streams groupBy does internally?

2024-01-30 Thread Matthias J. Sax
Did reply on SO. -Matthias On 1/24/24 2:18 AM, warrior2...@gmail.com wrote: Let's say there's a topic in which chunks of different files are all mixed up represented by a tuple |(FileId, Chunk)|. Chunks of a same file also can be a little out of order. The task is to aggregate all files and

Re: Re-key by multiple properties without composite key

2024-01-30 Thread Matthias J. Sax
Both fk1 and fk2 point to the PK of another entity (not shown for brevity, of no relevance to the question). It this two independent FK, or one two-column FK? Ingesting the topic into a Kafka Streams application, how can I re-key the resulting KTable by both fk1 and fk2? If you read the

Re: [VOTE] 3.7.0 RC2

2024-01-30 Thread Omnia Ibrahim
Hi Stan and Gaurav, Just to clarify some points mentioned here before KAFKA-14616: I raised a year ago so it's not related to JBOD work. It is rather a blocker bug for KRAFT in general. The PR from Colin should fix this. Am not sure if it is a blocker for 3.7 per-say as it was a major bug

v3.5.1 KRAFT mode: Cluster every day exact same time unavailable for ~30sec -> no controller available

2024-01-30 Thread Denny Fuchs
Hello, we have Kafka v3.5.1 in KRAFT mode running, with two datacenters (via 10Gb/s Darkfiber): DC 1 : 3 nodes Controller / Broker DC 2 : 2 nodes Controller / Broker DC 2 : 1 node Broker Exactly at the same time: 21:01:00 (CEST) the cluster is unstable and no producer / consumer can access