| Smalyshev added a comment. |
It will be more, a lot more. What language are you working in?
The end consumer will be Java, but I don't want to consume the raw Kafka stream from Java, I'd rather have some intermediary that cleans up, deduplicates, etc. the changes.
Load balanced parallel consumers, or all distinct consumers doing different stuff?
All distinct. They will be pretty close to each other, but nothing forces them to consume exactly the same things, they are completely independent.
If any of those processes goes down, a different consumer process will be auto-assigned its work.
That's kind of the opposite of what I need :) Each client is independent and should get all the updates.
TASK DETAIL
EMAIL PREFERENCES
To: Ottomata, Smalyshev
Cc: Anomie, Aklapper, Smalyshev, QZanden, EBjune, merbst, Salgo60, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, JAllemandou, mobrovac, jkroll, Wikidata-bugs, Jdouglas, aude, GWicke, Deskana, Manybubbles, Mbch331, Krenair, jeremyb
Cc: Anomie, Aklapper, Smalyshev, QZanden, EBjune, merbst, Salgo60, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, JAllemandou, mobrovac, jkroll, Wikidata-bugs, Jdouglas, aude, GWicke, Deskana, Manybubbles, Mbch331, Krenair, jeremyb
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
