Re: Streams: Global state & topic multiplication questions

2017-01-20 Thread Peter Kopias
Thank you both for the directions, I'll dive into these. Peter On Jan 20, 2017 9:55 AM, "Michael Noll" wrote: > As Eno said I'd use the interactive queries API for Q2. > > Demo apps: > - > https://github.com/confluentinc/examples/blob/3. > 1.x/kafka-streams/src/main/java/io/confluent/examples/

Re: Streams: Global state & topic multiplication questions

2017-01-20 Thread Michael Noll
As Eno said I'd use the interactive queries API for Q2. Demo apps: - https://github.com/confluentinc/examples/blob/3.1.x/kafka-streams/src/main/java/io/confluent/examples/streams/interactivequeries/kafkamusic/KafkaMusicExample.java - https://github.com/confluentinc/examples/blob/3.1.x/kafka-stream

Re: Streams: Global state & topic multiplication questions

2017-01-19 Thread Eno Thereska
For Q2: one way to export the state on demand would be to use the Interactive Queries API (https://www.confluent.io/blog/unifying-stream-processing-and-interactive-queries-in-apache-kafka/ ). Tha

Re: Streams: Global state & topic multiplication questions

2017-01-19 Thread Peter Kopias
Q1: Thank you, the branch() is what I'm looking for, I just missed it somehow. Q2: I receive something like "imageid,x,y" as key, and a color as value. I aggregate this to something like average color for example. So technically I do not have images, I have colored pixels with 3 dimensions on

Re: Streams: Global state & topic multiplication questions

2017-01-19 Thread Eno Thereska
Hi Peter, About Q1: The DSL has the "branch" API, where one stream is branched to several streams, based on a predicate. I think that could help. About Q2: I'm not entirely sure I understand the problem space. What is the definition of a "full image"? Thanks Eno > On 19 Jan 2017, at 12:07, Pet

Streams: Global state & topic multiplication questions

2017-01-19 Thread Peter Kopias
Greetings Everyone, I'm just getting into the kafka world with a sample project, and I've got two conceptional issues, you might have a trivial answer already at hand to. Scenario: multiuser painting webapp, with N user working on M images simultaneously. The "brush" events go to one single k