I have a job that consumes a stream with multiple partitions and the work is divided amongst multiple StreamTask instances as you’d expect. Now I need to be able to synchronize some state to all of my StreamTasks that is used to process messages from this stream. That is, the same state lives in every StreamTask instance. I was going to do this via a second stream but I need the messages in this stream to be broadcast to every StreamTask instance. It appears, though, that Samza doesn’t support the broadcast model for input streams. I could workaround this by writing each message to all partitions but wanted to see if there was a better way of solving this problem.
Thanks! James
