Re: Kafka Streams and reliable state stores

2017-03-23 Thread Matthias J. Sax
> There's also race conditions here -- what if node B owns partition 1, > node A redirects a query from a key in that partition, then B fails over to A > concurrently? You will get an exception, and you need to refresh your metadata. Afterward, you need to query again. This blog posts gives more

Kafka Streams and reliable state stores

2017-03-23 Thread Steven Schlansker
Hello everyone, I am looking to enhance my Kafka Streams based application from one instance to many. Part of the difficulty is the it seems that all of the state providers are "instance local", either in memory or on local disk. This means to answer queries for non-local partitions you have to