Re: ZK, Kafka, Streamclient not cleanly starting up (two issues)

Hi Peter, We are doing heavy microservice development (many of which comm with kafka), and a typical service has an integration test suite that runs under docker-compose. We found the fastest way to get our service up and running is to disable topic auto-create and use the topic-creation

Re: Re: Problem with processor API partition assignments

On 05.01.2017 13:37, Damian Guy wrote: Hi Brian, It might be helpful if you provide some code showing your Topology. Thanks, Damian On Thu, 5 Jan 2017 at 10:59 Brian Krahmer <bkrah...@krahmer.com> wrote: Hey guys, I'm fighting an issue where I can currently only run one instance of my s

Problem with processor API partition assignments

Hey guys, I'm fighting an issue where I can currently only run one instance of my streams application because when other instances come up, the partition reassignment (looks to me) to be incorrect. I'm testing with docker-compose at the moment. When I scale my application to 3 instances

Problem with multiple joins in one topology

Hey guys, I'm having a hell of a time here. I've worked for days trying to get this joining pipeline working. I thought I had it working last week, but my jubilation was premature. The point was to take data in from five different topics and merge them together to obtain one enriched

Problem with multiple joins in one topology

Hey guys, I'm having a hell of a time here. I've worked for days trying to get this joining pipeline working. I thought I had it working last week, but my jubilation was premature. The point was to take data in from five different topics and merge them together to obtain one enriched

Re: Re: Topic discovery when supporting multiple kafka clusters

You didn't mention anything about your current configuration, just that you are 'out of resources'. Perhaps you misunderstand how to size your partitions per topic, and how partition allocation works. If your brokers are maxed on cpu, and you double the number of brokers but keep the replica

Re: Streams - merging multiple topics

Thanks Damian! Based on your response, I finally got it working. I did end up using left joins and added a final step that goes from table -> stream and then filters out nulls. thanks, brian On 21.11.2016 22:03, Damian Guy wrote: Hi Brian, It sounds like you might want do something like:

Streams - merging multiple topics

Hey guys. I've been banging my head for about 3 days now trying to get a streams application working with no luck. I've read through all of the docs and examples I can find, and just am not getting it. I'm using 0.10.1 and have worked quite a bit with the high-level consumer and publisher.