Kafka producer and consumer within on sync execution

2017-04-08 Thread Rams N
Hi, I've an usecase to respond to an API call to the client which should happen in sync. But within the api execution, the system A need to publish a kafka message to an different system B and which responds to another kafka topic. The response must be consumed by A and should respond to the client

Fwd: EndOfStreamException and Client session timed out

2017-04-08 Thread Adeel Shahzad
-- Forwarded message -- From: Adeel Shahzad Date: Sat, Apr 8, 2017 at 1:43 PM Subject: EndOfStreamException and Client session timed out To: d...@kafka.apache.org Hello, We continuously get EndOfStreamException in zookeeper logs, [2017-04-06 19:15:24,350] WARN EndOfStreamExcept

Re: Leader not available error after kafka node goes down

2017-04-08 Thread Eno Thereska
Hi Ali, Try changing the default value for the streams producer retries to something large, since the default is 0 (which means that if a broker is temporarily down, streams would give that error), e.g., : final Properties props = new Properties(); props.put(StreamsConfig.APPLICATION_ID_CONFIG

Leader not available error after kafka node goes down

2017-04-08 Thread Ali Akhtar
I have a 3 node kafka cluster which is being managed via kubernetes, in docker containers. Recently, one of the 3 nodes went down, and was automatically re-created by kubernetes. However, now whenever I try to consume from one of my Kafka topics, thru Kafka Streaming, i get the error: >6687 [Str