Re: kafka connect 409 with connect-distributed

2019-08-12 Thread Javier Arias Losada
Thank you very much Best, Javier arias El jue., 8 ago. 2019 a las 14:47, Javier Arias Losada (< javier.ari...@gmail.com>) escribió: > Hello there, > we were suffering some problems on our connect-distributed setup, when > posting a new Connector config, the response was always a 409

kafka connect 409 with connect-distributed

2019-08-08 Thread Javier Arias Losada
Hello there, we were suffering some problems on our connect-distributed setup, when posting a new Connector config, the response was always a 409 Conflict mentioning a rebalance as the underlying reason. It was fixed after setting up a different CONNECT_REST_ADVERTISED_HOST_NAME on each worker,

kafka-streams disconnection errors

2019-07-11 Thread Javier Arias Losada
able to manage the kafka-connection management internals and being disconnected... but can someone explain the reason why? Thank you! Best, Javier arias losada

Re: KafkaConnect not consuming from SSL/SASL cluster

2019-06-04 Thread Javier Arias Losada
ot; prefixed on each of the > configuration items: > consumer.security.protocol=SASL_SSL > consumer.ssl.protocol=TLSv1.2 > consumer.sasl.mechanism=PLAIN > consumer.sasl.jaas.config=.. > > Hope this helps. > > Andrew Schofield > > From: Javier Arias Losada > Reply-To: "us

KafkaConnect not consuming from SSL/SASL cluster

2019-06-04 Thread Javier Arias Losada
Hello there, we are trying to use KafkaConnect, but it isn't consuming any messages after changing to a SSL and authenticated Kafka cluster. With a cluster without SSL or authentication it's working perfectly fine with the same configuration except for the sasl/ssl settings. I think probably is

Re: Kafka streams application unaware of connection to broker lost

2019-02-21 Thread Javier Arias Losada
sue: https://issues.apache.org/jira/browse/KAFKA-6520 > > > > > > On 2/20/19 3:25 AM, Javier Arias Losada wrote: > > > Hello Kafka users, > > > > > > working on a Kafka-Streams stateless application; we want to implement > > some > > > h

Kafka streams application unaware of connection to broker lost

2019-02-20 Thread Javier Arias Losada
Hello Kafka users, working on a Kafka-Streams stateless application; we want to implement some healthchecks so that whenever connection to Kafka is lost for more than a threshold, marke the instance as unhealthy, so that our cluster manager (could be K8S or AWS-ECS) kills that instance and starts

Re: Lag checking from producer

2019-02-19 Thread Javier Arias Losada
Hi, could you please be more specific on your use case? One of the theoretical advantages of a system like kafka is that you can decouple producers and consumers, so you don't need to to do backpressure. A different topic is how to handle lagging consumers, in that scenario you could scale up

long time between consumer gracefully stopping and rebalance

2019-01-25 Thread Javier Arias Losada
g triggered? what are the tradeoffs? more unneeded rebalances? For more context, our Kafka version is 1.1.0, after looking at libs found for example kafka/kafka_2.11-1.1.0-cp1.jar, we installed Confluent platform 4.1.0. On the consumer side, we are using Kafka-streams 2.1.0. Thank you very much. Javier Arias Losada.

rebalancing latency spikes on high throughput kafka-streams services

2019-01-16 Thread Javier Arias Losada
are using Kafka-streams 2.1.0. Thank you for reading my question and your responses. Best, Javier Arias Losada

Subscribe me, please

2019-01-15 Thread Javier Arias Losada