Kafka cluster not recovering after zookeeper and nodes failure

2019-03-20 Thread Radu Radutiu
Hello Kafka users, We have tested failure scenarios and found the following situation in which the kafka cluster will not automatically recover. Cluster setup: 3 VMs (n1,n2,n3) running Centos 7, each VM runs a zookeper v3.4.13 and kafka v2.1.0 instance, configured as systemd services, OpenJDK 1.8

Re: Experimenting with Kafka and OpenSSL

2017-10-30 Thread Radu Radutiu
If you test with Java 9 please make sure to use an accelerated cipher suite (e.g. one that uses AES GCM such as TLS_RSA_WITH_AES_128_GCM_SHA256). Radu On Mon, Oct 30, 2017 at 1:49 PM, Jaikiran Pai wrote: > I haven't yet had a chance to try out Java 9, but that's definitely on my > TODO list, m

Re: ISR churn

2017-03-23 Thread Radu Radutiu
On Mar 22, 2017, at 7:06 AM, Manikumar <mailto:manikumar.re...@gmail.com>> wrote: > >> > >> Any erros related to zookeeper seesion timeout? We can also check for > >> excesssive GC. > >> Some times this may due to forming multiple controllers due to s

ISR churn

2017-03-22 Thread Radu Radutiu
Hello, Does anyone know how I can debug high ISR churn on the kafka leader on a cluster without traffic? I have 2 topics on a 4 node cluster (replica 4 and replica 3) and both show constant changes of the number of insync replicas: [2017-03-22 15:30:10,945] INFO Partition [__consumer_offsets,0]

Re: Kafka broker crash

2016-06-23 Thread Radu Radutiu
/tmp is not a good location for storing files. It will get cleaned up periodically, depending on your linux distribution. Radu On 22 June 2016 at 19:33, Misra, Rahul wrote: > Hi Madhukar, > > Thanks for your quick response. The path is "/tmp/kafka-logs/". But the > servers have not been restart

Re: SSL support for command line tools

2016-06-23 Thread Radu Radutiu
set > > acl's > > to use the tool). > > > > On Wed, Jun 22, 2016 at 2:47 PM Gerard Klijs > > wrote: > > > > > You need to pass the correct options, similar to how you would do to a > > > client. We use the consumer-groups in a docker container, in

SSL support for command line tools

2016-06-22 Thread Radu Radutiu
Hi, Is is possible to configure the command line tools like kafka-consumer-groups.sh , kafka-topics.sh and all other command that are not a consumer or producer to connect to a SSL only kafka cluster ? Regards, Radu

Re: ConsoleProducer missing messages (random behavior)

2016-06-17 Thread Radu Radutiu
27;ve scripted this scenario, it's likely your broker hasn't come up > completely before you start producing messages to it. > > Regards, > > > On Thu, Jun 16, 2016 at 3:19 AM, Radu Radutiu wrote: > > > Hi, > > > > I was following the Quickstart guide an

ConsoleProducer missing messages (random behavior)

2016-06-16 Thread Radu Radutiu
Hi, I was following the Quickstart guide and I have noticed that ConsoleProducer does not publish all messages (the number of messages published differs from one run to another) and happens mostly on a fresh started broker. version: kafka_2.11-0.10.0.0 OS: Linux (Ubuntu 14.04, Centos 7.2) JDK: jav

ConsoleProducer missing messages (random behavior)

2016-06-15 Thread Radu Radutiu
Hi, I was following the Quickstart guide and I have noticed that ConsoleProducer does not publish all messages (the number of messages published differs from one run to another) and happens mostly on a fresh started broker. version: kafka_2.11-0.10.0.0 OS: Linux (Ubuntu 14.04, Centos 7.2) JDK: jav