hi everyone, we are trying to deploy Kafka 0.8.2.1 and Zookeeper on AWS using Cloudformation, ASG's and other Services. For Zookeeper we are using Netflix' Exhibitor (V 1.5.5) to ensure failover stability.
What we are observing right now is that after some days our Brokers are not registered anymore in the "/brokers/ids" path in Zookeeper. I was trying to see when they get deleted to check the logs, but the ZK Transaction logs only shows the create stmt, no deletes or something (though deletes are written down there). Can someone explain me how the mechanism works with registering and deregistering in Zookeeper or point me to a doc or even source code, where this happens? Or some one has even some idea what happens there. Any experience on what to take care of deploying kafka on AWS (or generally a cloud env) would be also helpful. Cheers -- *Fabian Wollert* Business Intelligence *POSTAL ADDRESS* Zalando SE 11501 Berlin *OFFICE* Zalando SE Mollstraße 1 10178 Berlin Germany Phone: +49 30 20968 1819 Fax: +49 30 27594 693 E-Mail: fabian.woll...@zalando.de Web: www.zalando.de Jobs: jobs.zalando.de Zalando SE, Tamara-Danz-Straße 1, 10243 Berlin Company registration: Amtsgericht Charlottenburg, HRB 158855 B Tax ID: 29/560/00596 * VAT registration number: DE 260543043 Management Board: Robert Gentz, David Schneider, Rubin Ritter Chairperson of the Supervisory Board: Cristina Stenbeck Registered office: Berlinn
