We are using a 3 node Kafka cluster and are encountering some weird issues.
1) On Each node, when we tail the server.log file under /var/log/kafka we see continuous errors like these pic-partition. (kafka.server.ReplicaFetcherThread) [2016-12-14 02:39:30,747] ERROR [ReplicaFetcherThread-0-4410000], Error for partition [dev-core-platform-logging,15] to broker 4410000:org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition. (kafka.server.ReplicaFetcherThread) The broker is up and is showing under zookeeper. So it is not clear why these errors occur 2) Occasionally we will find a Kafka broker that goes down. We have adjusted the Ulimit to increase open files as well as added 6g to the heap. When the broker goes down, the process is itself up but is de registered from Zookeeper Thanks, *Shailesh * -- This email communication (including any attachments) contains information from Answers Corporation or its affiliates that is confidential and may be privileged. The information contained herein is intended only for the use of the addressee(s) named above. If you are not the intended recipient (or the agent responsible to deliver it to the intended recipient), you are hereby notified that any dissemination, distribution, use, or copying of this communication is strictly prohibited. If you have received this email in error, please immediately reply to sender, delete the message and destroy all copies of it. If you have questions, please email le...@answers.com. If you wish to unsubscribe to commercial emails from Answers and its affiliates, please go to the Answers Subscription Center http://campaigns.answers.com/subscriptions to opt out. Thank you.
