Re: NotLeaderForPartitionException causing event loss

2016-08-12 Thread Zakee
Increasing number of retries and/or retry.backoff.ms will help reduce the data loss. Figure out how long NLFPE occurs (this happens only as long as metadata is obsolete), and configure below props accordingly. message.send.max.retries=3 (default) retry.backoff.ms=100 (default) > On Aug 12, 201

NotLeaderForPartitionException causing event loss

2016-08-12 Thread sunil kalva
We are seeing data loss, whenever we see "NotLeaderForPartitionException" exception, We are using 0.8.2 java client publisher API with callback, when i get callback with the error i am logging them in a file and retrying them later. So number of errors = number of logged events are matching but ove