Is there a correlation between the lagging partitions and the consumer assigned to them?
> On Jun 26, 2019, at 4:25 PM, Garvit Sharma <[email protected]> wrote: > > Can anyone please help me with this. > > On Wed, Jun 26, 2019 at 8:56 PM Garvit Sharma <[email protected]> wrote: > >> Hey Steve, >> >> I have checked, count of messages on all the partitions are same. >> >> I am still exploring an approach using which the root cause could be >> determined. >> >> Thanks, >> >> On Wed, Jun 26, 2019 at 8:07 PM Garvit Sharma <[email protected]> >> wrote: >> >>> I am not sure about that. Is there a way to analyse that ? >>> >>> On Wed, Jun 26, 2019 at 7:35 PM Steve Howard <[email protected]> >>> wrote: >>> >>>> Hi Garvit, >>>> >>>> Are the slow partitions "hot", i.e., receiving a lot more messages than >>>> others? >>>> >>>> Thanks, >>>> >>>> Steve >>>> >>>> On Wed, Jun 26, 2019, 9:56 AM Garvit Sharma <[email protected] wrote: >>>> >>>>> Just to add more details, these consumers are processing the Kafka >>>> events >>>>> and writing to DB(fast write guaranteed). >>>>> >>>>> On Wed, Jun 26, 2019 at 7:23 PM Garvit Sharma <[email protected]> >>>>> wrote: >>>>> >>>>>> Hi All, >>>>>> >>>>>> I can see huge consumer lag in a few partitions of Kafka topic. I >>>> need to >>>>>> know the root cause of this issue. >>>>>> >>>>>> Please let me know, how to proceed. >>>>>> >>>>>> Below is sample consumer lag data : >>>>>> >>>>>> [image: image.png] >>>>>> >>>>>> Thanks, >>>>>> >>>>>> >>>>> >>>> >>>
