[ https://issues.apache.org/jira/browse/METRON-1782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631674#comment-16631674 ]
ASF GitHub Bot commented on METRON-1782: ---------------------------------------- Github user MohanDV commented on the issue: https://github.com/apache/metron/pull/1202 +1 Verified on the full dev , below are the debug log from profiler `2018-09-28 10:17:36.465 o.a.m.p.b.ProfileSplitterBolt Thread-6-splitterBolt-executor[7 7] [DEBUG] Received message; topic=indexing, partition=0, offset=5490, kafkaTimestamp=1538129856340 ....... 2018-09-28 10:17:43.893 o.a.m.p.b.ProfileSplitterBolt Thread-6-splitterBolt-executor[7 7] [DEBUG] Received message; topic=indexing, partition=0, offset=5491, kafkaTimestamp=1538129863880 ......... 2018-09-28 10:17:45.026 o.a.m.p.b.ProfileSplitterBolt Thread-6-splitterBolt-executor[7 7] [DEBUG] Received message; topic=indexing, partition=0, offset=5492, kafkaTimestamp=1538129864998 ..... 2018-09-28 10:17:45.859 o.a.m.p.b.ProfileSplitterBolt Thread-6-splitterBolt-executor[7 7] [DEBUG] Received message; topic=indexing, partition=0, offset=5493, kafkaTimestamp=1538129865850 ` > Add Kafka Partition and Offset to Profiler Debug Logs > ----------------------------------------------------- > > Key: METRON-1782 > URL: https://issues.apache.org/jira/browse/METRON-1782 > Project: Metron > Issue Type: Bug > Reporter: Nick Allen > Assignee: Nick Allen > Priority: Major > > I was troubleshooting an issue that a user was running into with the > Profiler. The logs made it appear that a second batch of messages were being > sent after a period of time, when none actually were. > We found that the second batch was actually just Storm timing out the first > batch of messages and re-sending them. This would have been simple to > uncover if we had the Kafka topic, partition, and offset details of each > message logged at a DEBUG level. > I made those code change while debugging the issue. I thought this might be > generally useful to roll into Apache. -- This message was sent by Atlassian JIRA (v7.6.3#76005)