[ https://issues.apache.org/jira/browse/KAFKA-1640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14139928#comment-14139928 ]
chenshangan commented on KAFKA-1640: ------------------------------------ [~guozhang] thanks for you suggestion, it's because the size of that single message is bigger than the max buffer size. I will close this issue. btw, what do you mean of turning on log4j on the consumer and how? I use log4j from the whole client project, I think it should affect the whole client, but why not ? > consumer will fail if encounter special offset > ---------------------------------------------- > > Key: KAFKA-1640 > URL: https://issues.apache.org/jira/browse/KAFKA-1640 > Project: Kafka > Issue Type: Bug > Components: consumer > Affects Versions: 0.8.1.1 > Reporter: chenshangan > Assignee: Neha Narkhede > > I'm running topology on storm which consume messages from kafka. Sometimes I > encounter exceptions like offset out of range. I did not pay much attention > on this problem before and just restarted the topology to consume messages > from latest offset because of various reasons. Recently, more services are > dependent on kafka, and this problem still exists. According to the invalid > offset information, I did a test and finally found the problem. There exists > an offset which consumer can never start from and can not skip over it unless > you provide next valid offset to start from. I can not figure out why. -- This message was sent by Atlassian JIRA (v6.3.4#6332)