[
https://issues.apache.org/jira/browse/CRUNCH-630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15795661#comment-15795661
]
Andrew Olson commented on CRUNCH-630:
-------------------------------------
Yes that looks good.
> KafkaRecordReader keeps retrying to poll data when the offset is reset to
> latest offset
> ---------------------------------------------------------------------------------------
>
> Key: CRUNCH-630
> URL: https://issues.apache.org/jira/browse/CRUNCH-630
> Project: Crunch
> Issue Type: Bug
> Reporter: Pooja Dhondge
> Assignee: Micah Whitacre
> Attachments: CRUNCH-630.patch
>
>
> We recently saw this behavior where, if the offset it is trying to read from
> doesn't exist on Kafka due to retention policy, the offset gets reset to
> latest(default) and the KafkaRecordReader keeps retrying beyond
> KAFKA_EMPTY_RETRY_ATTEMPTS_KEY
> {noformat}
> ...crunch.kafka.inputformat.KafkaRecordReader: No records retrieved but
> pending offsets to consume therefore polling again. Attempt 17/10
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
