[ 
https://issues.apache.org/jira/browse/STORM-2869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jungtaek Lim resolved STORM-2869.
---------------------------------
       Resolution: Fixed
    Fix Version/s: 1.2.0
                   2.0.0

Thanks [~Srdo], I merged into master and 1.x-branch.

> KafkaSpout discards all pending records when adjusting the consumer position 
> after a commit
> -------------------------------------------------------------------------------------------
>
>                 Key: STORM-2869
>                 URL: https://issues.apache.org/jira/browse/STORM-2869
>             Project: Apache Storm
>          Issue Type: Bug
>          Components: storm-kafka-client
>    Affects Versions: 2.0.0, 1.2.0
>            Reporter: Stig Rohde Døssing
>            Assignee: Stig Rohde Døssing
>              Labels: pull-request-available
>             Fix For: 2.0.0, 1.2.0
>
>          Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> As part of the STORM-2666 fix the spout clears out waitingToEmit when the 
> consumer position falls behind the committed offset during a commit. We only 
> need to do it for the affected partition, and then only for the records that 
> are behind the committed offset.
> Also the validation check in emitOrRetryTuple is slightly too permissive, it 
> should check whether the current record is behind the committed offset, not 
> whether the consumer position is behind the committed offset.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to