[jira] [Updated] (STORM-1017) If ignoreZkOffsets set true,KafkaSpout will reset zk offset when recover from failure.
[ https://issues.apache.org/jira/browse/STORM-1017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated STORM-1017: Fix Version/s: 0.11.0 > If ignoreZkOffsets set true,KafkaSpout will reset zk offset when recover from > failure. > -- > > Key: STORM-1017 > URL: https://issues.apache.org/jira/browse/STORM-1017 > Project: Apache Storm > Issue Type: Bug > Components: storm-kafka >Reporter: Renkai Ge >Assignee: Priyank Shah > Fix For: 0.11.0 > > > when ignoreZkOffsets set true and startOffsetTime = > kafka.api.OffsetRequest.EarliestTime(). > workers running -> topology shutdown by user and restart -> workers will read > from earliest time again > workers running -> one of workers shutdown by accident and supervisor restart > the worker -> what offset will the restarted worker read from? > More details on > https://github.com/apache/storm/pull/493#issuecomment-135783234 > It will cause a lot of unwanted duplicated messages in some scenes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (STORM-1017) If ignoreZkOffsets set true,KafkaSpout will reset zk offset when recover from failure.
[ https://issues.apache.org/jira/browse/STORM-1017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated STORM-1017: -- Assignee: Priyank Shah (was: Sriharsha Chintalapani) > If ignoreZkOffsets set true,KafkaSpout will reset zk offset when recover from > failure. > -- > > Key: STORM-1017 > URL: https://issues.apache.org/jira/browse/STORM-1017 > Project: Apache Storm > Issue Type: Bug > Components: storm-kafka >Reporter: Renkai Ge >Assignee: Priyank Shah > > when ignoreZkOffsets set true and startOffsetTime = > kafka.api.OffsetRequest.EarliestTime(). > workers running -> topology shutdown by user and restart -> workers will read > from earliest time again > workers running -> one of workers shutdown by accident and supervisor restart > the worker -> what offset will the restarted worker read from? > More details on > https://github.com/apache/storm/pull/493#issuecomment-135783234 > It will cause a lot of unwanted duplicated messages in some scenes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
