[
https://issues.apache.org/jira/browse/STORM-391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14235577#comment-14235577
]
ASF GitHub Bot commented on STORM-391:
--------------------------------------
GitHub user Lewuathe opened a pull request:
https://github.com/apache/storm/pull/338
[STORM-391] KafkaSpout to await for the topic
KafkaSpout is waiting for creation of target topic.
Curator keeps watching existence of topic path for a given time length.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/Lewuathe/storm kafkaspout-await-for-topic
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/storm/pull/338.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #338
----
commit f3c0523c5aec432d1de5c0ccd6cf06a6550257e9
Author: lewuathe <[email protected]>
Date: 2014-12-05T15:00:03Z
[STORM-391] KafkaSpout to await for the topic
KafkaSpout is waiting for creation of target topic.
Curator keeps watching existence of topic path for a given time length.
----
> KafkaSpout to await for the topic
> ---------------------------------
>
> Key: STORM-391
> URL: https://issues.apache.org/jira/browse/STORM-391
> Project: Apache Storm
> Issue Type: Improvement
> Affects Versions: 0.9.2-incubating
> Reporter: Alexey Raga
> Assignee: Kai Sasaki
> Labels: features
>
> When topic does not yet exist and the consumer is asked to consume from it,
> the default behaviour for Kafka heigh-level consumer is to "await" for the
> topic without a failure.
> KafkaSpout currently fails trying to get the partition information about the
> topic that does not exist.
> It may be a good idea to have the same common behaviour in KafkaSpout and it
> can probably be implemented through the zookeeper watchers: if topic does not
> exist, then set up a watcher and don't do anything until it yields.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)