It's not make sense. I know one SpoutKafka can fetch from one topic only(due to config). So I use 12 KafkaSpouts to fetch from 12 different topics, and each for parallelism 1 or 2 only. It works(I can see 12 spouts in storm UI. Notice that, you have to set different zookeeper paths for different topics, and they store offset for each topics in different location of zookeeper.
SpoutConfig(BrokerHosts hosts, String topic, String zkRoot, String id) You should give different id for different topics. James > Anis Nasir <aadi.a...@gmail.com> 於 2014/6/22 下午7:43 寫道： > > I have four instances of KafkaSpout in my topology .I can see four executors > running on storm UI, as i have set number of instances to four. However, only > one of the spouts is able to fetch messages from kafka. > > cheers > Anis > > >> On Sun, Jun 22, 2014 at 1:40 PM, <jamesw...@yahoo.com.tw> wrote: >> Hi, >> >> How many instances of KafkaSpout in your topology? If you have one only, I >> think you can see one spout in storm UI. However, if you set parallelism for >> 4, you will see "executers" for 4 in storm UI. >> >> James >> >> > Anis Nasir <aadi.a...@gmail.com> 於 2014/6/22 下午7:33 寫道： >> > >> > Dear all, >> > >> > I configured my kafka topic to have four partitions and I tried to set the >> > spout task parallelism to four as well. However, in storm UI, I can only >> > see one spout reading from the kafka topic. Can someone observed the same >> > pattern? or am I doing something wrong? >> > >> > Regards >> > Anis >
