Re: Storm KafkaSpout Integration

rds:(3) > 37917 [Thread-11-words] INFO backtype.storm.daemon.executor - Activating > spout words:(3) > 62005 [Thread-11-words] INFO backtype.storm.daemon.executor - Processing > received message source: __system:-1, stream: __tick, id: {}, [30] > 62013 [Thread-13-words]

RE: Storm KafkaSpout Integration

: Storm KafkaSpout Integration From: larrya...@gmail.com To: user@storm.apache.org unsubscribe 2016-04-01 10:18 GMT+01:00 david kavanagh <david_...@hotmail.com>: Hey, What i found online was a simple java Kafka Consumer, and i used that code to write my own KafkaSpout.Here is th

Re: Storm KafkaSpout Integration

ride > public void nextTuple() { > ConsumerIterator<byte[], byte[]> it = _stream.iterator(); > String message = new String(it.next().message()); > _collector.emit(new Values(message)); > } > > @Override > public void ack(Object id) { > } > > @Ove

RE: Storm KafkaSpout Integration

xt().message()); _collector.emit(new Values(message)); } @Override public void ack(Object id) {} @Override public void fail(Object id) { } @Overridepublic void declareOutputFields(OutputFieldsDeclarer declarer) { declarer.declare(new Fields("tweet"

Re: Storm KafkaSpout Integration

ks for the advice anyway. > > Regards > David > > -- > Date: Wed, 30 Mar 2016 21:33:38 +0300 > Subject: Re: Storm KafkaSpout Integration > From: spicoflo...@gmail.com > To: user@storm.apache.org > > hi, > i think the problem that you have

RE: Storm KafkaSpout Integration

. RegardsDavid Date: Wed, 30 Mar 2016 21:33:38 +0300 Subject: Re: Storm KafkaSpout Integration From: spicoflo...@gmail.com To: user@storm.apache.org hi, i think the problem that you have is that you have stup one partition per topic, but you try to conume with 10 kafka task spouts. check this lines

Re: Storm KafkaSpout Integration

derstanding you correctly, the line you told me to add in the first email should work because i am only creating one partition? > config.put(Config.TOPOLOGY_MAX_SPOUT_PENDING, 1); > Thanks again for the help :-) > David > > Date: Wed, 30 Mar 2016 15:36:

Re: Storm KafkaSpout Integration

917 [Thread-11-words] INFO backtype.storm.daemon.executor - Activating > spout words:(3) > 62005 [Thread-11-words] INFO backtype.storm.daemon.executor - Processing > received message source: __system:-1, stream: __tick, id: {}, [30] > 62013 [Thread-13-words] INFO backtype.storm.daem

RE: Storm KafkaSpout Integration

ck, id: {}, [30]62013 [Thread-13-words] INFO backtype.storm.daemon.executor - Processing received message source: __system:-1, stream: __tick, id: {}, [30] Date: Wed, 30 Mar 2016 10:10:54 +0530 Subject: Re: Storm KafkaSpout Integration From: dkira...@aadhya-analytics.com To: user@storm.apache.org Hi

Re: Storm KafkaSpout Integration

Hi david, I think everything is good but you are missing a statement config.put(Config.TOPOLOGY_MAX_SPOUT_PENDING, 1); add it after the line config.setDebug(true); *Best regards,* *K.Sai Dilip Reddy.* On Tue, Mar 29, 2016 at 10:03 PM, david kavanagh wrote: > Hi all, >

Storm KafkaSpout Integration

Hi all, I am currently trying use TestTopologyStaticHosts to try connect the KafkaSpout to a Kafka topic. I have a ZooKeeper and a Kafka instance running on my localhost. I have a topic named "twitter-topic" that has some tweets in it. This is all working as expected. I can run the consumer in