Re: Storm KafkaSpout Integration

2016-04-04 Thread John Reilly
rds:(3) > 37917 [Thread-11-words] INFO backtype.storm.daemon.executor - Activating > spout words:(3) > 62005 [Thread-11-words] INFO backtype.storm.daemon.executor - Processing > received message source: __system:-1, stream: __tick, id: {}, [30] > 62013 [Thread-13-words]

RE: Storm KafkaSpout Integration

2016-04-01 Thread david kavanagh
public void fail(Object id) { } @Overridepublic void declareOutputFields(OutputFieldsDeclarer declarer) { declarer.declare(new Fields("tweet"));}} Date: Thu, 31 Mar 2016 11:12:38 -0700 Subject: Re: Storm KafkaSpout Integration From: tech.login@gmail.com To: user@s

Re: Storm KafkaSpout Integration

2016-04-01 Thread Larry Akah
ride > public void nextTuple() { > ConsumerIterator<byte[], byte[]> it = _stream.iterator(); > String message = new String(it.next().message()); > _collector.emit(new Values(message)); > } > > @Override > public void ack(Object id) { > } > > @Ove

RE: Storm KafkaSpout Integration

2016-04-01 Thread david kavanagh
xt().message()); _collector.emit(new Values(message)); } @Override public void ack(Object id) {} @Override public void fail(Object id) { } @Overridepublic void declareOutputFields(OutputFieldsDeclarer declarer) { declarer.declare(new Fields("tweet"

Re: Storm KafkaSpout Integration

2016-03-31 Thread Tech Id
ks for the advice anyway. > > Regards > David > > -- > Date: Wed, 30 Mar 2016 21:33:38 +0300 > Subject: Re: Storm KafkaSpout Integration > From: spicoflo...@gmail.com > To: user@storm.apache.org > > hi, > i think the problem that you have

RE: Storm KafkaSpout Integration

2016-03-31 Thread david kavanagh
. RegardsDavid Date: Wed, 30 Mar 2016 21:33:38 +0300 Subject: Re: Storm KafkaSpout Integration From: spicoflo...@gmail.com To: user@storm.apache.org hi, i think the problem that you have is that you have stup one partition per topic, but you try to conume with 10 kafka task spouts. check this lines

Re: Storm KafkaSpout Integration

2016-03-30 Thread Spico Florin
derstanding you correctly, the line you told me to add in the first email should work because i am only creating one partition? > config.put(Config.TOPOLOGY_MAX_SPOUT_PENDING, 1); > Thanks again for the help :-) > David > ____ > Date: Wed, 30 Mar 2016 15:36:

Re: Storm KafkaSpout Integration

2016-03-30 Thread Sai Dilip Reddy Kiralam
917 [Thread-11-words] INFO backtype.storm.daemon.executor - Activating > spout words:(3) > 62005 [Thread-11-words] INFO backtype.storm.daemon.executor - Processing > received message source: __system:-1, stream: __tick, id: {}, [30] > 62013 [Thread-13-words] INFO backtype.storm.daem

RE: Storm KafkaSpout Integration

2016-03-30 Thread david kavanagh
ck, id: {}, [30]62013 [Thread-13-words] INFO backtype.storm.daemon.executor - Processing received message source: __system:-1, stream: __tick, id: {}, [30] Date: Wed, 30 Mar 2016 10:10:54 +0530 Subject: Re: Storm KafkaSpout Integration From: dkira...@aadhya-analytics.com To: user@storm.apache.org Hi

Re: Storm KafkaSpout Integration

2016-03-29 Thread Sai Dilip Reddy Kiralam
Hi david, I think everything is good but you are missing a statement config.put(Config.TOPOLOGY_MAX_SPOUT_PENDING, 1); add it after the line config.setDebug(true); *Best regards,* *K.Sai Dilip Reddy.* On Tue, Mar 29, 2016 at 10:03 PM, david kavanagh wrote: > Hi all, >