Trident Kafka Spout Performance Problem

2013-12-17 Thread Kidong Lee
Hi, I have performance problem with trident kafka spout. My trident topology looks like this: ... conf.put(Config.TOPOLOGY_TRIDENT_BATCH_EMIT_INTERVAL_MILLIS, 200); conf.put(RichSpoutBatchExecutor.MAX_BATCH_SIZE_CONF, 4* 1024); ... TridentKafkaConfig tridentKafkaConfig = new Tride

Re: Profiling a topology, Heapster and Ostrich

2013-12-17 Thread Patricio Echagüe
We use yourkit and it's been great so far. On Tue, Dec 17, 2013 at 12:05 PM, Serkan Uzunbaz wrote: > Hi all, > In my topology, one of the tasks of a bolt has a higher execute latency > than the other tasks of the same bolt. I am trying to find the root cause > by profiling the topology. > > Whi

is integration testing of custom serializer code without running a multi-node cluster possible?

2013-12-17 Thread Chris Bedford
Hi there - Is integration testing of custom serializer code without running a multi-node cluster possible? I am asking because I need to integration test various customer serializers we are writing for our current project. As I understand it, only if a spout or bolt is sending a tuple to a tuple

Profiling a topology, Heapster and Ostrich

2013-12-17 Thread Serkan Uzunbaz
Hi all, In my topology, one of the tasks of a bolt has a higher execute latency than the other tasks of the same bolt. I am trying to find the root cause by profiling the topology. Which tools would you suggest to profile the topology? I am planning to give Heapster and Ostrich a try. Has anyone i

Fwd: Deploying storm on cloud IAAS support

2013-12-17 Thread Spico Florin
Hello! I've seen on the storm tutorials that there is only one example of deployment of Storm in the Amazon Cloud. My questions are: 1.Is there any support for other cloud IAAS providers? If yes, who are they? 2. It is planned to support any other IAAS? I'll look forward for your answers.