Re: Can you help on this about performance of topology

2016-11-16 Thread sam mohel
sure , as Rudraneel said 1. How many topologies? >> one 2. What are the workload parameters (e.g. tuple arrival rate, number of executors per component, size of each tuple) >> ​ 3. System environment ( Number of cores in each supervisor node, Available RAM) >> I have numbis working on 8 GB RAM but

Re: Can you help on this about performance of topology

2016-11-16 Thread Manu Zhang
Hi Sam, Could you share you topology ? More background information will help us to understand your problem. And what kind of performance do you want to achieve, low latency or high throughput ? Cheers, Manu Zhang On Thu, Nov 17, 2016 at 5:34 AM sam mohel wrote: > Please .Is there any help ? >

Re: KafkaBolt JSON Serializer Problem

2016-11-16 Thread Zhechao Ma
Change the JSONObject import to import org.apache.storm.shade.org.json.simple.JSONObject; Resolved. The missing exception stack information quiet misleads me ! 2016-11-17 12:38 GMT+08:00 Zhechao Ma : > I modify code in KafkaProducer.java to catch the exception stack, and > finally get the re

Re: KafkaBolt JSON Serializer Problem

2016-11-16 Thread Zhechao Ma
I modify code in KafkaProducer.java to catch the exception stack, and finally get the real Exception cause. java.lang.ClassCastException: org.apache.storm.shade.org.json.simple.JSONObject cannot be cast to org.json.simple.JSONObject So this problem is related to the maven shade plugin. 2016-11-

Re: Can you help on this about performance of topology

2016-11-16 Thread sam mohel
Thanks for your help On Thursday, November 17, 2016, Rudraneel chakraborty < rudraneel.chakrabo...@gmail.com> wrote: > Hi, > > For any kin of performance analysis, first determine the following > 1. How many topologies? > 2. What are the workload parameters (e.g. tuple arrival rate, number of > e

Re: Can you help on this about performance of topology

2016-11-16 Thread Rudraneel chakraborty
Hi, For any kin of performance analysis, first determine the following 1. How many topologies? 2. What are the workload parameters (e.g. tuple arrival rate, number of executors per component, size of each tuple) 3. System environment ( Number of cores in each supervisor node, Available RAM) 4. Wha

Re: Can you help on this about performance of topology

2016-11-16 Thread Matt Lowe
Performance in what way? If you mean from the storm Twitter example, that is part of the business logic. It is a way of filtering. Best Regards Matthew Lowe > On 16 Nov 2016, at 22:34, sam mohel wrote: > > Please .Is there any help ? > >> On Wednesday, November 16, 2016, sam mohel wrote: >

Re: Can you help on this about performance of topology

2016-11-16 Thread sam mohel
Please .Is there any help ? On Wednesday, November 16, 2016, sam mohel wrote: > How can algoritm like" text similarity between tweets" affect on the > performance of storm topology ?

Having the Nimbus and a worker on the same node of the cluster

2016-11-16 Thread Dominik Safaric
Hi, It is generally recommended for streaming engines, also including Storm to run a separate master node - in the case of Storm, the Nimbus. However, why should one in Storm run the Nimbus on a separate node? Performance wise, the Nimbus isn’t intense unlike of course workers. In terms of

unsubscribe

2016-11-16 Thread Andrew Anderson
Unsubscribe

Can you help on this about performance of topology

2016-11-16 Thread sam mohel
How can algoritm like" text similarity between tweets" affect on the performance of storm topology ?

Re: KafkaBolt JSON Serializer Problem

2016-11-16 Thread Zhechao Ma
Hi Amber, Here is the code. Properties prop = new Properties(); prop.put("bootstrap.servers", kafkaBrokers); prop.put("ack", ack); prop.put("key.serializer", keySerializer); prop.put("value.serializer", valueSerializer); KafkaBolt kafkaBolt = new KafkaBolt() .withProducerProperti