Re: Shared static data between bolts

2015-05-06 Thread Huy Le Van
Hi,Thanks Supun and Devang. After a little research, I think I’ll give Redis 3.0 a try. Best regards, Huy, Le Van On Wednesday, May 6, 2015 at 2:40 a.m., Devang Shah devangsha...@gmail.com, wrote: You can also use the power of  Zookeeper to share data across JVM's, much like what

Re: Shared static data between bolts

2015-05-05 Thread Huy Le Van
Could someone help me please? On Thursday, Apr 30, 2015 at 4:27 a.m., Huy Le Van huy.le...@insight-centre.org, wrote: Hi Michael, If a bolt of type A on a JVM modifies the shared data, will another bolt of type B on another JVM see the changes? To be clear, I have a use-case where I need

Re: Shared static data between bolts

2015-04-29 Thread Huy Le Van
database. In this case, can I still use this solution or do I need to use Hazelcast/Redis/Memcached? Best regards, Huy, Le Van On Thursday, Dec 4, 2014 at 8:53 p.m., Michael Rose mich...@fullcontact.com, wrote: Yes, as long as they're in the same JVM. If you have 4 workers, that's 4 JVMs

Re: TransactionalTridentKafkaSpout using only 1 executor

2014-12-11 Thread Huy Le Van
); Best regards,Huy, Le Van INSIGHT@ NUI Galway Lower Dangan, IDA Business Park,Galway, Ireland On Wednesday, Dec 10, 2014 at 6:52 p.m., P. Taylor Goetz ptgo...@gmail.com, wrote: Can you share your topology code? It sound like you may not be setting the parallelism hint in the right

Re: GC errors

2014-12-10 Thread Huy Le Van
Hi Kushan, This is an excellent tuning guide: https://gist.github.com/mrflip/5958028 . You can find the suggested ‘worker.childopts’ to put into storm.yaml there, which should eliminate the GC error. Best regards,Huy, Le Van On Wednesday, Dec 10, 2014 at 3:25 p.m., Jens-U. Mozdzen

Re: TransactionalTridentKafkaSpout using only 1 executor

2014-12-04 Thread Huy Le Van
Could someone help me please? Best regards,Huy, Le Van On Thursday, Dec 4, 2014 at 3:35 p.m., Huy Le Van huy.le...@insight-centre.org, wrote: Hi, I’m trying to tune Kafka Trident (Transactional) and seeing that the ‘spout0’ bolt uses only one executor. The problem is exactly

Re: TransactionalTridentKafkaSpout using only 1 executor

2014-12-04 Thread Huy Le Van
I just dumped from text files directly to kafka producer using bin/kafka-console-producer.sh so I guess the keys were all null. I’ll write a producer to see. By the way, what is the command to show the distribution of my data in kafka? Best regards,Huy, Le Van On Thursday, Dec 4