Re: Send a map to all nodes

2012-04-03 Thread Radim Kolar
YARN in hadoop 0.23.1 can do this.

Re: Send a map to all nodes

2012-03-29 Thread Samir Eljazovic
Hi Luiz, you should consider Storm or S4for your purpose. In Storm you can create topology to run your algorithm on all nodes. HTH Samir On 29 March 2012 14:58, Luiz Carlos Muniz wrote: > Do not worry about this. > > My pro

Re: Send a map to all nodes

2012-03-29 Thread Luiz Carlos Muniz
Do not worry about this. My problem is just run an algorithm on all nodes in a grid. So I realized, hadoop does not serve for this purpose and I am already studying a alternative. If you have some suggestion I will be grateful. Luiz Carlos Melo Muniz 2012/3/29 Harsh J > Luiz, > > Though it

Re: Send a map to all nodes

2012-03-28 Thread Harsh J
Luiz, Though it is possible to 'hint' this by tweaking the InputSplits passed from the job, the default schedulers of Hadoop do not make any such guarantees and hence this isn't possible unless you write your own complete scheduler, an exercise that wouldn't suit production deployments unless you

Send a map to all nodes

2012-03-28 Thread Luiz Carlos Muniz
Hi, Is there any way to ensure the execution of a map on all nodes of a clusterin a way that each node run the map once and only once. That is, I would use Hadoop to execute a method on all nodes in the cluster. Without the possibility that the method execute twice in the same node even if another