Re: Resource Allocation Model Of Apache Giraph

2014-10-24 Thread Matthew Saltz
-reduce job by using IdentityMapper to see how many mappers there. Thanks, Zhang, David (Paypal Risk) *From:* Charith Wickramarachchi [mailto:charith.dhanus...@gmail.com] *Sent:* 2014年10月24日 5:37 *To:* user *Subject:* Re: Resource Allocation Model Of Apache Giraph Thanks Claudio

Re: Resource Allocation Model Of Apache Giraph

2014-10-24 Thread Claudio Martella
, David (Paypal Risk) *From:* Charith Wickramarachchi [mailto:charith.dhanus...@gmail.com] *Sent:* 2014年10月24日 5:37 *To:* user *Subject:* Re: Resource Allocation Model Of Apache Giraph Thanks Claudio and Avery, I find a way way to configure hadoop to have desired number of mappers per

Resource Allocation Model Of Apache Giraph

2014-10-23 Thread Charith Wickramarachchi
Hi Folks, I'm wondering what is the resource allocation model for Apache Giraph. As I understand each worker is one to one Mapped with a Mapper and a worker can process multiple partitions with a user defined number of threads. Is it possible to make sure that one worker, only process a single

Re: Resource Allocation Model Of Apache Giraph

2014-10-23 Thread Claudio Martella
the maximum number of workers assigned to one machine (optimally one with multiple threads). On Thu, Oct 23, 2014 at 5:53 PM, Charith Wickramarachchi charith.dhanus...@gmail.com wrote: Hi Folks, I'm wondering what is the resource allocation model for Apache Giraph. As I understand each worker is one

Re: Resource Allocation Model Of Apache Giraph

2014-10-23 Thread Charith Wickramarachchi
your hadoop configuration to control the maximum number of workers assigned to one machine (optimally one with multiple threads). On Thu, Oct 23, 2014 at 5:53 PM, Charith Wickramarachchi charith.dhanus...@gmail.com wrote: Hi Folks, I'm wondering what is the resource allocation model