Re: Is it possible to know the mapper task a particular vertex is assigned to?

2014-03-06 Thread Claudio Martella
by default vertices stay where they are when they are loaded. On Thu, Mar 6, 2014 at 7:31 AM, Pankaj Malhotra pankajiit...@gmail.comwrote: There is a vertex with a large outgoing edge-list. I wanted to compare the memory usage, number of messages, and few other statistics for the worker with

Re: Is it possible to know the mapper task a particular vertex is assigned to?

2014-03-06 Thread Pankaj Malhotra
If that is so, then how to find the mapper task which has a particular vertex? Thanks, Pankaj On 6 March 2014 14:49, Claudio Martella claudio.marte...@gmail.com wrote: by default vertices stay where they are when they are loaded. On Thu, Mar 6, 2014 at 7:31 AM, Pankaj Malhotra

Is it possible to know the mapper task a particular vertex is assigned to?

2014-03-05 Thread Pankaj Malhotra
Hi, How can I find the mapper task a particular vertex is assigned to? I can do this by doing a sysout and then looking at the logs. But there must be a smarter way to do this. Please suggest. Thanks, Pankaj

Re: Is it possible to know the mapper task a particular vertex is assigned to?

2014-03-05 Thread Roman Shaposhnik
On Wed, Mar 5, 2014 at 9:53 PM, Pankaj Malhotra pankajiit...@gmail.com wrote: Hi, How can I find the mapper task a particular vertex is assigned to? I can do this by doing a sysout and then looking at the logs. But there must be a smarter way to do this. Please suggest. That mapping is not

Re: Is it possible to know the mapper task a particular vertex is assigned to?

2014-03-05 Thread Pankaj Malhotra
There is a vertex with a large outgoing edge-list. I wanted to compare the memory usage, number of messages, and few other statistics for the worker with this vertex and the average statistics across workers. Does the mapping change within the same job? Thanks, Pankaj On 6 March 2014 11:38,