Re: To process a BIG input graph in giraph.

2014-03-05 Thread Claudio Martella
-vip /user/hadoop/input should be enough. On Wed, Mar 5, 2014 at 5:31 PM, Suijian Zhou suijian.z...@gmail.com wrote: Hi, Experts, Could anybody remind me how to load mutiple input files in a giraph command line? The following do not work, they only load the first input file: -vip

Re: To process a BIG input graph in giraph.

2014-03-05 Thread Suijian Zhou
Thanks Claudio, it works! By the way, I want to make clear the logic behind the graph loading of giraph. I.e: which one is true in the following: 1). The master node loads the entire graph into its memory and then split and distribute the blocks of the graph to all slave nodes. 2). All master and

Javadoc for Giraph-Hive

2014-03-05 Thread Gautham V
Hi Folks I'm not able to find the java doc for the Giraph-Hive jar. The below URL doesn't seem to work: https://giraph.apache.org/giraph-hive/apidocs/overview-summary.html Could someone please point me to the right location of the docs. Thanks in advance. -Gautham

Is it possible to know the mapper task a particular vertex is assigned to?

2014-03-05 Thread Pankaj Malhotra
Hi, How can I find the mapper task a particular vertex is assigned to? I can do this by doing a sysout and then looking at the logs. But there must be a smarter way to do this. Please suggest. Thanks, Pankaj

Re: Is it possible to know the mapper task a particular vertex is assigned to?

2014-03-05 Thread Roman Shaposhnik
On Wed, Mar 5, 2014 at 9:53 PM, Pankaj Malhotra pankajiit...@gmail.com wrote: Hi, How can I find the mapper task a particular vertex is assigned to? I can do this by doing a sysout and then looking at the logs. But there must be a smarter way to do this. Please suggest. That mapping is not

Re: Is it possible to know the mapper task a particular vertex is assigned to?

2014-03-05 Thread Pankaj Malhotra
There is a vertex with a large outgoing edge-list. I wanted to compare the memory usage, number of messages, and few other statistics for the worker with this vertex and the average statistics across workers. Does the mapping change within the same job? Thanks, Pankaj On 6 March 2014 11:38,