Re: To process a BIG input graph in giraph.

2014-03-05 Thread Claudio Martella
-vip /user/hadoop/input should be enough. On Wed, Mar 5, 2014 at 5:31 PM, Suijian Zhou suijian.z...@gmail.com wrote: Hi, Experts, Could anybody remind me how to load mutiple input files in a giraph command line? The following do not work, they only load the first input file: -vip

Re: To process a BIG input graph in giraph.

2014-03-05 Thread Suijian Zhou
Thanks Claudio, it works! By the way, I want to make clear the logic behind the graph loading of giraph. I.e: which one is true in the following: 1). The master node loads the entire graph into its memory and then split and distribute the blocks of the graph to all slave nodes. 2). All master and

To process a BIG input graph in giraph.

2014-03-01 Thread Suijian Zhou
Hi, Here I'm trying to process a very big input file through giraph, ~70GB. I'm running the giraph program on a 40 nodes linux cluster but the program just get stuck there after it read in a small fraction of the input file. Although each node has 16GB mem, it looks that only one node read the