Exception with Large Graphs

2013-08-29 Thread Yasser Altowim
Hi, I am implementing an algorithm using Giraph, and I was able to run my algorithm on relatively small datasets (64,000,000 vertices and 128,000,000 edges). However, when I increase the size of the dataset to 128,000,000 vertices and 256,000,000 edges, the job takes so much time to

Passing Custom Arguments for giraph.zkList

2013-08-29 Thread Ramani, Arun
Hi, I am trying to pass a zookeeper quorum to my giraph job and it throws the following exception: 13/08/29 13:14:38 INFO utils.ConfigurationUtils: No edge input format specified. Ensure your InputFormat does not require one. 13/08/29 13:14:38 INFO utils.ConfigurationUtils: No output format

Re: Passing Custom Arguments for giraph.zkList

2013-08-29 Thread Claudio Martella
zk1 is supposed to be a hostname. On Thu, Aug 29, 2013 at 11:05 PM, Ramani, Arun aram...@paypal.com wrote: Hi, I am trying to pass a zookeeper quorum to my giraph job and it throws the following exception: 13/08/29 13:14:38 INFO utils.ConfigurationUtils: No edge input format

Re: Passing Custom Arguments for giraph.zkList

2013-08-29 Thread Ramani, Arun
Hi Claudio, Yes zk1, zk2, zk3, zk4 and zk5 are all zookeeper hostnames. These 5 hosts make a zookeeper quorum. Please let me know how to pass this. Thanks Arun Ramani From: Claudio Martella claudio.marte...@gmail.commailto:claudio.marte...@gmail.com Reply-To:

Re: Passing Custom Arguments for giraph.zkList

2013-08-29 Thread Claudio Martella
the problem is not the format of the string, but the way you're passing it. Try passing it as -D giraph.zkList=... before the giraphrunner options. that should work. On Thu, Aug 29, 2013 at 11:47 PM, Ramani, Arun aram...@paypal.com wrote: Hi Claudio, Yes zk1, zk2, zk3, zk4 and zk5 are all