RE: FileNotFoundException: File _bsp/_defaultZkManagerDir/job_201308291126_0029/_zkServer does not exist.

2013-09-03 Thread Ken Williams
Hi Pradeep, Yes, the zookeeper server is definitely running, I can connect to it with the command-line client[root@localhost giraph]# zkCli.sh -server 127.0.0.1:2181Connecting to 127.0.0.1:21812013-09-03 11:15:45,987 [myid:] - INFO [main:Environment@100] - Client

Re: FileNotFoundException: File _bsp/_defaultZkManagerDir/job_201308291126_0029/_zkServer does not exist.

2013-09-03 Thread Claudio Martella
can you try defining the zookeeper manager directory from the command line? like this -D giraph.zkManagerDirectory=/path/in/hdfs/foobar you'll have to delete this directory by hand before each job. Just to see if it solves the problem. Then I could know how to fix it. On Tue, Sep 3, 2013 at

Re: FileNotFoundException: File _bsp/_defaultZkManagerDir/job_201308291126_0029/_zkServer does not exist.

2013-09-03 Thread Claudio Martella
try with the attached patch applied to trunk, without the mentioned -D giraph.zkManagerDirectory. On Tue, Sep 3, 2013 at 3:25 PM, Ken Williams zoo9...@hotmail.com wrote: Hi Claudio, I tried this but it made no difference. The map tasks still fail, still no output, and still an

Benchmarking Giraph

2013-09-03 Thread Alok Kumbhare
Hi, We are looking into some giraph benchmarks to compare against a similar programming model and framework we are working on. As a start we are planning to benchmark the following algorithms on data sets with more than a billion edges. 1. Single Source Shortest Path from a given source 2. Page

RE: Exception with Large Graphs

2013-09-03 Thread Yasser Altowim
Hi Avery, Thanks for your response. The data I am loading is almost 9 GB, and I have 10 nodes, each has a 4G of ram. Best, Yasser From: Avery Ching [mailto:ach...@apache.org] Sent: Friday, August 30, 2013 4:43 PM To: user@giraph.apache.org Subject: Re: Exception with Large Graphs That