Re: Zookeeper Problems when running Giraph (PageRankVertex) on large graphs.

2014-10-10 Thread Fontana, Peter C.
org>> Subject: Re: Zookeeper Problems when running Giraph (PageRankVertex) on large graphs. Hello, Thank you for the response. I tried to find the zookeeper logs from where the zookeeper servers store the data logs, but I have no entries with that date. I used echo conf | nc server port To find

Re: Zookeeper Problems when running Giraph (PageRankVertex) on large graphs.

2014-09-25 Thread Fontana, Peter C.
gt;> Date: Wednesday, September 24, 2014 at 8:50 AM To: user Giraph Mailing List mailto:user@giraph.apache.org>> Subject: Re: Zookeeper Problems when running Giraph (PageRankVertex) on large graphs. Hi, I had similar problems. Files that Giraph wrote to zookeeper were over limit so zookee

Re: Zookeeper Problems when running Giraph (PageRankVertex) on large graphs.

2014-09-24 Thread Lukas Nalezenec
Hi, I had similar problems. Files that Giraph wrote to zookeeper were over limit so zookeeper crushed. In my case i had too many partitions with too long input and checkpoint paths. You can try to get logs from the Zookeeper process. Lukas On 24.9.2014 14:31, Fontana, Peter C. wrote: Hello,

Zookeeper Problems when running Giraph (PageRankVertex) on large graphs.

2014-09-24 Thread Fontana, Peter C.
Hello, I am trying to run the PageRankVertex code on a large graph. I successfully got it to run on smaller examples, but when I try to run it on a large example (100M nodes, 10B edges, 300GB space), it does not finish. I get the following error. java.lang.IllegalStateException: run: Caught an