Re: Zookeeper Problems when running Giraph (PageRankVertex) on large graphs.

2014-09-25 Thread Fontana, Peter C.
Hello, Thank you for the response. I tried to find the zookeeper logs from where the zookeeper servers store the data logs, but I have no entries with that date. I used echo conf | nc server port To find the log directory, and then used java org.apache.zookeeper.server.LogFormatter To read

Re: understanding failing my job, Giraph/Hadoop memory usage, under-utilized nodes, and moving forward

2014-09-25 Thread Matthew Cornell
On Mon, Sep 22, 2014 at 2:10 PM, Matthew Saltz wrote: > In the logs for the workers, do you have a line that looks like: > 2014-09-21 18:12:13,021 INFO org.apache.giraph.worker.BspServiceWorker: > finishSuperstep: Waiting on all requests, superstep 93 Memory > (free/total/max) = 21951.08M / 36456.

Re: receiving messages that I didn't send

2014-09-25 Thread Matthew Cornell
Thanks for replying, Pavan. I figured out that my message Writable (an ArrayListWritable) needed to call clear() in readFields() before calling super(): @Override public void readFields(DataInput in) throws IOException { clear(); super.readFields(in); } This was an 'of