understanding failing my job, Giraph/Hadoop memory usage, under-utilized nodes, and moving forward

Hi Folks, I've spent the last two months learning, installing, coding, and analyzing the performance of our Giraph app, and I'm able to run on small inputs on our tiny cluster (yay!) I am now stuck trying to figure out why larger inputs fail, why only some compute nodes are being used, and

Re: understanding failing my job, Giraph/Hadoop memory usage, under-utilized nodes, and moving forward

Sorry, should be *org.apache.giraph.utils.MemoryUtils.getRuntimeMemoryStats(), *I left out the giraph. On Mon, Sep 22, 2014 at 8:10 PM, Matthew Saltz sal...@gmail.com wrote: Hi Matthew, I answered a few of your questions in-line (unfortunately they might not help the larger problem, but

Re: understanding failing my job, Giraph/Hadoop memory usage, under-utilized nodes, and moving forward

Hi Matthew, I answered a few of your questions in-line (unfortunately they might not help the larger problem, but hopefully it'll help a bit). Best, Matthew On Mon, Sep 22, 2014 at 5:50 PM, Matthew Cornell m...@matthewcornell.org wrote: Hi Folks, I've spent the last two months learning,