Re: out of core option

2013-12-05 Thread Ameya Vilankar
Each worker is allocated *mapred.child.java.opts *memory, which in your case is 4000M. Check if your server doesn't have enough memory for 2 Mappers. Also the out of memory option is available in two forms. 1. Out of core graph 2. Out of core messages. Currently you are setting only the out of

Re: out of core option

2013-12-05 Thread Rob Vesse
Sebastian You've made a minor typo in the configuration setting which means you haven't actually enabled out of core graph mode. You have giraph.useOutOfCoreGiraph when it should be giraph.useOutOfCoreGraph ­ note that the last word is Graph not Giraph Rob From: Sebastian Stipkovic

Re: out of core option

2013-12-05 Thread Sebastian Stipkovic
Hi Ameya, thanks for the answer. My allocated memory was too high. My server has altogether 4000M. I have turned the memory down to 2000M for each Mapper. Now I have set both out of core options and get the following exception: 2013-12-05 23:10:18,568 INFO org.apache.hadoop.mapred.JobTracker:

Re: out of core option

2013-12-05 Thread Sebastian Stipkovic
Hi Rob, embarrassing. You are right. But now I get with the correct option the following exception: 2013-12-05 23:10:18,568 INFO org.apache.hadoop.mapred.JobTracker: Adding task (MAP) 'attempt_201312052304_0001_m_01_0' to tip task_201312052304_0001_m_01, for tracker

Re: Issue while executing SimpleShortestPathsComputation

2013-12-05 Thread Yong Guo
Hi, I also got this error when tried to build Giraph on top of hadoop-2.2.0 using similar commands. Can anyone help? Thanks, Yong 2013/12/6 Rohit Bhat rohitbhat.n...@gmail.com I already have yarn (hadoop_2.2.0) on my machine. I tried the following 2 commands and got similar errors in both

Re: Issue while executing SimpleShortestPathsComputation

2013-12-05 Thread Yong Guo
Hi, I think it might be the Giraph version problem. When I tried to build giraph *1.0.0* on hadoop2.0.3-alpha, I can compile successfully by *mvn -Phadoop_yarn -Dhadoop.version=2.0.3-alpha clean package -DskipTests*. The command failed when I used giraph*1.1.0*. Thanks, Yong 2013/12/6 Yong

Re: Issue while executing SimpleShortestPathsComputation

2013-12-05 Thread Rohit Bhat
I am using giraph 1.0.0 but with yarn (hadoop 2.2.0) On Thu, Dec 5, 2013 at 5:49 PM, Yong Guo guoyongn...@gmail.com wrote: Hi, I think it might be the Giraph version problem. When I tried to build giraph*1.0.0* on hadoop2.0.3-alpha, I can compile successfully by *mvn -Phadoop_yarn

Re: Issue while executing SimpleShortestPathsComputation

2013-12-05 Thread Rohit Bhat
Can someone please confirm if giraph 1.0.0 works with hadoop-2.2.0? On Thu, Dec 5, 2013 at 5:58 PM, Rohit Bhat rohitbhat.n...@gmail.com wrote: I am using giraph 1.0.0 but with yarn (hadoop 2.2.0) On Thu, Dec 5, 2013 at 5:49 PM, Yong Guo guoyongn...@gmail.com wrote: Hi, I think it might