RE: [Solved] Giraph job hangs indefinitely and is eventually killed by JobTracker

2014-04-07 Thread Pavan Kumar A
] Giraph job hangs indefinitely and is eventually killed by JobTracker Hi, Thanks for the help! Turns out this was happening because /etc/hosts had an outdated IP address (dynamic) for the host that was being used as the master. Giraph was probably failing to communicate with the master

[Solved] Giraph job hangs indefinitely and is eventually killed by JobTracker

2014-04-07 Thread Vikesh Khanna
, Masters, Computer Science (Class of 2015) Stanford University - Original Message - From: "Vikesh Khanna" To: user@giraph.apache.org Sent: Monday, April 7, 2014 2:58:13 PM Subject: Re: Giraph job hangs indefinitely and is eventually killed by JobTracker @Pankaj, I am r

Re: Giraph job hangs indefinitely and is eventually killed by JobTracker

2014-04-07 Thread Vikesh Khanna
April 7, 2014 4:13:23 AM Subject: Re: Giraph job hangs indefinitely and is eventually killed by JobTracker Hi, Try making and analyzing memory dump after exception (JVM param -XX:+HeapDumpOnOutOfMemoryError ) What configuration (mainly Partition class) do you use ? Lukas On 7.4.2014 1

Re: Giraph job hangs indefinitely and is eventually killed by JobTracker

2014-04-07 Thread Lukas Nalezenec
(Class of 2015) Stanford University *From: *"Praveen kumar s.k" *To: *user@giraph.apache.org *Sent: *Thursday, April 3, 2014 4:40:07 PM *Subject: *Re: Giraph job hangs indefinitely and is eventually killed by JobTracker

Re: Giraph job hangs indefinitely and is eventually killed by JobTracker

2014-04-07 Thread Pankaj Malhotra
tuck indefinitely (and > eventually killed). I have attached the small log for the map task on 1 > worker. Would really appreciate if you can help understand the cause. > > Thanks, > Vikesh Khanna, > Masters, Computer Science (Class of 2015) > Stanford University > > > --

Re: Giraph job hangs indefinitely and is eventually killed by JobTracker

2014-04-07 Thread Vikesh Khanna
April 4, 2014 6:06:51 AM Subject: Re: Giraph job hangs indefinitely and is eventually killed by JobTracker Hi Avery, I tried both the options. It does appear to be a GC problem. The problem continues with the second option as well :(. I have attached the logs after enabling the first set

Re: Giraph job hangs indefinitely and is eventually killed by JobTracker

2014-04-03 Thread Avery Ching
: *user@giraph.apache.org *Sent: *Thursday, April 3, 2014 4:40:07 PM *Subject: *Re: Giraph job hangs indefinitely and is eventually killed by JobTracker You have given -w 30, make sure that that many number of map tasks are configured in your cluster On Thu, Apr 3, 2014 at 6:24 PM, Avery Ching

Re: Giraph job hangs indefinitely and is eventually killed by JobTracker

2014-04-03 Thread Vikesh Khanna
omputer Science (Class of 2015) Stanford University - Original Message - From: "Praveen kumar s.k" To: user@giraph.apache.org Sent: Thursday, April 3, 2014 4:40:07 PM Subject: Re: Giraph job hangs indefinitely and is eventually killed by JobTracker You have given -w 30,

Re: Giraph job hangs indefinitely and is eventually killed by JobTracker

2014-04-03 Thread Praveen kumar s.k
You have given -w 30, make sure that that many number of map tasks are configured in your cluster On Thu, Apr 3, 2014 at 6:24 PM, Avery Ching wrote: > My guess is that you don't get your resources. It would be very helpful to > print the master log. You can find it when the job is running to lo

Re: Giraph job hangs indefinitely and is eventually killed by JobTracker

2014-04-03 Thread Avery Ching
My guess is that you don't get your resources. It would be very helpful to print the master log. You can find it when the job is running to look at the Hadoop counters on the job UI page. Avery On 4/3/14, 12:49 PM, Vikesh Khanna wrote: Hi, I am running the PageRank benchmark under giraph-e

Giraph job hangs indefinitely and is eventually killed by JobTracker

2014-04-03 Thread Vikesh Khanna
Hi, I am running the PageRank benchmark under giraph-examples from giraph-1.0.0 release. I am using the following command to run the job (as mentioned here ) vikesh@madmax /lfs/madmax/0/vikesh/usr/local/giraph/giraph-examples/src/main/java/org/apache/giraph/examples $ $HADOOP_HOME/bin/hado