Which branch of giraph are you using? Also, what InputFormatClass are you using? Since, you are using only 10 Mappers, go to jobtracker and the check the log for each mapper. There must be an error happening somewhere.
On Tue, Dec 10, 2013 at 10:22 AM, Peter Morgan <pmorgan...@gmail.com> wrote: > I get a similar problem running my own algorithm. > It works on a small set of data and around 10 workers, but scaling it up, > I get lots of logs like above, and the job sits infinitely. > It is happening on the input read for me, usually around half of the > workers finish, and half have those logs. > > > On Wed, Dec 4, 2013 at 9:41 AM, Rafal Wojdyla <r...@spotify.com> wrote: > >> Hi! >> >> I use Giraph trunk (1.1.0) with java 1.6 and hadoop 2.2.0.x and I try to >> run the example from http://giraph.apache.org/quick_start.html on the >> example data from the page - I have the same problem. So I started this >> issue: https://issues.apache.org/jira/browse/GIRAPH-806 >> >> Cheers - Rafal >> >> >> On Tue, Dec 3, 2013 at 8:46 PM, Manuel Lagang <manuellag...@gmail.com>wrote: >> >>> If you expected your job to take a while and you just want to make sure >>> the job doesn't fail due to timeouts, you can set the hadoop parameter " >>> mapreduce.task.timeout" to a higher value or to 0 for no timeouts at >>> all. >>> >>> If you didn't expect your job to take a while on a single worker, it's >>> hard to figure out what went wrong without more context on your code or >>> what stage the job is failing (during input loading? which superstep?). >>> >>> >>> On Tue, Dec 3, 2013 at 11:19 AM, Sundara Raghavan Sankaran < >>> sun...@crayondata.com> wrote: >>> >>>> Hi, >>>> >>>> In my giraph job, one of the workers just outputs the same log >>>> repeatedly and ultimately the job fails because of it not reporting its >>>> status. >>>> >>>> Here is the log:- >>>> >>>> 2013-12-03 19:01:01,159 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Future result not ready yet >>>> java.util.concurrent.FutureTask@4281de5c >>>> 2013-12-03 19:01:01,159 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Waiting for >>>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>>> 2013-12-03 19:02:01,159 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Future result not ready yet >>>> java.util.concurrent.FutureTask@4281de5c >>>> 2013-12-03 19:02:01,159 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Waiting for >>>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>>> 2013-12-03 19:03:01,159 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Future result not ready yet >>>> java.util.concurrent.FutureTask@4281de5c >>>> 2013-12-03 19:03:01,160 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Waiting for >>>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>>> 2013-12-03 19:04:01,160 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Future result not ready yet >>>> java.util.concurrent.FutureTask@4281de5c >>>> 2013-12-03 19:04:01,160 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Waiting for >>>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>>> 2013-12-03 19:05:01,160 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Future result not ready yet >>>> java.util.concurrent.FutureTask@4281de5c >>>> 2013-12-03 19:05:01,160 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Waiting for >>>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>>> 2013-12-03 19:06:01,161 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Future result not ready yet >>>> java.util.concurrent.FutureTask@4281de5c >>>> 2013-12-03 19:06:01,161 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Waiting for >>>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>>> 2013-12-03 19:07:01,161 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Future result not ready yet >>>> java.util.concurrent.FutureTask@4281de5c >>>> 2013-12-03 19:07:01,161 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Waiting for >>>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>>> 2013-12-03 19:08:01,161 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Future result not ready yet >>>> java.util.concurrent.FutureTask@4281de5c >>>> 2013-12-03 19:08:01,162 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Waiting for >>>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>>> 2013-12-03 19:09:01,162 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Future result not ready yet >>>> java.util.concurrent.FutureTask@4281de5c >>>> 2013-12-03 19:09:01,162 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Waiting for >>>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>>> 2013-12-03 19:10:01,162 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Future result not ready yet >>>> java.util.concurrent.FutureTask@4281de5c >>>> 2013-12-03 19:10:01,162 INFO org.apache.giraph.utils.ProgressableUtils: >>>> waitFor: Waiting for >>>> org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5c2d8c20 >>>> >>>> What is going on? Is there something I can do so that it doesn't happen. >>>> >>>> >>>> -- >>>> >>>> Thanks, >>>> >>>> Sundar >>>> >>> >>> >> >
