The job eventually fails because of out-of-hearbeat from tasks:
Task attempt_201309262131_0001_m_58_0 failed to report status for
602 seconds. Killing!
Any suggestions?
Yingyi
On Thu, Sep 26, 2013 at 3:27 PM, Yingyi Bu wrote:
> I checked several other slave machines.
> Basically the map
I checked several other slave machines.
Basically the map task is waiting on this trace:
"main" prio=10 tid=0x098ed000 nid=0x7beb in Object.wait()
[0x413e7000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- wai
Hopefully you are using combiners and also re-using objects. This can
keep memory usage much lower. Also implementing your own OutEdges can
make it much more efficient.
How much memory do you have?
Avery
On 9/26/13 12:51 PM, Yingyi Bu wrote:
>> I think you may have added the same vertex 2x?
>> I think you may have added the same vertex 2x?
I ran the job over roughly half of the graph and saw this. However the
input is not a connected components such that there might be target vertex
ids which do not exist.
When I ran the job over the entire graph, I cannot see this but the job
fails
I think you may have added the same vertex 2x? That being said, I don't
see why the code is this way. It should be fine. We should file a JIRA.
On 9/26/13 11:02 AM, Yingyi Bu wrote:
Thanks, Lukas!
I think the reason of this exception is that I run the job over part
of the graph where some t
Thanks, Lukas!
I think the reason of this exception is that I run the job over part of the
graph where some target ids do not exist.
Yingyi
On Thu, Sep 26, 2013 at 1:13 AM, Lukas Nalezenec <
lukas.naleze...@firma.seznam.cz> wrote:
> Hi,
> Do you use partition balancing ?
> Lukas
>
>
>
> On 09/
Hi,
Do you use partition balancing ?
Lukas
On 09/26/13 05:16, Yingyi Bu wrote:
Hi,
I got this exception when I ran a Giraph-1.0.0 PageRank job over a 60 machine
cluster with 28GB input data. But I got this exception:
java.lang.IllegalStateException: run: Caught an unrecoverable exception
re
Hi,
I got this exception when I ran a Giraph-1.0.0 PageRank job over a 60
machine cluster with 28GB input data. But I got this exception:
java.lang.IllegalStateException: run: Caught an unrecoverable
exception resolveMutations: Already has missing vertex on this worker
for 20464109
at or
