Hi,
adding more details about the environment.
When I run hama-examples-0.6.2.jar with tutorial example/input (berlin
example) file it works without any error.
Now when I try my own input file which has approximately 10k nodes and 39k
edges but it fails with:
*java.lang.IllegalArgumentException: Messages must never be behind
the vertex in ID! Current Message ID: 2 vs. 20*
What am I doing wrong ?
Any help/explanation is appreciated.
Regards,
Mahesh Babu
On Thu, Aug 8, 2013 at 4:25 PM, Mahesh Babu <[email protected]> wrote:
> Hi,
>
> I followed the SSSP example, GraphJob example and getting following error:
>
> 13/08/08 16:01:57 INFO bsp.BSPJobClient: Current supersteps number: 0
> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO mortbay.log:
> Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
> org.mortbay.log.Slf4jLog
> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO
> sync.ZKSyncClient: Initializing ZK Sync Client
> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO
> sync.ZooKeeperSyncClientImpl: Start connecting to Zookeeper! At localhost/
> 127.0.0.1:61001
> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
> message.MessageTransferQueueFactory: Message queue is configured on
> deprecated parameter:hama.messenger.queue.class
> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
> message.MessageTransferQueueFactory: Message queue is configured on
> deprecated parameter:hama.messenger.queue.class
> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO ipc.Server:
> Starting SocketReader
> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO ipc.Server: IPC
> Server Responder: starting
> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO ipc.Server: IPC
> Server listener on 61001: starting
> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO
> message.HadoopMessageManagerImpl: BSPPeer address:localhost port:61001
> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO ipc.Server: IPC
> Server handler 0 on 61001: starting
> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO
> graph.GraphJobRunner: 4935 vertices are loaded into localhost:61001
> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
> message.MessageTransferQueueFactory: Message queue is configured on
> deprecated parameter:hama.messenger.queue.class
> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
> message.MessageTransferQueueFactory: Message queue is configured on
> deprecated parameter:hama.messenger.queue.class
> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
> message.MessageTransferQueueFactory: Message queue is configured on
> deprecated parameter:hama.messenger.queue.class
> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
> message.MessageTransferQueueFactory: Message queue is configured on
> deprecated parameter:hama.messenger.queue.class
> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
> message.MessageTransferQueueFactory: Message queue is configured on
> deprecated parameter:hama.messenger.queue.class
> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 ERROR bsp.BSPTask:
> Error running bsp setup and bsp function.
> attempt_201308081548_0005_000000_0: java.lang.IllegalArgumentException:
> Messages must never be behind the vertex in ID! Current Message ID: 2 vs. 20
> attempt_201308081548_0005_000000_0: at
> org.apache.hama.graph.GraphJobRunner.iterate(GraphJobRunner.java:284)
> attempt_201308081548_0005_000000_0: at
> org.apache.hama.graph.GraphJobRunner.doSuperstep(GraphJobRunner.java:229)
> attempt_201308081548_0005_000000_0: at
> org.apache.hama.graph.GraphJobRunner.bsp(GraphJobRunner.java:133)
> attempt_201308081548_0005_000000_0: at
> org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:177)
> attempt_201308081548_0005_000000_0: at
> org.apache.hama.bsp.BSPTask.run(BSPTask.java:146)
> attempt_201308081548_0005_000000_0: at
> org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1262)
> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN
> message.MessageTransferQueueFactory: Message queue is configured on
> deprecated parameter:hama.messenger.queue.class
> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO ipc.Server:
> Stopping server on 61001
>
>
> What could be the reason I am getting this error.
>
> I am able to run the code in eclipse/standalong environment. However, when
> I try to run with hama/hadoop pseudo distribution mode it fails.
>
> Thanks,
> Mahesh Babu
>
>
hduser@hama:/usr/local/hama$ bin/hama jar hama-examples-0.6.2.jar sssp 0
/home/hduser/hamaFormat/hama-p2p-Gnutella04.txt
/home/hduser/hamaOutput/hama-p2p-Gnutella04
13/08/09 12:00:36 INFO mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
13/08/09 12:00:37 INFO bsp.FileInputFormat: Total input paths to process : 1
13/08/09 12:00:37 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
13/08/09 12:00:37 WARN snappy.LoadSnappy: Snappy native library not loaded
13/08/09 12:00:37 INFO bsp.FileInputFormat: Total input paths to process : 1
13/08/09 12:00:37 INFO bsp.BSPJobClient: Running job: job_201308091056_0008
13/08/09 12:00:40 INFO bsp.BSPJobClient: Current supersteps number: 2
13/08/09 12:00:40 INFO bsp.BSPJobClient: The total number of supersteps: 2
13/08/09 12:00:40 INFO bsp.BSPJobClient: Counters: 6
13/08/09 12:00:40 INFO bsp.BSPJobClient:
org.apache.hama.bsp.JobInProgress$JobCounter
13/08/09 12:00:40 INFO bsp.BSPJobClient: SUPERSTEPS=2
13/08/09 12:00:40 INFO bsp.BSPJobClient: LAUNCHED_TASKS=1
13/08/09 12:00:40 INFO bsp.BSPJobClient:
org.apache.hama.bsp.BSPPeerImpl$PeerCounter
13/08/09 12:00:40 INFO bsp.BSPJobClient: SUPERSTEP_SUM=2
13/08/09 12:00:40 INFO bsp.BSPJobClient: TIME_IN_SYNC_MS=56
13/08/09 12:00:40 INFO bsp.BSPJobClient: IO_BYTES_READ=338163
13/08/09 12:00:40 INFO bsp.BSPJobClient: TASK_INPUT_RECORDS=4935
13/08/09 12:00:40 INFO bsp.FileInputFormat: Total input paths to process : 1
13/08/09 12:00:40 INFO bsp.BSPJobClient: Running job: job_201308091056_0007
13/08/09 12:00:43 INFO bsp.BSPJobClient: Current supersteps number: 2
13/08/09 12:01:53 INFO bsp.BSPJobClient: Current supersteps number: 0
attempt_201308091056_0007_000000_0: 13/08/09 12:00:41 INFO mortbay.log: Logging
to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 INFO sync.ZKSyncClient:
Initializing ZK Sync Client
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 INFO
sync.ZooKeeperSyncClientImpl: Start connecting to Zookeeper! At
localhost/127.0.0.1:61001
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 WARN
message.MessageTransferQueueFactory: Message queue is configured on deprecated
parameter:hama.messenger.queue.class
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 WARN
message.MessageTransferQueueFactory: Message queue is configured on deprecated
parameter:hama.messenger.queue.class
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 INFO ipc.Server: Starting
SocketReader
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 INFO ipc.Server: IPC
Server Responder: starting
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 INFO ipc.Server: IPC
Server listener on 61001: starting
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 INFO
message.HadoopMessageManagerImpl: BSPPeer address:localhost port:61001
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 INFO ipc.Server: IPC
Server handler 0 on 61001: starting
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 INFO
graph.GraphJobRunner: 4935 vertices are loaded into localhost:61001
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 WARN
message.MessageTransferQueueFactory: Message queue is configured on deprecated
parameter:hama.messenger.queue.class
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 WARN
message.MessageTransferQueueFactory: Message queue is configured on deprecated
parameter:hama.messenger.queue.class
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 WARN
message.MessageTransferQueueFactory: Message queue is configured on deprecated
parameter:hama.messenger.queue.class
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 WARN
message.MessageTransferQueueFactory: Message queue is configured on deprecated
parameter:hama.messenger.queue.class
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 WARN
message.MessageTransferQueueFactory: Message queue is configured on deprecated
parameter:hama.messenger.queue.class
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 ERROR bsp.BSPTask: Error
running bsp setup and bsp function.
attempt_201308091056_0007_000000_0: java.lang.IllegalArgumentException:
Messages must never be behind the vertex in ID! Current Message ID: 2 vs. 20
attempt_201308091056_0007_000000_0: at
org.apache.hama.graph.GraphJobRunner.iterate(GraphJobRunner.java:284)
attempt_201308091056_0007_000000_0: at
org.apache.hama.graph.GraphJobRunner.doSuperstep(GraphJobRunner.java:229)
attempt_201308091056_0007_000000_0: at
org.apache.hama.graph.GraphJobRunner.bsp(GraphJobRunner.java:133)
attempt_201308091056_0007_000000_0: at
org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:177)
attempt_201308091056_0007_000000_0: at
org.apache.hama.bsp.BSPTask.run(BSPTask.java:146)
attempt_201308091056_0007_000000_0: at
org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1262)
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 WARN
message.MessageTransferQueueFactory: Message queue is configured on deprecated
parameter:hama.messenger.queue.class
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 INFO ipc.Server: Stopping
server on 61001
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 INFO ipc.Server: IPC
Server handler 0 on 61001: exiting
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 INFO ipc.Server: Stopping
IPC Server listener on 61001
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 INFO ipc.Server: Stopping
IPC Server Responder
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 INFO
metrics.RpcInstrumentation: shut down
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 ERROR bsp.BSPTask:
Shutting down ping service.
attempt_201308091056_0007_000000_0: 13/08/09 12:00:42 FATAL bsp.GroomServer:
Error running child
attempt_201308091056_0007_000000_0: java.lang.IllegalArgumentException:
Messages must never be behind the vertex in ID! Current Message ID: 2 vs. 20
attempt_201308091056_0007_000000_0: at
org.apache.hama.graph.GraphJobRunner.iterate(GraphJobRunner.java:284)
attempt_201308091056_0007_000000_0: at
org.apache.hama.graph.GraphJobRunner.doSuperstep(GraphJobRunner.java:229)
attempt_201308091056_0007_000000_0: at
org.apache.hama.graph.GraphJobRunner.bsp(GraphJobRunner.java:133)
attempt_201308091056_0007_000000_0: at
org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:177)
attempt_201308091056_0007_000000_0: at
org.apache.hama.bsp.BSPTask.run(BSPTask.java:146)
attempt_201308091056_0007_000000_0: at
org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1262)
attempt_201308091056_0007_000000_0: java.lang.IllegalArgumentException:
Messages must never be behind the vertex in ID! Current Message ID: 2 vs. 20
attempt_201308091056_0007_000000_0: at
org.apache.hama.graph.GraphJobRunner.iterate(GraphJobRunner.java:284)
attempt_201308091056_0007_000000_0: at
org.apache.hama.graph.GraphJobRunner.doSuperstep(GraphJobRunner.java:229)
attempt_201308091056_0007_000000_0: at
org.apache.hama.graph.GraphJobRunner.bsp(GraphJobRunner.java:133)
attempt_201308091056_0007_000000_0: at
org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:177)
attempt_201308091056_0007_000000_0: at
org.apache.hama.bsp.BSPTask.run(BSPTask.java:146)
attempt_201308091056_0007_000000_0: at
org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1262)
13/08/09 12:01:53 INFO bsp.BSPJobClient: Job failed.
