Hi, Can you help me understand: 1) How to check input graph type 2) How to debug partition jobs
Insights would be helpful. Regards, Mahesh Babu On Fri, Aug 9, 2013 at 5:35 PM, Edward J. Yoon <[email protected]>wrote: > Hi, > > Integer ID (1, 2, ..) should be fine. As other people said, I think > you need to check the input graph type. > > On Fri, Aug 9, 2013 at 8:50 PM, Mahesh Babu <[email protected]> wrote: > > Hi Edward, > > > > I replaced node names from 1 to "one", 6288 to > > "sixthousandtwohundredeightyeight", etc. > > I am not getting the error now. so it may be something to do with number > > itself being the name. > > > > Will monitor if I hit at this error once again. For now it is working. > > Proceeding with some more code changes. > > > > Thanks, > > Mahesh Babu > > > > > > On Fri, Aug 9, 2013 at 2:38 PM, Mahesh Babu <[email protected]> wrote: > > > >> Hi Edward, > >> > >> In my case vertices are named with numbers. like 1,2,3...etc itself. No > >> alphabets in the vertex name, it is just 1 to 10000+ nodes identified by > >> the number itself. > >> > >> You think that could be reason ? > >> > >> Regards, > >> Mahesh Babu > >> > >> > >> On Fri, Aug 9, 2013 at 1:58 PM, Edward J. Yoon <[email protected] > >wrote: > >> > >>> It occurs when the vertices are unsorted. > >>> > >>> Please check whether your vertex parser reads correctly, and > >>> partitioning job was run before the graph job. > >>> > >>> On Fri, Aug 9, 2013 at 3:43 PM, Mahesh Babu <[email protected]> wrote: > >>> > Hi, > >>> > > >>> > adding more details about the environment. > >>> > > >>> > When I run hama-examples-0.6.2.jar with tutorial example/input > (berlin > >>> > example) file it works without any error. > >>> > > >>> > Now when I try my own input file which has approximately 10k nodes > and > >>> 39k > >>> > edges but it fails with: > >>> > > >>> > java.lang.IllegalArgumentException: Messages must never be > >>> behind the > >>> > vertex in ID! Current Message ID: 2 vs. 20 > >>> > > >>> > What am I doing wrong ? > >>> > > >>> > Any help/explanation is appreciated. > >>> > > >>> > Regards, > >>> > Mahesh Babu > >>> > > >>> > > >>> > > >>> > > >>> > On Thu, Aug 8, 2013 at 4:25 PM, Mahesh Babu <[email protected]> > wrote: > >>> >> > >>> >> Hi, > >>> >> > >>> >> I followed the SSSP example, GraphJob example and getting following > >>> error: > >>> >> > >>> >> 13/08/08 16:01:57 INFO bsp.BSPJobClient: Current supersteps number: > 0 > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > mortbay.log: > >>> >> Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via > >>> >> org.mortbay.log.Slf4jLog > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > >>> >> sync.ZKSyncClient: Initializing ZK Sync Client > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > >>> >> sync.ZooKeeperSyncClientImpl: Start connecting to Zookeeper! At > >>> >> localhost/127.0.0.1:61001 > >>> >> > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN > >>> >> message.MessageTransferQueueFactory: Message queue is configured on > >>> >> deprecated parameter:hama.messenger.queue.class > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN > >>> >> message.MessageTransferQueueFactory: Message queue is configured on > >>> >> deprecated parameter:hama.messenger.queue.class > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > ipc.Server: > >>> >> Starting SocketReader > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > ipc.Server: > >>> IPC > >>> >> Server Responder: starting > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > ipc.Server: > >>> IPC > >>> >> Server listener on 61001: starting > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > >>> >> message.HadoopMessageManagerImpl: BSPPeer address:localhost > port:61001 > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > ipc.Server: > >>> IPC > >>> >> Server handler 0 on 61001: starting > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > >>> >> graph.GraphJobRunner: 4935 vertices are loaded into localhost:61001 > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN > >>> >> message.MessageTransferQueueFactory: Message queue is configured on > >>> >> deprecated parameter:hama.messenger.queue.class > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN > >>> >> message.MessageTransferQueueFactory: Message queue is configured on > >>> >> deprecated parameter:hama.messenger.queue.class > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN > >>> >> message.MessageTransferQueueFactory: Message queue is configured on > >>> >> deprecated parameter:hama.messenger.queue.class > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN > >>> >> message.MessageTransferQueueFactory: Message queue is configured on > >>> >> deprecated parameter:hama.messenger.queue.class > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN > >>> >> message.MessageTransferQueueFactory: Message queue is configured on > >>> >> deprecated parameter:hama.messenger.queue.class > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 ERROR > >>> bsp.BSPTask: > >>> >> Error running bsp setup and bsp function. > >>> >> attempt_201308081548_0005_000000_0: > java.lang.IllegalArgumentException: > >>> >> Messages must never be behind the vertex in ID! Current Message ID: > 2 > >>> vs. 20 > >>> >> attempt_201308081548_0005_000000_0: at > >>> >> > org.apache.hama.graph.GraphJobRunner.iterate(GraphJobRunner.java:284) > >>> >> attempt_201308081548_0005_000000_0: at > >>> >> > >>> > org.apache.hama.graph.GraphJobRunner.doSuperstep(GraphJobRunner.java:229) > >>> >> attempt_201308081548_0005_000000_0: at > >>> >> org.apache.hama.graph.GraphJobRunner.bsp(GraphJobRunner.java:133) > >>> >> attempt_201308081548_0005_000000_0: at > >>> >> org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:177) > >>> >> attempt_201308081548_0005_000000_0: at > >>> >> org.apache.hama.bsp.BSPTask.run(BSPTask.java:146) > >>> >> attempt_201308081548_0005_000000_0: at > >>> >> > >>> > org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1262) > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN > >>> >> message.MessageTransferQueueFactory: Message queue is configured on > >>> >> deprecated parameter:hama.messenger.queue.class > >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > ipc.Server: > >>> >> Stopping server on 61001 > >>> >> > >>> >> > >>> >> What could be the reason I am getting this error. > >>> >> > >>> >> I am able to run the code in eclipse/standalong environment. > However, > >>> when > >>> >> I try to run with hama/hadoop pseudo distribution mode it fails. > >>> >> > >>> >> Thanks, > >>> >> Mahesh Babu > >>> >> > >>> > > >>> > >>> > >>> > >>> -- > >>> Best Regards, Edward J. Yoon > >>> @eddieyoon > >>> > >> > >> > > > > -- > Best Regards, Edward J. Yoon > @eddieyoon >
