Hi Francisco, Thanks for the detailed reply. I will try this and update back.
In between, is there a way to defer sending messages until all the graph is created ? Regards, Mahesh Babu On Sun, Aug 11, 2013 at 1:04 AM, Francisco Sanches <[email protected]>wrote: > Hi Mahesh Babu > > You are trying to send a mesagem for vertex that has not been created yet. > Note the graph: > > # source destination > 1 5 > 1 7 > 2 1 > > When the vertex 1 to send a message to the 5 it will give this error > because the vertex 5 has not yet been created. To fix this would have to > change to the graph: > > # source destination > 1 2 > 1 5 > 1 7 > 2 1 > 5 1 > 7 1 > > This should fix the problem. At least when I had this problem I solved > well. I would recommend you run the example sometimes SSSP hama, and begin > their work by her. > > > 2013/8/10 Mahesh Babu <[email protected]> > > > Hi, > > > > My graph definition is as follows: > > Vertex<Text, IntWritable, StringIntPairWritable> > > VertexInputReader<LongWritable, Text, Text, IntWritable, > > StringIntPairWritable> > > with parseVertex(LongWritable key, Text value, Vertex<Text, > > IntWritable, StringIntPairWritable> vertex) > > > > and hence > > setInputKeyClass(LongWritable.class); > > setInputValueClass(Text.class); > > setOutputKeyClass(Text.class); > > setOutputValueClass(StringIntPairWritable.class); > > > > I am not sure why I decided InputKey to be LongWritable, just went by one > > of the examples and this parameter is unused in parseVertex > implementation. > > > > Is there something wrong with my definitions ? > > > > StringIntPairWritable is similar to IntIntPairWritable where I wanted the > > predecessor to be string type. > > > > My latest error is: > > 13/08/10 23:23:53 ERROR bsp.LocalBSPRunner: Exception during BSP > execution! > > java.lang.IllegalArgumentException: Messages must never be behind the > > vertex in ID! Current Message ID: five vs. fivehundredeighty > > at > > org.apache.hama.graph.GraphJobRunner.iterate(GraphJobRunner.java:284) > > at > > org.apache.hama.graph.GraphJobRunner.doSuperstep(GraphJobRunner.java:229) > > > > > > Regards, > > Mahesh Babu > > > > > > > > On Fri, Aug 9, 2013 at 8:35 PM, Mahesh Babu <[email protected]> wrote: > > > > > Hi, > > > > > > Can you help me understand: > > > 1) How to check input graph type > > > 2) How to debug partition jobs > > > > > > Insights would be helpful. > > > > > > Regards, > > > Mahesh Babu > > > > > > > > > On Fri, Aug 9, 2013 at 5:35 PM, Edward J. Yoon <[email protected] > > >wrote: > > > > > >> Hi, > > >> > > >> Integer ID (1, 2, ..) should be fine. As other people said, I think > > >> you need to check the input graph type. > > >> > > >> On Fri, Aug 9, 2013 at 8:50 PM, Mahesh Babu <[email protected]> wrote: > > >> > Hi Edward, > > >> > > > >> > I replaced node names from 1 to "one", 6288 to > > >> > "sixthousandtwohundredeightyeight", etc. > > >> > I am not getting the error now. so it may be something to do with > > number > > >> > itself being the name. > > >> > > > >> > Will monitor if I hit at this error once again. For now it is > working. > > >> > Proceeding with some more code changes. > > >> > > > >> > Thanks, > > >> > Mahesh Babu > > >> > > > >> > > > >> > On Fri, Aug 9, 2013 at 2:38 PM, Mahesh Babu <[email protected]> > wrote: > > >> > > > >> >> Hi Edward, > > >> >> > > >> >> In my case vertices are named with numbers. like 1,2,3...etc > itself. > > No > > >> >> alphabets in the vertex name, it is just 1 to 10000+ nodes > identified > > >> by > > >> >> the number itself. > > >> >> > > >> >> You think that could be reason ? > > >> >> > > >> >> Regards, > > >> >> Mahesh Babu > > >> >> > > >> >> > > >> >> On Fri, Aug 9, 2013 at 1:58 PM, Edward J. Yoon < > > [email protected] > > >> >wrote: > > >> >> > > >> >>> It occurs when the vertices are unsorted. > > >> >>> > > >> >>> Please check whether your vertex parser reads correctly, and > > >> >>> partitioning job was run before the graph job. > > >> >>> > > >> >>> On Fri, Aug 9, 2013 at 3:43 PM, Mahesh Babu <[email protected]> > > wrote: > > >> >>> > Hi, > > >> >>> > > > >> >>> > adding more details about the environment. > > >> >>> > > > >> >>> > When I run hama-examples-0.6.2.jar with tutorial example/input > > >> (berlin > > >> >>> > example) file it works without any error. > > >> >>> > > > >> >>> > Now when I try my own input file which has approximately 10k > nodes > > >> and > > >> >>> 39k > > >> >>> > edges but it fails with: > > >> >>> > > > >> >>> > java.lang.IllegalArgumentException: Messages must never > be > > >> >>> behind the > > >> >>> > vertex in ID! Current Message ID: 2 vs. 20 > > >> >>> > > > >> >>> > What am I doing wrong ? > > >> >>> > > > >> >>> > Any help/explanation is appreciated. > > >> >>> > > > >> >>> > Regards, > > >> >>> > Mahesh Babu > > >> >>> > > > >> >>> > > > >> >>> > > > >> >>> > > > >> >>> > On Thu, Aug 8, 2013 at 4:25 PM, Mahesh Babu <[email protected]> > > >> wrote: > > >> >>> >> > > >> >>> >> Hi, > > >> >>> >> > > >> >>> >> I followed the SSSP example, GraphJob example and getting > > following > > >> >>> error: > > >> >>> >> > > >> >>> >> 13/08/08 16:01:57 INFO bsp.BSPJobClient: Current supersteps > > >> number: 0 > > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > > >> mortbay.log: > > >> >>> >> Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) > via > > >> >>> >> org.mortbay.log.Slf4jLog > > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > > >> >>> >> sync.ZKSyncClient: Initializing ZK Sync Client > > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > > >> >>> >> sync.ZooKeeperSyncClientImpl: Start connecting to Zookeeper! At > > >> >>> >> localhost/127.0.0.1:61001 > > >> >>> >> > > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN > > >> >>> >> message.MessageTransferQueueFactory: Message queue is > configured > > on > > >> >>> >> deprecated parameter:hama.messenger.queue.class > > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN > > >> >>> >> message.MessageTransferQueueFactory: Message queue is > configured > > on > > >> >>> >> deprecated parameter:hama.messenger.queue.class > > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > > >> ipc.Server: > > >> >>> >> Starting SocketReader > > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > > >> ipc.Server: > > >> >>> IPC > > >> >>> >> Server Responder: starting > > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > > >> ipc.Server: > > >> >>> IPC > > >> >>> >> Server listener on 61001: starting > > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > > >> >>> >> message.HadoopMessageManagerImpl: BSPPeer address:localhost > > >> port:61001 > > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > > >> ipc.Server: > > >> >>> IPC > > >> >>> >> Server handler 0 on 61001: starting > > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > > >> >>> >> graph.GraphJobRunner: 4935 vertices are loaded into > > localhost:61001 > > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN > > >> >>> >> message.MessageTransferQueueFactory: Message queue is > configured > > on > > >> >>> >> deprecated parameter:hama.messenger.queue.class > > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN > > >> >>> >> message.MessageTransferQueueFactory: Message queue is > configured > > on > > >> >>> >> deprecated parameter:hama.messenger.queue.class > > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN > > >> >>> >> message.MessageTransferQueueFactory: Message queue is > configured > > on > > >> >>> >> deprecated parameter:hama.messenger.queue.class > > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN > > >> >>> >> message.MessageTransferQueueFactory: Message queue is > configured > > on > > >> >>> >> deprecated parameter:hama.messenger.queue.class > > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN > > >> >>> >> message.MessageTransferQueueFactory: Message queue is > configured > > on > > >> >>> >> deprecated parameter:hama.messenger.queue.class > > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 ERROR > > >> >>> bsp.BSPTask: > > >> >>> >> Error running bsp setup and bsp function. > > >> >>> >> attempt_201308081548_0005_000000_0: > > >> java.lang.IllegalArgumentException: > > >> >>> >> Messages must never be behind the vertex in ID! Current Message > > >> ID: 2 > > >> >>> vs. 20 > > >> >>> >> attempt_201308081548_0005_000000_0: at > > >> >>> >> > > >> org.apache.hama.graph.GraphJobRunner.iterate(GraphJobRunner.java:284) > > >> >>> >> attempt_201308081548_0005_000000_0: at > > >> >>> >> > > >> >>> > > >> > > org.apache.hama.graph.GraphJobRunner.doSuperstep(GraphJobRunner.java:229) > > >> >>> >> attempt_201308081548_0005_000000_0: at > > >> >>> >> > org.apache.hama.graph.GraphJobRunner.bsp(GraphJobRunner.java:133) > > >> >>> >> attempt_201308081548_0005_000000_0: at > > >> >>> >> org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:177) > > >> >>> >> attempt_201308081548_0005_000000_0: at > > >> >>> >> org.apache.hama.bsp.BSPTask.run(BSPTask.java:146) > > >> >>> >> attempt_201308081548_0005_000000_0: at > > >> >>> >> > > >> >>> > > >> > org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1262) > > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 WARN > > >> >>> >> message.MessageTransferQueueFactory: Message queue is > configured > > on > > >> >>> >> deprecated parameter:hama.messenger.queue.class > > >> >>> >> attempt_201308081548_0005_000000_0: 13/08/08 16:00:49 INFO > > >> ipc.Server: > > >> >>> >> Stopping server on 61001 > > >> >>> >> > > >> >>> >> > > >> >>> >> What could be the reason I am getting this error. > > >> >>> >> > > >> >>> >> I am able to run the code in eclipse/standalong environment. > > >> However, > > >> >>> when > > >> >>> >> I try to run with hama/hadoop pseudo distribution mode it > fails. > > >> >>> >> > > >> >>> >> Thanks, > > >> >>> >> Mahesh Babu > > >> >>> >> > > >> >>> > > > >> >>> > > >> >>> > > >> >>> > > >> >>> -- > > >> >>> Best Regards, Edward J. Yoon > > >> >>> @eddieyoon > > >> >>> > > >> >> > > >> >> > > >> > > >> > > >> > > >> -- > > >> Best Regards, Edward J. Yoon > > >> @eddieyoon > > >> > > > > > > > > > > > > -- > Francisco Sanches >
