Re: zookeeper problem in giraph..

2014-04-04 Thread Lukas Nalezenec
BTW: This patch solves connection problems between workers, not with zookeeper but as you problem disappears when you dont sent messages the zookeeper problems may be secondary. On 5.4.2014 00:12, Lukas Nalezenec wrote: Hi, I had similar issue, it was caused by long GC pauses. I patched Nett

Re: Custom partitioning among workers

2014-04-04 Thread Lukas Nalezenec
Hi, Make labels be part of vertex id (I know, its limiting) then implement custom WorkerGraphPartitioner and MasterGraphPartitioner. Regards Lukas On 4.4.2014 13:59, Akshay Trivedi wrote: Hi all, I need help on partitioning graph. I input the graph and label it. Now I want that all vertices w

Re: zookeeper problem in giraph..

2014-04-04 Thread Lukas Nalezenec
Hi, I had similar issue, it was caused by long GC pauses. I patched NettyClient so when reconnect fails it sleeps for some time before next try. Patch is enclosed. Let me know if it works for you. I would try tuning GC. You can also try to use giraph.waitForRequestsConfirmation and giraph.maxN

Re: zookeeper problem in giraph..

2014-04-04 Thread Lukas Nalezenec
Hi, I had similar issue, it was caused by long GC pauses. I patched NettyClient so when reconnect fails it sleeps for some time before next try. Patch is enclosed. Let me know if it works for you. I would try tuning GC. You can also try to use giraph.waitForRequestsConfirmation and giraph.maxN

zookeeper problem in giraph..

2014-04-04 Thread Suijian Zhou
Hi, I have a zookeeper problem when running a giraph program, the program will be aborted in superstep 2 as: 14/04/04 15:44:48 INFO zookeeper.ClientCnxn: Opening socket connection to server compute-0-18.local/10.1.255.236:22181. Will not attempt to authenticate using SASL (unknown error) 14/04/04

Re: loading graph stuck.

2014-04-04 Thread Suijian Zhou
Hi, All, Thanks a lot, the problem is finally solved by replace the input format from Double to Int which saves memory. But new problem is that the program will be aborted in superstep 2 as: 14/04/04 10:45:39 INFO job.JobProgressTracker: Data from 5 workers - Compute superstep 2: 0 out of 3029732

Out of memory error in Graph on hadoop1.2.1

2014-04-04 Thread Arun Kumar
Hi while executing triangle count progrm over graph in a cluster of 8 server machines i am getting out of memory exception.My data size is of 1GB In my conf/hadoop-env.sh file i have updated the heapsize export HADOOP_HEAPSIZE=6000 even after that i am getting the below exception Can someone h

Custom partitioning among workers

2014-04-04 Thread Akshay Trivedi
Hi all, I need help on partitioning graph. I input the graph and label it. Now I want that all vertices with same label are assigned to a worker and no other vertices with different labels are assigned to the same worker. In this way each group of vertices having same label are assigned to an uniqu

Edge value types don't match

2014-04-04 Thread Agrta Rawat
Hi All, I am running my giraph code on Hadoop CDH-4.5 while the jar, I have built, is giraph-1.0.0-for-hadoop-2.0.0-cdh4.1.2-jar-with-dependencies.jar. When I run the code I get following exception- Exception in thread "main" java.lang.IllegalArgumentException: checkClassTypes: Edge value types

InternalVertexRunner vague exceptions

2014-04-04 Thread George Valkanas
Hi all, As part of the concurrent random walks that I'm implementing (see: https://issues.apache.org/jira/browse/GIRAPH-824 ), I am using the InternalVertexRunner to locally execute / test my code. Invoking: InternalVertexRunner.run(conf, graph) always returns null. After much digging / custom p