Hi,
I have built
giraph-1.0.0-for-hadoop-2.0.0-cdh4.1.2-jar-with-dependencies.jar. When I am
running my code on cluster where CDH-4.5 is installed, I am getting
java.lang.IncompatibleClassChangeError.
Exception in thread "main" java.lang.IncompatibleClassChangeError: Found
interface org.apache.ha
This is for a single worker it appears. Most likely your worker went
into GC and never returned. You can try with GC settings turned on, try
adding something like.
-XX:+PrintGC -XX:+PrintGCDateStamps -XX:+PrintGCDetails
-XX:+PrintGCTimeStamps -verbose:gc
You could also try the concurrent m
@Praveen,
Thanks for that! We are running the job with 1-3 worker(s) now. However, we are
still facing the same issue. Looks like someone has run into this earlier as
well -
http://mail-archives.apache.org/mod_mbox/giraph-user/201401.mbox/%3CetPan.52df59f4.46e87ccd.5dc0@LeeTaekyuui-MacBook-Pro
You have given -w 30, make sure that that many number of map tasks are
configured in your cluster
On Thu, Apr 3, 2014 at 6:24 PM, Avery Ching wrote:
> My guess is that you don't get your resources. It would be very helpful to
> print the master log. You can find it when the job is running to lo
My guess is that you don't get your resources. It would be very helpful
to print the master log. You can find it when the job is running to
look at the Hadoop counters on the job UI page.
Avery
On 4/3/14, 12:49 PM, Vikesh Khanna wrote:
Hi,
I am running the PageRank benchmark under giraph-e
Hi,
I am running the PageRank benchmark under giraph-examples from giraph-1.0.0
release. I am using the following command to run the job (as mentioned here )
vikesh@madmax
/lfs/madmax/0/vikesh/usr/local/giraph/giraph-examples/src/main/java/org/apache/giraph/examples
$ $HADOOP_HOME/bin/hado
Sorry I by accident sent that email before finishing it.
I tested the compute method with just:
public void compute(Vertex vertex,
Iterable messages) throws IOException
{
//check if its the first superstep
if (getSuperstep() == 0)
{
if(isStart(vertex))
{
vertex.setValue(new IntWritable((int
I just tested the compute method with just:
public void compute(Vertex vertex,
Iterable messages) throws IOException
{
//check if its the first superstep
if (getSuperstep() == 0)
{
if(isStart(vertex))
{
vertex.setValue(new IntWritable((int) getSuperstep()));
for (Edge edge : vertex.getEdges
After a while of those info jobs been printed this is printed out after:
14/04/03 17:01:25 INFO zookeeper.ClientCnxn: Unable to read additional data
from server sessionid 0x145284966610002, likely server has closed socket,
closing socket connection and attempting reconnect
14/04/03 17:01:26 INFO m
My Giraph job gets stuck at this point and will not go any further, that
log is what is continually printed out every 5 seconds. This log is coming
from the CombinedWorkerProgress class:
else if (isComputeSuperstep()) {
sb.append("Compute superstep ").append(currentSuperstep).append(": ");
How is that an error?
That¹s just some informational log statements from Giraph, you¹ll need to
provide the actual error message/describe the issue to get help with your
problem
Rob
From: ghufran malik
Reply-To:
Date: Thursday, 3 April 2014 16:09
To:
Subject: Master/Agreggators
> Hi,
>
Hi,
I received the error:
14/04/03 16:01:07 INFO mapred.JobClient: map 100% reduce 0%
14/04/03 16:01:11 INFO job.JobProgressTracker: Data from 1 workers -
Compute superstep 0: 0 out of 4 vertices computed; 0 out of 1 partitions
computed; min free memory on worker 1 - 106.6MB, average 106.6MB
14/
Also as to my original question I understand that I need to register an agg
to a master class to store a persistent list.
On Thu, Apr 3, 2014 at 2:13 PM, ghufran malik wrote:
> Hi,
>
> Lukas, I believe the queue list is essential to the BFS algorithm I am
> trying? I am following this explanatio
Hi,
Lukas, I believe the queue list is essential to the BFS algorithm I am
trying? I am following this explanation given here:
https://www.youtube.com/watch?v=zLZhSSXAwxI
So for my output I want to have the vertex id followed by the number
representing the order in which it was visited so vertex
Check this out for BFS..
http://stackoverflow.com/questions/12253794/breadth-first-implentation-in-giraph-graphchi-or-pregel
Nishant Gandhi
M.Tech CSE
IIT Patna
On Thu, Apr 3, 2014 at 3:18 PM, Lukas Nalezenec <
lukas.naleze...@firma.seznam.cz> wrote:
> Hi,
> It looks like you are using wrong
Hi,
Try finding master and check what is it doing in jobtracker.
Lukas
On 2.4.2014 23:58, Suijian Zhou wrote:
Hi,
Why the giraph program will stuck when loading input graph( the size
of the graph is 500MB, not so big)? No matter how I try different
number of workers( from -w 2 to -w 30) or
Hi,
It looks like you are using wrong algorithm. If you are doing simple BFS
you should not need to remember vertex ids.
Lukas
Lukas
On 2.4.2014 20:30, ghufran malik wrote:
Hi
I am trying to implement the BFS algorithm using Giraph 1.1.0.
I have partly implemented it and am stuck on just o
Maven usually places its downloads in the local
repository(~/.m2/repository) of each user. Check there.
On Thu, Apr 3, 2014 at 2:37 PM, Agrta Rawat wrote:
> Hi All,
>
> I have tried building giraph jar file without installing hadoop on my
> system. I succeeded and got the required giraph jar fo
Hi All,
I have tried building giraph jar file without installing hadoop on my
system. I succeeded and got the required giraph jar for hadoop.
But I have seen in the logs of "mvn compile" hadoop jar file for
hadioop-core, hadoop-common etc are downloaded. But when I checked it my
system, I could n
Hi
It depends on what you want to do with Giraph.
You don't necessary need to write custom PartitionerFactory. You would
need to turn on PartitionBalancer but its broken. I think I have already
found the bug, i will commit it soon. I you are really interested in
balancing I am writing advanced
Hi,
You have to make custom aggregator - Giraph is not designed for this use
case - this is little bit hacky.
I am not sure if MasterComputation is executed before first iteration.
Regards
Lukas
On 3.4.2014 09:16, Akshay Trivedi wrote:
rs at
org.apache.giraph.aggregators package but I am unab
Hi,
Thank you for the quick reply Lukas. I looked up aggregators at
org.apache.giraph.aggregators package but I am unable to find any
aggregator for graphs in that package. Can you tell me which
implementation of persistent aggregator I need to use or do I need to
implement a custom aggregator??
R
22 matches
Mail list logo
