I am new with Giraph and I am willing to using it in my project. I am
using hadoop 1.2.1.
I builded giraph with mvn package -Phadoop_1.0
-Dhadoop.version=1.2.1 -DskipTests --offline. I ran the
SimpleShortestPathsVertex example and all OK. With the same input I
tried the SimplePageRankVertex
Hi Andro,
Not sure if it helps -- maybe you can try to change the -of to -vof
on your command line. (i.e, the option flag in front of your
org.apache.giraph.io.formats.IdWithValueTextOutputFormat).
Wei
From: Andro Bermúdez Serrano andro.bermu...@gmail.com
To: user@giraph.apache.org,
Can you see the log of the job? Try TO /var/log or find w/ the job name,
job_date_002.
Il giorno 09/ott/2013 21:02, Wei Zhang w...@us.ibm.com ha scritto:
Hi Andro,
Not sure if it helps -- maybe you can try to change the -of to -vof
on your command line. (i.e, the option flag in front of
Try TO the jobtracker UI.
http://nameofthemaster:50030/.
You can find the job band a detailed log ...
Il giorno 09/ott/2013 21:18, Silvio Di gregorio
silvio.digrego...@gmail.com ha scritto:
Can you see the log of the job? Try TO /var/log or find w/ the job name,
job_date_002.
Il giorno
there are two failed map:
java.lang.Throwable: Child Error at
org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271) Caused
by: java.io.IOException: Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
and
There must be another error . See all file. Looking for ERROR no WARN.
Il giorno 09/ott/2013 22:06, Andro Bermúdez Serrano
andro.bermu...@gmail.com ha scritto:
there are two failed map:
java.lang.Throwable: Child Error at
org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271) Caused
Maybe the problem is with agregators. This is one of the exception throw
Caused by: java.lang.IllegalStateException: aggregate: Tried to access
aggregator which wasn't registered max; Aggregators can be registered
in MasterCompute.initialize by calling
registerAggregator(aggregatorName,
you need to define the mastercompute class (-mc option) which for your
example is that SimplePageRankVertexMasterCompute class within that same
vertex class.
On Wed, Oct 9, 2013 at 10:44 PM, Andro Bermúdez Serrano
andro.bermu...@gmail.com wrote:
Maybe the problem is with agregators. This is
Try VertexWithDoubleValueNullEdgeTextOutputFormat like output format. The
rank of the vertex is a double .
Il giorno 09/ott/2013 20:44, Andro Bermúdez Serrano
andro.bermu...@gmail.com ha scritto:
I am new with Giraph and I am willing to using it in my project. I am
using hadoop 1.2.1.
I
Hi Wei,
For best performance, please be sure to tune the GC settings, use
Java 7, tune the number of cores used for computation,
communication, etc. and the combiner.
We also have some numbers on our recent Facebook blog post.
This is how I used the mc option that I used, not sure if it helps.
-mc org.apache.giraph.examples.SimplePageRankComputation
\$SimplePageRankMasterCompute
Wei
From: Claudio Martella claudio.marte...@gmail.com
To: user@giraph.apache.org user@giraph.apache.org,
Date: 10/09/2013 05:00
Hi Avery,
Thanks a lot for the pointer! I haven't quite got to the point where I can
tune the Giraph performance yet (hopefully I can get there soon)
I am still at the early stage of finding/generating the right workload to
measure the performance. I am wondering is there some pointer (in
12 matches
Mail list logo