Running the example in http://giraph.apache.org/quick_start.html

2013-10-09 Thread Andro Bermúdez Serrano
I am new with Giraph and I am willing to using it in my project. I am using hadoop 1.2.1. I builded giraph with mvn package -Phadoop_1.0 -Dhadoop.version=1.2.1 -DskipTests --offline. I ran the SimpleShortestPathsVertex example and all OK. With the same input I tried the SimplePageRankVertex

Re: Running the example in http://giraph.apache.org/quick_start.html

2013-10-09 Thread Wei Zhang
Hi Andro, Not sure if it helps -- maybe you can try to change the -of to -vof on your command line. (i.e, the option flag in front of your org.apache.giraph.io.formats.IdWithValueTextOutputFormat). Wei From: Andro Bermúdez Serrano andro.bermu...@gmail.com To: user@giraph.apache.org,

Re: Running the example in http://giraph.apache.org/quick_start.html

2013-10-09 Thread Silvio Di gregorio
Can you see the log of the job? Try TO /var/log or find w/ the job name, job_date_002. Il giorno 09/ott/2013 21:02, Wei Zhang w...@us.ibm.com ha scritto: Hi Andro, Not sure if it helps -- maybe you can try to change the -of to -vof on your command line. (i.e, the option flag in front of

Re: Running the example in http://giraph.apache.org/quick_start.html

2013-10-09 Thread Silvio Di gregorio
Try TO the jobtracker UI. http://nameofthemaster:50030/. You can find the job band a detailed log ... Il giorno 09/ott/2013 21:18, Silvio Di gregorio silvio.digrego...@gmail.com ha scritto: Can you see the log of the job? Try TO /var/log or find w/ the job name, job_date_002. Il giorno

Re: Running the example in http://giraph.apache.org/quick_start.html

2013-10-09 Thread Andro Bermúdez Serrano
there are two failed map: java.lang.Throwable: Child Error at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271) Caused by: java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258) and

Re: Running the example in http://giraph.apache.org/quick_start.html

2013-10-09 Thread Silvio Di gregorio
There must be another error . See all file. Looking for ERROR no WARN. Il giorno 09/ott/2013 22:06, Andro Bermúdez Serrano andro.bermu...@gmail.com ha scritto: there are two failed map: java.lang.Throwable: Child Error at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271) Caused

Re: Running the example in http://giraph.apache.org/quick_start.html

2013-10-09 Thread Andro Bermúdez Serrano
Maybe the problem is with agregators. This is one of the exception throw Caused by: java.lang.IllegalStateException: aggregate: Tried to access aggregator which wasn't registered max; Aggregators can be registered in MasterCompute.initialize by calling registerAggregator(aggregatorName,

Re: Running the example in http://giraph.apache.org/quick_start.html

2013-10-09 Thread Claudio Martella
you need to define the mastercompute class (-mc option) which for your example is that SimplePageRankVertexMasterCompute class within that same vertex class. On Wed, Oct 9, 2013 at 10:44 PM, Andro Bermúdez Serrano andro.bermu...@gmail.com wrote: Maybe the problem is with agregators. This is

Re: Running the example in http://giraph.apache.org/quick_start.html

2013-10-09 Thread Silvio Di gregorio
Try VertexWithDoubleValueNullEdgeTextOutputFormat like output format. The rank of the vertex is a double . Il giorno 09/ott/2013 20:44, Andro Bermúdez Serrano andro.bermu...@gmail.com ha scritto: I am new with Giraph and I am willing to using it in my project. I am using hadoop 1.2.1. I

Re: workload used to measure Giraph performance number

2013-10-09 Thread Avery Ching
Hi Wei, For best performance, please be sure to tune the GC settings, use Java 7, tune the number of cores used for computation, communication, etc. and the combiner. We also have some numbers on our recent Facebook blog post.

Re: Running the example in http://giraph.apache.org/quick_start.html

2013-10-09 Thread Wei Zhang
This is how I used the mc option that I used, not sure if it helps. -mc org.apache.giraph.examples.SimplePageRankComputation \$SimplePageRankMasterCompute Wei From: Claudio Martella claudio.marte...@gmail.com To: user@giraph.apache.org user@giraph.apache.org, Date: 10/09/2013 05:00

Re: workload used to measure Giraph performance number

2013-10-09 Thread Wei Zhang
Hi Avery, Thanks a lot for the pointer! I haven't quite got to the point where I can tune the Giraph performance yet (hopefully I can get there soon) I am still at the early stage of finding/generating the right workload to measure the performance. I am wondering is there some pointer (in