Re: Writing my own aggregator..

...@gmail.comwrote: -- Forwarded message -- From: Ameya Vilankar ameya.vilan...@gmail.com Date: Fri, Jan 10, 2014 at 1:43 PM Subject: Re: Writing my own aggregator.. To: Jyoti Yadav rao.jyoti26ya...@gmail.com This should solve it I think. If it doesn't email me the error

Re: addEdgeRequest() - Already has missing vertex on this worker for X

I don't get what you are trying to solve here. If vertex A already has edges to B and C, what edges are your trying to add? Could you explain in detail what you are trying to do? You can call vertex.getEdges() to get an iterable list of edges where you know the the value on the edge and the

Re: Giraph waiting infinitely

Which branch of giraph are you using? Also, what InputFormatClass are you using? Since, you are using only 10 Mappers, go to jobtracker and the check the log for each mapper. There must be an error happening somewhere. On Tue, Dec 10, 2013 at 10:22 AM, Peter Morgan pmorgan...@gmail.com wrote:

Re: out of core option

Each worker is allocated *mapred.child.java.opts *memory, which in your case is 4000M. Check if your server doesn't have enough memory for 2 Mappers. Also the out of memory option is available in two forms. 1. Out of core graph 2. Out of core messages. Currently you are setting only the out of

Re: Compiling latest code for cdh4

maven compile checks and modify some code to catch and rewrap some missed checked exceptions. Was this necessary, or should the cdh4 profile work as-is? On Mon, Dec 2, 2013 at 4:45 PM, Ameya Vilankar ameya.vilan...@gmail.comwrote: Check out this link: http://www.cloudera.com/content

Re: Issue while executing SimpleShortestPathsComputation

Yes. Use this: mvn -Phadoop_cdh4.4.0 -DskipTests -Dmaven.javadoc.skip=true package On Mon, Dec 2, 2013 at 5:18 PM, Manuel Lagang manuellag...@gmail.comwrote: I get the same error when I compile Giraph against the default hadoop version (0.20.203.0), but my project that uses Giraph uses a

Re: about retaining the variable value...

In your scenario, you want to store some value that is obtained in Superstep 1, so that it is available to a vertex in all the subsequent supersteps. The best place to do that is to store it on the vertex itself. The simplest example is ShortesPath Example where you store the current lowest

Re: Giraph development in Eclipse

Hi, Do the following steps: 1. Clone the giraph repo from github 2. Checkout the trunk branch of the repository 3. Compile and package it using mvn clean package. You can use the profile that you require to package it. See the Giraph Readme on github or the pom.xml 4. Once it compiles correctly,

Figuring out if the program is halted

Hi, I want to check on the Master(i.e. in the MasterCompute Class) whether all the vertices have voted to halt and the program has terminated. For e.g. Suppose that I am running Connected Components. I want to run an aggregator when the algorithm has terminated that will count the number of

Re: Link Prediction with Giraph

Hi, You can look at the Facebook Link Prediction Challenge on Kaggle where you have to suggest links in a social Network. The link for the forum for the contest is: http://www.kaggle.com/c/FacebookRecruiting/forums It has a lot of interesting approaches. One of them can be found at the link below:

Running Giraph with out of core messages and combiners at the same time

of core messages and combiners working on those messages. I have to use run with out of core messages enabled because in the second superstep I cannot combine the messages and I want to run this on 100 Million users and the 100 Million items. Please Help me out. Thanks in advance. Ameya Vilankar Software