Difference in Input format and Vertex type

2014-04-18 Thread Akshay Trivedi
Hi, Using giraph, I am taking input in the format TextDoubleDoubleAdjacencyListVertexInputFormat and I want my Vertex to be of type Vertex i.e vertex value in input is in DoubleWritable and in program it is of type Text. Can this be done in giraph i.e will giraph type cast it?? or what should I do

Starting a second computation

2014-04-18 Thread Schweiger, Tom
Hello Giraph list, I have a problem that has two steps. Step 2 needs to start after step 1 completes. Step 1 is completed when all the vertices have voted to halt and there are no more messages. I know I can switch my computes using a MasterCompute, but it is unclear how I re-awaken all th

RE: input superstep of giraph.

2014-04-18 Thread Pavan Kumar A
Btw, the jobs we run typically run for hours, so total time is mostly just sum of input + supersteps for us, since a very little extra time is negligible. However, I see your job itself is so small, so to be more accuratetotal time = time between start of your job (once all machines were allocat

RE: input superstep of giraph.

2014-04-18 Thread Pavan Kumar A
Please take a look at GIRAPH-838Note that there is a little window between end of one superstep & start of the other. So, this 120 s can be accounted for that. But what I meant was total time is as good as sum of input + other supersteps (though only approximately because of this slight extra ti

Re: input superstep of giraph.

2014-04-18 Thread ghufran malik
Hi Pavan, I might have misunderstood your explanation. But from the giraph timers I received, Total does not seem to be: sum of input time + sum of time in all supersteps For example the following timers were outputted after I ran the ConnectedComponents algorithm: Giraph Timers Initialize

Re: input superstep of giraph.

2014-04-18 Thread ghufran malik
Hi, Thank you for the explanation :) It was confusing when reading it, some of the timers I can intuitively understand, however I think it would be beneficial if these explanations were added to the API docs, then if anyone else is confused they can look up the meanings there. https://giraph.apa

RE: input superstep of giraph.

2014-04-18 Thread Pavan Kumar A
I wrote the Initialize counter :) Please tell me if the name seems confusing So,Initialize = the time spent by job waiting for resources. In a shared pool the job you launch may not get all the machines needed to start the job. So for instance you want to run a job with 200 workers, giraph does n

Re: input superstep of giraph.

2014-04-18 Thread ghufran malik
Hi, Could you also explain what the following timers correspond to as well please: Giraph Timers Initialize (ms)=775 Setup (ms)=105 Shutdown (ms)=12537 Total (ms)=27075 Thanks, Ghufran On Thu, Apr 17, 2014 at 9:10 PM, Pavan Kumar A wrote: > Input consists of > > reading the input (verti