Re: Giraph avro input format

2014-02-18 Thread Roman Shaposhnik
It would be interesting to see what can be done with Avro in Giraph natively along the lines of: http://avro.apache.org/docs/1.7.6/mr.html Thanks, Roman. On Mon, Feb 17, 2014 at 11:49 AM, Claudio Martella wrote: > I'm not sure about what I'm going to say, but Gora should read from Avro, > and

Re: debugging graph-programs

2014-02-18 Thread Roman Shaposhnik
Well, then you should really use this approach: https://git-wip-us.apache.org/repos/asf?p=giraph.git;a=blob;f=giraph-examples/src/test/java/org/apache/giraph/examples/SimpleShortestPathsComputationTest.java;h=dc6c84aeda01283c5d29d2787e89fa01fbe65241;hb=HEAD#l114 Thanks, Roman. On Tue, Feb 1

Re: debugging graph-programs

2014-02-18 Thread Martin Neumann
@ Lukas: Do you have some links where I can read how to use it to debug programs? My current program has a lot of logic in the EdgeInputFormat as well that was why I was looking at MapReduce tools since loading the data uses the same classes (as far as I can see). But I agree its a rather desperat

Re: debugging graph-programs

2014-02-18 Thread Lukas Nalezenec
Hi, How about org.apache.giraph.utils.TestGraph? I would not try using mrunit for testing Giraph. cheers Lukas On 18.2.2014 17:01, Mirko Kämpf wrote: Hi Martin, it depends on the details of your implementation. In principle, you do not write Mapper and Reducer classes, which are tested by MR

Re: debugging graph-programs

2014-02-18 Thread Mirko Kämpf
Hi Martin, it depends on the details of your implementation. In principle, you do not write Mapper and Reducer classes, which are tested by MR-Unit. You usually have to implement the application / algorithm specific logic, in e.g. the Vertex class. MR-Unit might not help that much here. This lead

Re: debugging graph-programs

2014-02-18 Thread Martin Neumann
How much of the Giraph 1.1.0 version is still based on MapReduce? Would something like mrunit (http://mrunit.apache.org/) work with it? On Tue, Feb 18, 2014 at 12:52 PM, Martin Neumann wrote: > I'm using the Yarn version (1.1.0 trunk) and I was not able to get it to > work that way. But I'm no

Re: debugging graph-programs

2014-02-18 Thread Martin Neumann
I'm using the Yarn version (1.1.0 trunk) and I was not able to get it to work that way. But I'm no expert on that, if anyone knows a way to get it done It would be great. On Tue, Feb 18, 2014 at 2:07 AM, Roman Shaposhnik wrote: > I find running Giraph apps via hadoop's local execution mode > qu