RE: how to design the mapper and reducer for the below problem

2013-06-16 Thread John Lilley
I don't think can be done in a single map/reduce pass. Here the author discusses an implementation in PIG: http://techblug.wordpress.com/2011/08/07/transitive-closure-in-pig/ john From: parnab kumar [mailto:parnab.2...@gmail.com] Sent: Thursday, June 13, 2013 10:42 PM To: user@hadoop.apache.org

RE: how to design the mapper and reducer for the below problem

2013-06-16 Thread John Lilley
Sorry this is the link I meant: http://hortonworks.com/blog/transitive-closure-in-apache-pig/ john From: John Lilley [mailto:john.lil...@redpoint.net] Sent: Sunday, June 16, 2013 1:02 PM To: user@hadoop.apache.org Subject: RE: how to design the mapper and reducer for the below problem I don't

Re: how to design the mapper and reducer for the below problem

2013-06-14 Thread Bhasker Allene
That looks like graph algorithms using MapReduce. Sorry couldn't give you specific answer! On 14/06/2013 05:41, parnab kumar wrote: Consider a following input file of format : input File : 1 2 2 3 3 4 6 7 7 9 10 11 The output Should be as follows : 1 2 3 4 6 7 9 10 11

Re: how to design the mapper and reducer for the below problem

2013-06-14 Thread Harsh J
Hey Parnab, Please checkout Giraph (http://giraph.apache.org), which should help you develop a program to solve this. On Fri, Jun 14, 2013 at 10:11 AM, parnab kumar parnab.2...@gmail.com wrote: Consider a following input file of format : input File : 1 2 2 3 3 4 6 7 7 9 10 11 The