CompositeInputFormat scalbility

2009-06-24 Thread pmg
/CompositeInputFormat-scalbility-tp24192957p24192957.html Sent from the Hadoop core-user mailing list archive at Nabble.com.

Re: CompositeInputFormat scalbility

2009-06-24 Thread jason hadoop
.g. comparing > 724101722493 with 5026328101569 using some heuristics. > > thanks > -- > View this message in context: > http://www.nabble.com/CompositeInputFormat-scalbility-tp24192957p24192957.html > Sent from the Hadoop core-user mailing list archive at Nabble.com. > >

Re: CompositeInputFormat scalbility

2009-06-24 Thread pmg
result into different nodes where I can compare the tuples e.g. comparing >> 724101722493 with 5026328101569 using some heuristics. >> >> thanks >> -- >> View this message in context: >> http://www.nabble.com/CompositeInputFormat-scalbility-tp24192957p24192957.html >&g

Re: CompositeInputFormat scalbility

2009-06-24 Thread jason hadoop
[781676672721,5026328101569] > >> 123[781676672721,5026328001562] > >> > >> How does CompositeInputFormat scale when we want to join 600K with 2 > >> millions records. Does it run on the node with single map/reduce? > >> > >> Also how can