Re: Reduce method called same key twice

2011-06-29 Thread Trevor Adams
.org > Subject: Re: Reduce method called same key twice > > So, that kind of makes sense but why would it not group the other values > then? There are a bunch of the exact same key (only 1 primary record, so > only 1 that is different per set) and it is my understanding that they woul

RE: Reduce method called same key twice

2011-06-29 Thread Aaron Baff
Adams [mailto:trevorad...@gmail.com] Sent: Wednesday, June 29, 2011 11:34 AM To: mapreduce-user@hadoop.apache.org Subject: Re: Reduce method called same key twice So, that kind of makes sense but why would it not group the other values then? There are a bunch of the exact same key (only 1 primary

Re: Reduce method called same key twice

2011-06-29 Thread Trevor Adams
So, that kind of makes sense but why would it not group the other values then? There are a bunch of the exact same key (only 1 primary record, so only 1 that is different per set) and it is my understanding that they would be grouped together (without the primary key) if I didn't do anything differ

RE: Reduce method called same key twice

2011-06-29 Thread Aaron Baff
You probably need to implement a custom comparator that you use as the grouping comparator that compares the primary key, and then if they are the same compares the int part of the key. --Aaron - From: Trevor Adams [mai