Re: can merge-with return a map with duplicate keys?

2010-09-14 Thread Stuart Halloway
Could you try the numeric keys against the master branch? The num/prim/equiv changes should help with this. Stu > Interesting possibility, hard for me to test for directly. But > following that idea, I changed the keys to strings and the problem > went away, so I'm happy :) Thanks! > > > > On

Re: can merge-with return a map with duplicate keys?

2010-09-14 Thread kovas boguta
Interesting possibility, hard for me to test for directly. But following that idea, I changed the keys to strings and the problem went away, so I'm happy :) Thanks! On Tue, Sep 14, 2010 at 4:45 AM, Stuart Halloway wrote: > Can you look at the class of these keys and see if some are Long while o

can merge-with return a map with duplicate keys?

2010-09-14 Thread kovas boguta
I'm running a large hadoop job in which merge-with is called millions of times to aggregate values among about 1000 keys. Basically we are counting the number of times the keys occur among all entries and using merge-with as the reduce function. In the output, the keys are often duplicated (I've a

Re: can merge-with return a map with duplicate keys?

2010-09-14 Thread Stuart Halloway
Can you look at the class of these keys and see if some are Long while others are Integer? Stu > I'm running a large hadoop job in which merge-with is called millions > of times to aggregate values among about 1000 keys. Basically we are > counting the number of times the keys occur among all en