Re: Sorting Values sent to reducer NOT based on KEY (Depending on part of VALUE)

2013-04-23 Thread Sofia Georgiakaki
Hello, Sorting is done by the SortingComparator which performs sorting based on the value of key. A possible solution would be the following: You could write a custom Writable comparable class which extends WritableComparable (lets call it MyCompositeFieldWritableComparable), that will store

Re: Sorting Values sent to reducer NOT based on KEY (Depending on part of VALUE)

2013-04-23 Thread Vikas Jadhav
Thanks for reply. Will try to implement. I think there is problem in my case where i have modified write function of mapper context.write and tried to write same key value pair multiple times.Also for this purpose i have modified partitioner class. my partitioner class doesnt return single value

Sorting Values sent to reducer NOT based on KEY (Depending on part of VALUE)

2013-04-22 Thread Vikas Jadhav
Hi how to sort value in hadoop using standard sorting algorithm of hadoop ( i.e sorting facility provided by hadoop) Requirement: 1) Values shoulde be sorted depending on some part of value For Exam (KEY,VALUE) (0,BC,4,XY') (1,DC,1,PQ) (2,EF,0,MN) Sorted sequence @ reduce reached