RE: Limitation of key-value pairs for a particular key.

2013-01-18 Thread Sven Groot
Hi, I think I know what's going on here. It has to do with how many spills the map task performs. You are emitting the numbers in order, so if there is only one spill, they stay in order. For larger number of records, the map task will create more than one spill, which must be merged. Durin

RE: Limitation of key-value pairs for a particular key.

2013-01-18 Thread Utkarsh Gupta
You are right Actually we were expecting the values to be sorted. We tried to reproduce the problem by this simple code private final IntWritable one=new IntWritable(1); private Text word=new Text(); @Override public void map(LongWritable key,Text value, Context context) thr