Re: Does it possible that output value type of Map function different from final type?

2010-03-21 Thread Aaron Kimball
Glad you figured out your bug. It's worth pointing out that Google's MapReduce has stricter type signatures than Hadoop does. Hadoop allows the final (k, v) pairs to be of a different type than the inputs to the reducer, and the final key associated with a final value does not necessarily need to b

Re: Does it possible that output value type of Map function different from final type?

2010-03-21 Thread welman Lu
Hi, all I solved it! By through set: conf.setMapOutputKeyClass(Text.class); conf.setMapOutputValueClass(BytesWritable.class); conf.setOutputKeyClass(Text.class); conf.setOutputValueClass(Text.class); So stupid I am! I need to read more documents first! Best Regar

Does it possible that output value type of Map function different from final type?

2010-03-21 Thread welman Lu
Hi, all >From the original paper of mapReduce by google, the signature of data transform is that: map: (k1, v1) -> list(k2, v2) reduce: (k2, list(v2)) -> list(v2) Here, the output value type is v2, and the final type is also v2. But, what I want to achieve is that, the final value type should