Re: Does it possible that output value type of Map function different from final type?

2010-03-22 Thread welman Lu
Dear Aaron, Thanks for your reply! It's very help for you to tell me this, I don't know that the key type of the final output also can be different from the intermediate result. That's great! Best Regards Jiamin Lu

Re: Does it possible that output value type of Map function different from final type?

2010-03-21 Thread Aaron Kimball
Glad you figured out your bug. It's worth pointing out that Google's MapReduce has stricter type signatures than Hadoop does. Hadoop allows the final (k, v) pairs to be of a different type than the inputs to the reducer, and the final key associated with a final value does not necessarily need to b

Re: Does it possible that output value type of Map function different from final type?

2010-03-21 Thread welman Lu
Hi, all I solved it! By through set: conf.setMapOutputKeyClass(Text.class); conf.setMapOutputValueClass(BytesWritable.class); conf.setOutputKeyClass(Text.class); conf.setOutputValueClass(Text.class); So stupid I am! I need to read more documents first! Best Regar

Does it possible that output value type of Map function different from final type?

2010-03-21 Thread welman Lu
Hi, all >From the original paper of mapReduce by google, the signature of data transform is that: map: (k1, v1) -> list(k2, v2) reduce: (k2, list(v2)) -> list(v2) Here, the output value type is v2, and the final type is also v2. But, what I want to achieve is that, the final value type should