Re: Could we use different output Format for the Mapper and Combiner?

2011-02-16 Thread Stanley Xu
ypeC, ValuetypeD*); > > > > } > > > > hopes this help! > > > > regards > > > Alain > > > > [@@THALES GROUP RESTRICTED@@] > > > > *De :* Stanley Xu [mailto:wenhao...@gmail.com] > *Envoyé :* mercredi 16 février 2011 12:02 > *À :*

RE: Could we use different output Format for the Mapper and Combiner?

2011-02-16 Thread MONTMORY Alain
ontext.write(KeyTypeC, ValuetypeD); } hopes this help! regards Alain [@@THALES GROUP RESTRICTED@@] De : Stanley Xu [mailto:wenhao...@gmail.com] Envoyé : mercredi 16 février 2011 12:02 À : mapreduce-user@hadoop.apache.org Objet : Could we use different output Format for the Mapper and Combiner? Dea

Re: Could we use different output Format for the Mapper and Combiner?

2011-02-16 Thread Harsh J
The combiner must "have the same input and output key types and the same input and output value types" (as per the docs for setting one.) The combined outputs are treated as typical map outputs after processing, so that the reducer still applies on it properly. For this to work, your combiner can'

Could we use different output Format for the Mapper and Combiner?

2011-02-16 Thread Stanley Xu
Dear all, I am writing a map-reduce job today. Which I hope I could use different format for the Mapper and Combiner. I am using the Text as the format of the Mapper and MapWritable as the format of the format. But it looks the hadoop didn't support that yet? I have some code like the following: