Does the class of the Mapper output need to match the exact class of the specified output?

2010-01-26 Thread Wilkes, Chris
I'm outputting a Text and a LongWritable in my mapper and told the job that my mapper output class is Writable (the interface shared by both of them): job.setMapOutputValueClass(Writable.class); I'm doing this as I have two different types of input files and am combining them together. I

Re: Reducers are stuck fetching map data.

2010-01-26 Thread Suhail Rehman
Yes, will be immensely helpful for others. Suhail On Tue, Jan 26, 2010 at 9:52 PM, Jean-Daniel Cryans wrote: > You mean that documentation? > > http://hadoop.apache.org/common/docs/r0.20.1/quickstart.html#Required+Software > > J-D > > On Tue, Jan 26, 2010 at 1:34 AM, Suhail Rehman > wrote: > >

Re: Reducers are stuck fetching map data.

2010-01-26 Thread Jean-Daniel Cryans
You mean that documentation? http://hadoop.apache.org/common/docs/r0.20.1/quickstart.html#Required+Software J-D On Tue, Jan 26, 2010 at 1:34 AM, Suhail Rehman wrote: > We finally figured it out! The problem was with the JDK installation on our > VMs, it was configured to use IBM JDK, and the mom

Re: Reducers are stuck fetching map data.

2010-01-26 Thread Suhail Rehman
We finally figured it out! The problem was with the JDK installation on our VMs, it was configured to use IBM JDK, and the moment we switched to Sun, everything now works flawlessly. You may want to include this information somewhere in the documentation that you *strongly recommend *Sun JDK to be