Re: Reducers are stuck fetching map data.

2010-01-26 Thread Suhail Rehman
Yes, will be immensely helpful for others. Suhail On Tue, Jan 26, 2010 at 9:52 PM, Jean-Daniel Cryans wrote: > You mean that documentation? > > http://hadoop.apache.org/common/docs/r0.20.1/quickstart.html#Required+Software > > J-D > > On Tue, Jan 26, 2010 at 1:34 AM, S

Re: Reducers are stuck fetching map data.

2010-01-26 Thread Suhail Rehman
be used with Hadoop. Suhail On Thu, Jan 21, 2010 at 1:13 PM, Suhail Rehman wrote: > > We have verified that it does NOT solve the problem at all. This would > lead us to believe that the timeout issue we are experiencing is not part of > the shuffle phase. Any other ideas that m

Re: Using SequenceFiles in Hadoop for an imaging application.

2010-01-21 Thread Suhail Rehman
All issues were fixed, the imaging primitives were in an external jar that needed to be integrated into the final hadoop jar. Thanks Guys! Suhail On Wed, Jan 20, 2010 at 11:45 AM, Suhail Rehman wrote: > OK, i fixed that problem by adding > > conf.setInputFormat(SequenceFileInputFor

Re: Reducers are stuck fetching map data.

2010-01-21 Thread Suhail Rehman
ne for ReadTimeOut specificlly > > Thanks > Amareshwari > > > On 1/20/10 6:07 PM, "Suhail Rehman" wrote: > > We are having trouble running Hadoop MapReduce jobs on our cluster. > > VMs running on an IBM blade center with the following virtualized > configur

Re: Reducers are stuck fetching map data.

2010-01-20 Thread Suhail Rehman
cificlly > > Thanks > Amareshwari > > > On 1/20/10 6:07 PM, "Suhail Rehman" wrote: > > We are having trouble running Hadoop MapReduce jobs on our cluster. > > VMs running on an IBM blade center with the following virtualized > configuration: > > Mast

Reducers are stuck fetching map data.

2010-01-20 Thread Suhail Rehman
with regards to this would be much appreciated. Regards, Suhail Rehman MS by Research in Computer Science International Institute of Information Technology - Hyderabad reh...@research.iiit.ac.in - http://research.iiit.ac.in/~reh

Re: Using SequenceFiles in Hadoop for an imaging application.

2010-01-20 Thread Suhail Rehman
OK, i fixed that problem by adding conf.setInputFormat(SequenceFileInputFormat.class); to the job configuration. Does the BytesWritable file object point to exactly one file inside the Sequence File? On Wed, Jan 20, 2010 at 10:54 AM, Suhail Rehman wrote: > This is the console output try

Re: Using SequenceFiles in Hadoop for an imaging application.

2010-01-19 Thread Suhail Rehman
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307) at org.apache.hadoop.mapred.Child.main(Child.java:170) On Wed, Jan 20, 2010 at 5:41 AM, Jeff Zhang wrote: > Could you paste your exception message ? > > > > On Wed, Jan 20, 2010 at 1:15 AM, Suhail Rehman wrote: > >> I am usin

Using SequenceFiles in Hadoop for an imaging application.

2010-01-19 Thread Suhail Rehman
pache.hadoop.mapred.lib.IdentityReducer.class); client.setConf(conf); try { JobClient.runJob(conf); } catch (Exception e) { e.printStackTrace(); } } Thanks, Regards, Suh