Re: Problems with MR Job running really slowly

2011-11-06 Thread Florin P
t: Re: Problems with MR Job running really slowly To: mapreduce-user@hadoop.apache.org Date: Monday, November 7, 2011, 12:13 AM 1)  I am varying both the number of mappers and reducers trying to determine three things     a) What are the options I need reducers and mappers to              -  Not have ma

Re: Problems with MR Job running really slowly

2011-11-06 Thread Steve Lewis
d book for understanding tuning parameters is Hadoop Definitive > Guide by Tom White. > > Hope that the above helps. > Regards, > Florin > > > > > --- On Thu, 11/3/11, Steve Lewis wrote: > > From: Steve Lewis > Subject: Problems with MR Job running reall

Re: Problems with MR Job running really slowly

2011-11-06 Thread Florin P
rs is Hadoop Definitive Guide by Tom White. Hope that the above helps. Regards, Florin --- On Thu, 11/3/11, Steve Lewis wrote: From: Steve Lewis Subject: Problems with MR Job running really slowly To: "mapreduce-user" Date: Thursday, November 3, 2011, 11:07 PM I have a job

Problems with MR Job running really slowly

2011-11-03 Thread Steve Lewis
I have a job which takes an xml file - the splitter breaks the file into tags, the mapper parses each tag and sends the data to the reducer. I am using a custom splitter which reads the file looking for start and end tags. When I run the code in the splitter and the mapper - generating separate ta