Re: Jobs run slower and slower

2009-03-04 Thread Sean Laurent
per task takes to initialize > and to execute the map function? > > > On Wed, Mar 4, 2009 at 8:44 AM, Sean Laurent >wrote: > > > On Tue, Mar 3, 2009 at 10:14 PM, Amar Kamat > wrote: > > > > > Yeah. May be its not the problem with the JobTracker. Can you check

Re: Jobs run slower and slower

2009-03-04 Thread Sean Laurent
On Tue, Mar 3, 2009 at 10:14 PM, Amar Kamat wrote: > Yeah. May be its not the problem with the JobTracker. Can you check (via > job history) what is the best and the worst task runtimes? You can analyze > the jobs after they complete. > Amar Okay, I ran the same job 35 times last night. Each jo

Re: Jobs run slower and slower

2009-03-03 Thread Sean Laurent
slower because the tasks >> took >> longer time to get initialized? >> If so, you may hit >> https://issues.apache.org/jira/browse/HADOOP-4780 >> >> Runping >> >> On Tue, Mar 3, 2009 at 2:02 PM, Sean Laurent > >wrote: >> >> >> >>

Re: Jobs run slower and slower

2009-03-03 Thread Sean Laurent
ted jobs. The maximum > number of completed jobs kept is determined by the config variable > mapred.jobtracker.completeuserjobs.maximum. > You can lower that to lower the job tracker memory consumption. > > > On Tue, Mar 3, 2009 at 10:01 AM, Sean Laurent >wrote: > > > Interes

Re: Jobs run slower and slower

2009-03-03 Thread Sean Laurent
6 > > Runping > > > On Mon, Mar 2, 2009 at 4:46 PM, Sean Laurent >wrote: > > > Hi all, > > I'm conducting some initial tests with Hadoop to better understand how > well > > it will handle and scale with some of our specific problems. As a result, >

Jobs run slower and slower

2009-03-02 Thread Sean Laurent
Hi all, I'm conducting some initial tests with Hadoop to better understand how well it will handle and scale with some of our specific problems. As a result, I've written some M/R jobs that are representative of the work we want to do. I then run the jobs multiple times in a row (sequentially) to g

Re: Quickstart: only replicated to 0 nodes

2008-11-14 Thread Sean Laurent
On Thu, Nov 6, 2008 at 12:45 AM, Sean Laurent <[EMAIL PROTECTED]> wrote: > > So I'm new to Hadoop and I have been trying unsuccessfully to work > through the Quickstart tutorial to get a single node working in > pseudo-distributed mode. I can't seem to put data into

Quickstart: only replicated to 0 nodes

2008-11-05 Thread Sean Laurent
So I'm new to Hadoop and I have been trying unsuccessfully to work through the Quickstart tutorial to get a single node working in pseudo-distributed mode. I can't seem to put data into HDFS using release 0.18.2 under Java 1.6.0_04-b12: $ bin/hadoop fs -put conf input 08/11/05 18:32:23 INFO dfs.DF