per task takes to initialize
> and to execute the map function?
>
>
> On Wed, Mar 4, 2009 at 8:44 AM, Sean Laurent >wrote:
>
> > On Tue, Mar 3, 2009 at 10:14 PM, Amar Kamat
> wrote:
> >
> > > Yeah. May be its not the problem with the JobTracker. Can you check
On Tue, Mar 3, 2009 at 10:14 PM, Amar Kamat wrote:
> Yeah. May be its not the problem with the JobTracker. Can you check (via
> job history) what is the best and the worst task runtimes? You can analyze
> the jobs after they complete.
> Amar
Okay, I ran the same job 35 times last night. Each jo
slower because the tasks
>> took
>> longer time to get initialized?
>> If so, you may hit
>> https://issues.apache.org/jira/browse/HADOOP-4780
>>
>> Runping
>>
>> On Tue, Mar 3, 2009 at 2:02 PM, Sean Laurent > >wrote:
>>
>>
>>
>>
ted jobs. The maximum
> number of completed jobs kept is determined by the config variable
> mapred.jobtracker.completeuserjobs.maximum.
> You can lower that to lower the job tracker memory consumption.
>
>
> On Tue, Mar 3, 2009 at 10:01 AM, Sean Laurent >wrote:
>
> > Interes
6
>
> Runping
>
>
> On Mon, Mar 2, 2009 at 4:46 PM, Sean Laurent >wrote:
>
> > Hi all,
> > I'm conducting some initial tests with Hadoop to better understand how
> well
> > it will handle and scale with some of our specific problems. As a result,
>
Hi all,
I'm conducting some initial tests with Hadoop to better understand how well
it will handle and scale with some of our specific problems. As a result,
I've written some M/R jobs that are representative of the work we want to
do. I then run the jobs multiple times in a row (sequentially) to g
On Thu, Nov 6, 2008 at 12:45 AM, Sean Laurent <[EMAIL PROTECTED]> wrote:
>
> So I'm new to Hadoop and I have been trying unsuccessfully to work
> through the Quickstart tutorial to get a single node working in
> pseudo-distributed mode. I can't seem to put data into
So I'm new to Hadoop and I have been trying unsuccessfully to work
through the Quickstart tutorial to get a single node working in
pseudo-distributed mode. I can't seem to put data into HDFS using
release 0.18.2 under Java 1.6.0_04-b12:
$ bin/hadoop fs -put conf input
08/11/05 18:32:23 INFO dfs.DF