Subject: RE: Stability issue - dead DN's
Ok, I'll give this scenario a try (in spite of the intoxication ;-)).
= putting or getting a file =
A client will access the NameNode first and get a list of hostnames. These will
resolve to addresses either in public or in private space, depending on whether
Hi Mike,
You really really don't want to do this.
Long story short... It won't work.
Can you elaborate? Are you talking about the bonded interfaces or about having
a separated network for interconnects and external network? What can go wrong
there?
Just a suggestion.. You don't want
Bonded will work but you may not see the performance you would expect. If you
need 1 GBe, go 10GBe less headache and has even more headroom.
Multiple interfaces won't work. Or I should say didn't work in past releases.
If you think about it, clients have to connect to each node. So having two
242383
From: Segel, Mike [mse...@navteq.com]
Sent: Friday, May 13, 2011 2:36 PM
To: general@hadoop.apache.org
Cc: cdh-u...@cloudera.org; general@hadoop.apache.org
Subject: Re: Stability issue - dead DN's
Bonded will work but you may not see the performance
From: Segel, Mike [mse...@navteq.com]
Sent: Friday, May 13, 2011 2:36 PM
To: general@hadoop.apache.org
Cc: cdh-u...@cloudera.org; general@hadoop.apache.org
Subject: Re: Stability issue - dead DN's
Bonded will work but you may not see the performance you would expect
Evert,
From my experience, hadoop loathes swap and you mention that all reduces and
mappers are running (8 total) and from the ganglia screenshot I see that you
have a thick crest of that purple swap.
If we do the math that means [ map.tasks.max * mapred.child.java.opts ] +
[ reduce.tasks.max *
Evert,
What’s the stack trace and what version of hadoop do you have installed Sir!
James.
On 2011-05-11, at 3:23 AM, Evert Lammerts wrote:
Hi list,
I notice that whenever our Hadoop installation is put under a heavy load we
lose one or two (on a total of five) datanodes. This results in
-
From: James Seigel [mailto:ja...@tynt.com]
Sent: woensdag 11 mei 2011 14:54
To: general@hadoop.apache.org
Subject: Re: Stability issue - dead DN's
Evert,
What's the stack trace and what version of hadoop do you have installed
Sir!
James.
On 2011-05-11, at 3:23 AM, Evert Lammerts wrote
