hadoop reduce problem: Block blk_-2061672148590840392 is valid, and cannot be written to

2008-08-10 Thread wangxu
Hi,all, I got this problem below every time I ran reduce. 10.254.106.48:50010:DataXceiver: java.io.IOException: Block blk_-7951711472001460544 is valid, and cannot be written to. I am running map-reduce on *4* slave nodes,using *hadoop-0.16.4-core.jar* I was wondering whether this error is rela

Re: Setting up a Hadoop cluster where nodes are spread over the Internet

2008-08-10 Thread Jim R. Wilson
A while back I was playing with building a cluster connected via OpenVPN - it was working well for the most part. The complication I personally had was with making the OpenVPN nodes recognize eachother and connect at boot time (I was using custom EC2 AMIs and wanted a way to have external NAT'ed s

Re: Setting up a Hadoop cluster where nodes are spread over the Internet

2008-08-10 Thread Andreas Kostyrka
On Sunday 10 August 2008 08:02:52 Dhruba Borthakur wrote: > In almost all hadoop configurations, all host names can be specified > as IP address. So, in your hadoop-site.xml, please specify the IP > address of the namenode (instead of its hostname). Which is not necessary a solution for complicate