Re: Trouble setting NDFS on multiple machines

Tue, 27 Dec 2005 16:25:12 -0800

The exception means that one client is unable to connect to one *datanode*. Check that the box that had this exception can open a connection to all other datanodes with the correct port. 
try
telnet machineNameAsUsedInNameNode DATANODE_PORT

Is it able to connect?

Stefan

Am 27.12.2005 um 22:20 schrieb Gal Nitzan:


Hi,
For some reason I am having trouble setting NDFS on multiple machines I 
keep on getting an exception.
My settings follows the guide lines i.e Doug's cheat sheet on all three 
machines:

  <name>fs.default.name</name>
  <value>nutchmst1.XXXXXX.com:9000</value>

all machines seems to be connecting to the namenode:

051227 223242 10 Opened server at 50010
051227 223242 11 Starting DataNode in: /nutch/ndfs/data/data
051227 223242 11 using BLOCKREPORT_INTERVAL of 3500482msec
051227 223242 12 Client connection to x.x.22.185:9000: starting

051227 230013 Server connection on port 9000 from x.x.22.186: starting
051227 230013 Got brand-new heartbeat from nutchnd1:50010
051227 230013 Block report from nutchnd1:50010: 0 blocks.
051227 230013 Server connection on port 9000 from x.x.22.183: starting
051227 230013 Got brand-new heartbeat from nutchws1:50010
051227 230013 Block report from nutchws1:50010: 0 blocks.

The problem:::::::::::

[EMAIL PROTECTED] trunk]$ bin/nutch ndfs -copyFromLocal urls.txt
051227 230324 parsing file:/home/nutchuser/nutch/trunk/conf/nutch- defaul 
t.xml
051227 230324 parsing file:/home/nutchuser/nutch/trunk/conf/nutch- site.x 
ml
051227 230324 No FS indicated, using default:nutchmst1.XXX.com:9000
051227 230324 Client connection to x.x.22.185:9000: starting
Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 2
        at org.apache.nutch.fs.NDFSShell.main(NDFSShell.java:234)
[EMAIL PROTECTED] trunk]$ bin/nutch ndfs -copyFromLocal urls.txt urls 
/urls.txt
051227 230422 parsing file:/home/nutchuser/nutch/trunk/conf/nutch- defaul 
t.xml
051227 230423 parsing file:/home/nutchuser/nutch/trunk/conf/nutch- site.x 
ml
051227 230423 No FS indicated, using default:nutchmst1.xxx.com:9000
051227 230423 Client connection to x.x.22.185:9000: starting
Exception in thread "main" java.lang.NullPointerException
        at java.net.Socket.<init>(Socket.java:357)
        at java.net.Socket.<init>(Socket.java:207)
at org.apache.nutch.ndfs.NDFSClient $NDFSOutputStream.nextBlockOu 
tputStream(NDFSClient.java:573)
at org.apache.nutch.ndfs.NDFSClient$NDFSOutputStream.<init> (NDFS 
Client.java:521)
        at org.apache.nutch.ndfs.NDFSClient.create(NDFSClient.java:83)
at org.apache.nutch.fs.NDFSFileSystem.createRaw (NDFSFileSystem.j 
ava:71)
at org.apache.nutch.fs.NFSDataOutputStream$Summer.<init> (NFSData 
OutputStream.java:41)
at org.apache.nutch.fs.NFSDataOutputStream.<init> (NFSDataOutputS 
tream.java:129)
at org.apache.nutch.fs.NutchFileSystem.create (NutchFileSystem.ja 
va:187)
at org.apache.nutch.fs.NutchFileSystem.create (NutchFileSystem.ja 
va:174)
at org.apache.nutch.fs.NDFSFileSystem.doFromLocalFile (NDFSFileSy 
stem.java:178)
at org.apache.nutch.fs.NDFSFileSystem.copyFromLocalFile (NDFSFile 
System.java:153)
        at
org.apache.nutch.fs.NDFSShell.copyFromLocal(NDFSShell.java: 46 ) 
        at org.apache.nutch.fs.NDFSShell.main(NDFSShell.java:234)



I know I am missing somthing but I can't figure out what.





---------------------------------------------------------------
company:        http://www.media-style.com
forum:        http://www.text-mining.org
blog:            http://www.find23.net

Reply via email to