Hi,
For some reason I am having trouble setting NDFS on multiple machines I
keep on getting an exception.
My settings follows the guide lines i.e Doug's cheat sheet on all three
machines:
<name>fs.default.name</name>
<value>nutchmst1.XXXXXX.com:9000</value>
all machines seems to be connecting to the namenode:
051227 223242 10 Opened server at 50010
051227 223242 11 Starting DataNode in: /nutch/ndfs/data/data
051227 223242 11 using BLOCKREPORT_INTERVAL of 3500482msec
051227 223242 12 Client connection to x.x.22.185:9000: starting
051227 230013 Server connection on port 9000 from x.x.22.186: starting
051227 230013 Got brand-new heartbeat from nutchnd1:50010
051227 230013 Block report from nutchnd1:50010: 0 blocks.
051227 230013 Server connection on port 9000 from x.x.22.183: starting
051227 230013 Got brand-new heartbeat from nutchws1:50010
051227 230013 Block report from nutchws1:50010: 0 blocks.
The problem:::::::::::
[EMAIL PROTECTED] trunk]$ bin/nutch ndfs -copyFromLocal urls.txt
051227 230324 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-defaul
t.xml
051227 230324 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-site.x
ml
051227 230324 No FS indicated, using default:nutchmst1.XXX.com:9000
051227 230324 Client connection to x.x.22.185:9000: starting
Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 2
at org.apache.nutch.fs.NDFSShell.main(NDFSShell.java:234)
[EMAIL PROTECTED] trunk]$ bin/nutch ndfs -copyFromLocal urls.txt urls
/urls.txt
051227 230422 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-defaul
t.xml
051227 230423 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-site.x
ml
051227 230423 No FS indicated, using default:nutchmst1.xxx.com:9000
051227 230423 Client connection to x.x.22.185:9000: starting
Exception in thread "main" java.lang.NullPointerException
at java.net.Socket.<init>(Socket.java:357)
at java.net.Socket.<init>(Socket.java:207)
at org.apache.nutch.ndfs.NDFSClient$NDFSOutputStream.nextBlockOu
tputStream(NDFSClient.java:573)
at org.apache.nutch.ndfs.NDFSClient$NDFSOutputStream.<init>(NDFS
Client.java:521)
at org.apache.nutch.ndfs.NDFSClient.create(NDFSClient.java:83)
at org.apache.nutch.fs.NDFSFileSystem.createRaw(NDFSFileSystem.j
ava:71)
at org.apache.nutch.fs.NFSDataOutputStream$Summer.<init>(NFSData
OutputStream.java:41)
at org.apache.nutch.fs.NFSDataOutputStream.<init>(NFSDataOutputS
tream.java:129)
at org.apache.nutch.fs.NutchFileSystem.create(NutchFileSystem.ja
va:187)
at org.apache.nutch.fs.NutchFileSystem.create(NutchFileSystem.ja
va:174)
at org.apache.nutch.fs.NDFSFileSystem.doFromLocalFile(NDFSFileSy
stem.java:178)
at org.apache.nutch.fs.NDFSFileSystem.copyFromLocalFile(NDFSFile
System.java:153)
at
org.apache.nutch.fs.NDFSShell.copyFromLocal(NDFSShell.java:46
)
at org.apache.nutch.fs.NDFSShell.main(NDFSShell.java:234)
I know I am missing somthing but I can't figure out what.
-------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems? Stop! Download the new AJAX search engine that makes
searching your log files as easy as surfing the web. DOWNLOAD SPLUNK!
http://ads.osdn.com/?ad_id=7637&alloc_id=16865&op=click
_______________________________________________
Nutch-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-general
