I was able to find the problem. it seems that dev 0.8 will not run on java 1.5. at least not on my cluster.
Gal On Tue, 2005-12-27 at 23:20 +0200, Gal Nitzan wrote: > Hi, > > For some reason I am having trouble setting NDFS on multiple machines I > keep on getting an exception. > > My settings follows the guide lines i.e Doug's cheat sheet on all three > machines: > > <name>fs.default.name</name> > <value>nutchmst1.XXXXXX.com:9000</value> > > all machines seems to be connecting to the namenode: > > 051227 223242 10 Opened server at 50010 > 051227 223242 11 Starting DataNode in: /nutch/ndfs/data/data > 051227 223242 11 using BLOCKREPORT_INTERVAL of 3500482msec > 051227 223242 12 Client connection to x.x.22.185:9000: starting > > 051227 230013 Server connection on port 9000 from x.x.22.186: starting > 051227 230013 Got brand-new heartbeat from nutchnd1:50010 > 051227 230013 Block report from nutchnd1:50010: 0 blocks. > 051227 230013 Server connection on port 9000 from x.x.22.183: starting > 051227 230013 Got brand-new heartbeat from nutchws1:50010 > 051227 230013 Block report from nutchws1:50010: 0 blocks. > > The problem::::::::::: > > [EMAIL PROTECTED] trunk]$ bin/nutch ndfs -copyFromLocal urls.txt > 051227 230324 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-defaul > t.xml > 051227 230324 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-site.x > ml > 051227 230324 No FS indicated, using default:nutchmst1.XXX.com:9000 > 051227 230324 Client connection to x.x.22.185:9000: starting > Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 2 > at org.apache.nutch.fs.NDFSShell.main(NDFSShell.java:234) > [EMAIL PROTECTED] trunk]$ bin/nutch ndfs -copyFromLocal urls.txt urls > /urls.txt > 051227 230422 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-defaul > t.xml > 051227 230423 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-site.x > ml > 051227 230423 No FS indicated, using default:nutchmst1.xxx.com:9000 > 051227 230423 Client connection to x.x.22.185:9000: starting > Exception in thread "main" java.lang.NullPointerException > at java.net.Socket.<init>(Socket.java:357) > at java.net.Socket.<init>(Socket.java:207) > at org.apache.nutch.ndfs.NDFSClient$NDFSOutputStream.nextBlockOu > tputStream(NDFSClient.java:573) > at org.apache.nutch.ndfs.NDFSClient$NDFSOutputStream.<init>(NDFS > Client.java:521) > at org.apache.nutch.ndfs.NDFSClient.create(NDFSClient.java:83) > at org.apache.nutch.fs.NDFSFileSystem.createRaw(NDFSFileSystem.j > ava:71) > at org.apache.nutch.fs.NFSDataOutputStream$Summer.<init>(NFSData > OutputStream.java:41) > at org.apache.nutch.fs.NFSDataOutputStream.<init>(NFSDataOutputS > tream.java:129) > at org.apache.nutch.fs.NutchFileSystem.create(NutchFileSystem.ja > va:187) > at org.apache.nutch.fs.NutchFileSystem.create(NutchFileSystem.ja > va:174) > at org.apache.nutch.fs.NDFSFileSystem.doFromLocalFile(NDFSFileSy > stem.java:178) > at org.apache.nutch.fs.NDFSFileSystem.copyFromLocalFile(NDFSFile > System.java:153) > at > org.apache.nutch.fs.NDFSShell.copyFromLocal(NDFSShell.java:46 > ) > at org.apache.nutch.fs.NDFSShell.main(NDFSShell.java:234) > > > > I know I am missing somthing but I can't figure out what. > > > ------------------------------------------------------- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://ads.osdn.com/?ad_id=7637&alloc_id=16865&op=click _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
