Yes, check out from anonymous cvs a few hours ago. What OS are you running
on?
Here is the output of the test script:
Testsuite: net.nutch.tools.TestSegmentMergeTool
Tests run: 2, Failures: 2, Errors: 0, Time elapsed: 7.563 sec
------------- Standard Output ---------------
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50281\segments\seg0 \tmp
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50281\segments\seg1 \tmp
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50281\segments\seg2 \tmp
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50281\segments\seg3 \tmp
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50281\segments\seg4 \tmp
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50294\segments\seg0 \tmp
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50294\segments\seg1 \tmp
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50294\segments\seg2 \tmp
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50294\segments\seg3 \tmp
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50294\segments\seg4 \tmp
------------- ---------------- ---------------
------------- Standard Error -----------------
040908 160801 loading file:/C:/nutch/nutch/conf/nutch-default.xml
040908 160801 loading file:/C:/nutch/nutch/conf/nutch-site.xml
040908 160801 Using URL normalizer: net.nutch.net.BasicUrlNormalizer
040908 160802 Segment seg0: 100 entries.
040908 160802 Segment seg1: 100 entries.
040908 160802 Segment seg2: 100 entries.
040908 160802 Segment seg3: 100 entries.
040908 160802 Segment seg4: 100 entries.
040908 160802 TOTAL 500 input entries in 5 segments.
040908 160802 Looking for master index in null
040908 160802 Creating master unique index...
040908 160802 - creating missing index for seg0
040908 160802 No NutchFileSystem indicated, so defaulting to local fs.
040908 160802 indexing segment:
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50281\segments\seg0
040908 160802 Plugins: looking in: C:\nutch\nutch\build\plugins
040908 160802 parsing:
C:\nutch\nutch\build\plugins\clustering-carrot2\plugin.xml
040908 160802 parsing:
C:\nutch\nutch\build\plugins\creativecommons\plugin.xml
040908 160802 parsing: C:\nutch\nutch\build\plugins\DummyPlugin0\plugin.xml
040908 160802 org.dom4j.DocumentException:
C:\nutch\nutch\build\plugins\DummyPlugin0\plugin.xml (The system cannot
find the file specified) Nested exception:
C:\nutch\nutch\build\plugins\DummyPlugin0\plugin.xml (The system cannot
find the file specified)
040908 160802 parsing: C:\nutch\nutch\build\plugins\DummyPlugin1\plugin.xml
040908 160802 org.dom4j.DocumentException:
C:\nutch\nutch\build\plugins\DummyPlugin1\plugin.xml (The system cannot
find the file specified) Nested exception:
C:\nutch\nutch\build\plugins\DummyPlugin1\plugin.xml (The system cannot
find the file specified)
040908 160802 parsing: C:\nutch\nutch\build\plugins\DummyPlugin2\plugin.xml
040908 160802 org.dom4j.DocumentException:
C:\nutch\nutch\build\plugins\DummyPlugin2\plugin.xml (The system cannot
find the file specified) Nested exception:
C:\nutch\nutch\build\plugins\DummyPlugin2\plugin.xml (The system cannot
find the file specified)
040908 160802 parsing: C:\nutch\nutch\build\plugins\DummyPlugin3\plugin.xml
040908 160802 org.dom4j.DocumentException:
C:\nutch\nutch\build\plugins\DummyPlugin3\plugin.xml (The system cannot
find the file specified) Nested exception:
C:\nutch\nutch\build\plugins\DummyPlugin3\plugin.xml (The system cannot
find the file specified)
040908 160802 parsing: C:\nutch\nutch\build\plugins\DummyPlugin4\plugin.xml
040908 160802 org.dom4j.DocumentException:
C:\nutch\nutch\build\plugins\DummyPlugin4\plugin.xml (The system cannot
find the file specified) Nested exception:
C:\nutch\nutch\build\plugins\DummyPlugin4\plugin.xml (The system cannot
find the file specified)
040908 160802 parsing: C:\nutch\nutch\build\plugins\index-basic\plugin.xml
040908 160802 parsing:
C:\nutch\nutch\build\plugins\language-identifier\plugin.xml
040908 160802 parsing: C:\nutch\nutch\build\plugins\parse-ext\plugin.xml
040908 160802 parsing: C:\nutch\nutch\build\plugins\parse-html\plugin.xml
040908 160802 parsing: C:\nutch\nutch\build\plugins\parse-mp3\plugin.xml
040908 160802 parsing: C:\nutch\nutch\build\plugins\parse-msword\plugin.xml
040908 160802 parsing: C:\nutch\nutch\build\plugins\parse-pdf\plugin.xml
040908 160802 parsing: C:\nutch\nutch\build\plugins\parse-text\plugin.xml
040908 160802 parsing: C:\nutch\nutch\build\plugins\protocol-file\plugin.xml
040908 160802 parsing: C:\nutch\nutch\build\plugins\protocol-ftp\plugin.xml
040908 160802 parsing: C:\nutch\nutch\build\plugins\protocol-http\plugin.xml
040908 160802 parsing: C:\nutch\nutch\build\plugins\query-basic\plugin.xml
040908 160802 parsing: C:\nutch\nutch\build\plugins\query-site\plugin.xml
040908 160802 parsing: C:\nutch\nutch\build\plugins\query-url\plugin.xml
040908 160802 da was added as supported language
040908 160802 de was added as supported language
040908 160802 el was added as supported language
040908 160802 en was added as supported language
040908 160802 es was added as supported language
040908 160802 fi was added as supported language
040908 160802 fr was added as supported language
040908 160802 it was added as supported language
040908 160802 nl was added as supported language
040908 160802 pt was added as supported language
040908 160802 sv was added as supported language
040908 160802 found resource common-terms.utf8 at
file:/C:/nutch/nutch/conf/common-terms.utf8
040908 160803 merging segments _0 (1 docs) _1 (1 docs) _2 (1 docs) _3 (1
docs) _4 (1 docs) _5 (1 docs) _6 (1 docs) _7 (1 docs) _8 (1 docs) _9 (1
docs) _a (1 docs) _b (1 docs) _c (1 docs) _d (1 docs) _e (1 docs) _f (1
docs) _g (1 docs) _h (1 docs) _i (1 docs) _j (1 docs) _k (1 docs) _l (1
docs) _m (1 docs) _n (1 docs) _o (1 docs) _p (1 docs) _q (1 docs) _r (1
docs) _s (1 docs) _t (1 docs) _u (1 docs) _v (1 docs) _w (1 docs) _x (1
docs) _y (1 docs) _z (1 docs) _10 (1 docs) _11 (1 docs) _12 (1 docs) _13
(1 docs) _14 (1 docs) _15 (1 docs) _16 (1 docs) _17 (1 docs) _18 (1 docs)
_19 (1 docs) _1a (1 docs) _1b (1 docs) _1c (1 docs) _1d (1 docs) into _1e
(50 docs)
040908 160803 merging segments _1f (1 docs) _1g (1 docs) _1h (1 docs) _1i
(1 docs) _1j (1 docs) _1k (1 docs) _1l (1 docs) _1m (1 docs) _1n (1 docs)
_1o (1 docs) _1p (1 docs) _1q (1 docs) _1r (1 docs) _1s (1 docs) _1t (1
docs) _1u (1 docs) _1v (1 docs) _1w (1 docs) _1x (1 docs) _1y (1 docs) _1z
(1 docs) _20 (1 docs) _21 (1 docs) _22 (1 docs) _23 (1 docs) _24 (1 docs)
_25 (1 docs) _26 (1 docs) _27 (1 docs) _28 (1 docs) _29 (1 docs) _2a (1
docs) _2b (1 docs) _2c (1 docs) _2d (1 docs) _2e (1 docs) _2f (1 docs) _2g
(1 docs) _2h (1 docs) _2i (1 docs) _2j (1 docs) _2k (1 docs) _2l (1 docs)
_2m (1 docs) _2n (1 docs) _2o (1 docs) _2p (1 docs) _2q (1 docs) _2r (1
docs) _2s (1 docs) into _2t (50 docs)
040908 160803 Optimizing index...
040908 160803 merging segments _1e (50 docs) _2t (50 docs) into _2u (100
docs)
040908 160803 done indexing
040908 160803 - creating missing index for seg1
040908 160803 No NutchFileSystem indicated, so defaulting to local fs.
040908 160803 indexing segment:
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50281\segments\seg1
040908 160803 merging segments _0 (1 docs) _1 (1 docs) _2 (1 docs) _3 (1
docs) _4 (1 docs) _5 (1 docs) _6 (1 docs) _7 (1 docs) _8 (1 docs) _9 (1
docs) _a (1 docs) _b (1 docs) _c (1 docs) _d (1 docs) _e (1 docs) _f (1
docs) _g (1 docs) _h (1 docs) _i (1 docs) _j (1 docs) _k (1 docs) _l (1
docs) _m (1 docs) _n (1 docs) _o (1 docs) _p (1 docs) _q (1 docs) _r (1
docs) _s (1 docs) _t (1 docs) _u (1 docs) _v (1 docs) _w (1 docs) _x (1
docs) _y (1 docs) _z (1 docs) _10 (1 docs) _11 (1 docs) _12 (1 docs) _13
(1 docs) _14 (1 docs) _15 (1 docs) _16 (1 docs) _17 (1 docs) _18 (1 docs)
_19 (1 docs) _1a (1 docs) _1b (1 docs) _1c (1 docs) _1d (1 docs) into _1e
(50 docs)
040908 160803 merging segments _1f (1 docs) _1g (1 docs) _1h (1 docs) _1i
(1 docs) _1j (1 docs) _1k (1 docs) _1l (1 docs) _1m (1 docs) _1n (1 docs)
_1o (1 docs) _1p (1 docs) _1q (1 docs) _1r (1 docs) _1s (1 docs) _1t (1
docs) _1u (1 docs) _1v (1 docs) _1w (1 docs) _1x (1 docs) _1y (1 docs) _1z
(1 docs) _20 (1 docs) _21 (1 docs) _22 (1 docs) _23 (1 docs) _24 (1 docs)
_25 (1 docs) _26 (1 docs) _27 (1 docs) _28 (1 docs) _29 (1 docs) _2a (1
docs) _2b (1 docs) _2c (1 docs) _2d (1 docs) _2e (1 docs) _2f (1 docs) _2g
(1 docs) _2h (1 docs) _2i (1 docs) _2j (1 docs) _2k (1 docs) _2l (1 docs)
_2m (1 docs) _2n (1 docs) _2o (1 docs) _2p (1 docs) _2q (1 docs) _2r (1
docs) _2s (1 docs) into _2t (50 docs)
040908 160804 Optimizing index...
040908 160804 merging segments _1e (50 docs) _2t (50 docs) into _2u (100
docs)
040908 160804 done indexing
040908 160804 - creating missing index for seg2
040908 160804 No NutchFileSystem indicated, so defaulting to local fs.
040908 160804 indexing segment:
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50281\segments\seg2
040908 160804 merging segments _0 (1 docs) _1 (1 docs) _2 (1 docs) _3 (1
docs) _4 (1 docs) _5 (1 docs) _6 (1 docs) _7 (1 docs) _8 (1 docs) _9 (1
docs) _a (1 docs) _b (1 docs) _c (1 docs) _d (1 docs) _e (1 docs) _f (1
docs) _g (1 docs) _h (1 docs) _i (1 docs) _j (1 docs) _k (1 docs) _l (1
docs) _m (1 docs) _n (1 docs) _o (1 docs) _p (1 docs) _q (1 docs) _r (1
docs) _s (1 docs) _t (1 docs) _u (1 docs) _v (1 docs) _w (1 docs) _x (1
docs) _y (1 docs) _z (1 docs) _10 (1 docs) _11 (1 docs) _12 (1 docs) _13
(1 docs) _14 (1 docs) _15 (1 docs) _16 (1 docs) _17 (1 docs) _18 (1 docs)
_19 (1 docs) _1a (1 docs) _1b (1 docs) _1c (1 docs) _1d (1 docs) into _1e
(50 docs)
040908 160804 merging segments _1f (1 docs) _1g (1 docs) _1h (1 docs) _1i
(1 docs) _1j (1 docs) _1k (1 docs) _1l (1 docs) _1m (1 docs) _1n (1 docs)
_1o (1 docs) _1p (1 docs) _1q (1 docs) _1r (1 docs) _1s (1 docs) _1t (1
docs) _1u (1 docs) _1v (1 docs) _1w (1 docs) _1x (1 docs) _1y (1 docs) _1z
(1 docs) _20 (1 docs) _21 (1 docs) _22 (1 docs) _23 (1 docs) _24 (1 docs)
_25 (1 docs) _26 (1 docs) _27 (1 docs) _28 (1 docs) _29 (1 docs) _2a (1
docs) _2b (1 docs) _2c (1 docs) _2d (1 docs) _2e (1 docs) _2f (1 docs) _2g
(1 docs) _2h (1 docs) _2i (1 docs) _2j (1 docs) _2k (1 docs) _2l (1 docs)
_2m (1 docs) _2n (1 docs) _2o (1 docs) _2p (1 docs) _2q (1 docs) _2r (1
docs) _2s (1 docs) into _2t (50 docs)
040908 160804 Optimizing index...
040908 160804 merging segments _1e (50 docs) _2t (50 docs) into _2u (100
docs)
040908 160804 done indexing
040908 160804 - creating missing index for seg3
040908 160804 No NutchFileSystem indicated, so defaulting to local fs.
040908 160804 indexing segment:
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50281\segments\seg3
040908 160804 merging segments _0 (1 docs) _1 (1 docs) _2 (1 docs) _3 (1
docs) _4 (1 docs) _5 (1 docs) _6 (1 docs) _7 (1 docs) _8 (1 docs) _9 (1
docs) _a (1 docs) _b (1 docs) _c (1 docs) _d (1 docs) _e (1 docs) _f (1
docs) _g (1 docs) _h (1 docs) _i (1 docs) _j (1 docs) _k (1 docs) _l (1
docs) _m (1 docs) _n (1 docs) _o (1 docs) _p (1 docs) _q (1 docs) _r (1
docs) _s (1 docs) _t (1 docs) _u (1 docs) _v (1 docs) _w (1 docs) _x (1
docs) _y (1 docs) _z (1 docs) _10 (1 docs) _11 (1 docs) _12 (1 docs) _13
(1 docs) _14 (1 docs) _15 (1 docs) _16 (1 docs) _17 (1 docs) _18 (1 docs)
_19 (1 docs) _1a (1 docs) _1b (1 docs) _1c (1 docs) _1d (1 docs) into _1e
(50 docs)
040908 160804 merging segments _1f (1 docs) _1g (1 docs) _1h (1 docs) _1i
(1 docs) _1j (1 docs) _1k (1 docs) _1l (1 docs) _1m (1 docs) _1n (1 docs)
_1o (1 docs) _1p (1 docs) _1q (1 docs) _1r (1 docs) _1s (1 docs) _1t (1
docs) _1u (1 docs) _1v (1 docs) _1w (1 docs) _1x (1 docs) _1y (1 docs) _1z
(1 docs) _20 (1 docs) _21 (1 docs) _22 (1 docs) _23 (1 docs) _24 (1 docs)
_25 (1 docs) _26 (1 docs) _27 (1 docs) _28 (1 docs) _29 (1 docs) _2a (1
docs) _2b (1 docs) _2c (1 docs) _2d (1 docs) _2e (1 docs) _2f (1 docs) _2g
(1 docs) _2h (1 docs) _2i (1 docs) _2j (1 docs) _2k (1 docs) _2l (1 docs)
_2m (1 docs) _2n (1 docs) _2o (1 docs) _2p (1 docs) _2q (1 docs) _2r (1
docs) _2s (1 docs) into _2t (50 docs)
040908 160804 Optimizing index...
040908 160804 merging segments _1e (50 docs) _2t (50 docs) into _2u (100
docs)
040908 160804 done indexing
040908 160804 - creating missing index for seg4
040908 160804 No NutchFileSystem indicated, so defaulting to local fs.
040908 160804 indexing segment:
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50281\segments\seg4
040908 160804 merging segments _0 (1 docs) _1 (1 docs) _2 (1 docs) _3 (1
docs) _4 (1 docs) _5 (1 docs) _6 (1 docs) _7 (1 docs) _8 (1 docs) _9 (1
docs) _a (1 docs) _b (1 docs) _c (1 docs) _d (1 docs) _e (1 docs) _f (1
docs) _g (1 docs) _h (1 docs) _i (1 docs) _j (1 docs) _k (1 docs) _l (1
docs) _m (1 docs) _n (1 docs) _o (1 docs) _p (1 docs) _q (1 docs) _r (1
docs) _s (1 docs) _t (1 docs) _u (1 docs) _v (1 docs) _w (1 docs) _x (1
docs) _y (1 docs) _z (1 docs) _10 (1 docs) _11 (1 docs) _12 (1 docs) _13
(1 docs) _14 (1 docs) _15 (1 docs) _16 (1 docs) _17 (1 docs) _18 (1 docs)
_19 (1 docs) _1a (1 docs) _1b (1 docs) _1c (1 docs) _1d (1 docs) into _1e
(50 docs)
040908 160805 merging segments _1f (1 docs) _1g (1 docs) _1h (1 docs) _1i
(1 docs) _1j (1 docs) _1k (1 docs) _1l (1 docs) _1m (1 docs) _1n (1 docs)
_1o (1 docs) _1p (1 docs) _1q (1 docs) _1r (1 docs) _1s (1 docs) _1t (1
docs) _1u (1 docs) _1v (1 docs) _1w (1 docs) _1x (1 docs) _1y (1 docs) _1z
(1 docs) _20 (1 docs) _21 (1 docs) _22 (1 docs) _23 (1 docs) _24 (1 docs)
_25 (1 docs) _26 (1 docs) _27 (1 docs) _28 (1 docs) _29 (1 docs) _2a (1
docs) _2b (1 docs) _2c (1 docs) _2d (1 docs) _2e (1 docs) _2f (1 docs) _2g
(1 docs) _2h (1 docs) _2i (1 docs) _2j (1 docs) _2k (1 docs) _2l (1 docs)
_2m (1 docs) _2n (1 docs) _2o (1 docs) _2p (1 docs) _2q (1 docs) _2r (1
docs) _2s (1 docs) into _2t (50 docs)
040908 160805 Optimizing index...
040908 160805 merging segments _1e (50 docs) _2t (50 docs) into _2u (100
docs)
040908 160805 done indexing
040908 160805 - deleting duplicates from indexes in
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50281\segments
040908 160805 No NutchFileSystem indicated, so defaulting to local fs.
040908 160805 Reading url hashes...
040908 160805 Sorting url hashes...
040908 160805 Deleting url duplicates...
040908 160805 Deleted 0 url duplicates.
040908 160805 Reading content hashes...
040908 160805 Sorting content hashes...
040908 160805 Deleting content duplicates...
040908 160805 Deleted 0 content duplicates.
040908 160805 Duplicate deletion complete locally. Now returning to NFS...
040908 160805 DeleteDuplicates complete
040908 160805 - creating merged index in
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50281\index
040908 160805 No NutchFileSystem indicated, so defaulting to local fs.
040908 160805 merging segment indexes to:
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50281\index
040908 160805 merging segments _2u (100 docs) _2u (100 docs) _2u (100
docs) _2u (100 docs) _2u (100 docs) into _0 (500 docs)
040908 160805 done merging
java.io.FileNotFoundException: C:\Documents and
Settings\Administrator\Local Settings\Temp\.smttest50281\index\segments
(The system cannot find the file specified)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:200)
at
org.apache.lucene.store.FSInputStream$Descriptor.<init>(FSDirectory.java:376)
at org.apache.lucene.store.FSInputStream.<init>(FSDirectory.java:405)
at org.apache.lucene.store.FSDirectory.openFile(FSDirectory.java:268)
at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:40)
at org.apache.lucene.index.IndexReader$1.doBody(IndexReader.java:116)
at org.apache.lucene.store.Lock$With.run(Lock.java:109)
at org.apache.lucene.index.IndexReader.open(IndexReader.java:111)
at org.apache.lucene.index.IndexReader.open(IndexReader.java:101)
at net.nutch.tools.SegmentMergeTool.run(SegmentMergeTool.java:188)
at net.nutch.tools.SegmentMergeTool.main(SegmentMergeTool.java:322)
at
net.nutch.tools.TestSegmentMergeTool.testUniqueMerge(TestSegmentMergeTool.java:153)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:324)
at junit.framework.TestCase.runTest(TestCase.java:154)
at junit.framework.TestCase.runBare(TestCase.java:127)
at junit.framework.TestResult$1.protect(TestResult.java:106)
at junit.framework.TestResult.runProtected(TestResult.java:124)
at junit.framework.TestResult.run(TestResult.java:109)
at junit.framework.TestCase.run(TestCase.java:118)
at junit.framework.TestSuite.runTest(TestSuite.java:208)
at junit.framework.TestSuite.run(TestSuite.java:203)
at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:326)
at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:560)
040908 160805 SEVERE C:\Documents and Settings\Administrator\Local
Settings\Temp\.smttest50281\index\segments (The system cannot find the
file specified)
040908 160806 Segment seg0: 100 entries.
040908 160806 Segment seg1: 100 entries.
040908 160806 Segment seg2: 100 entries.
040908 160806 Segment seg3: 100 entries.
040908 160806 Segment seg4: 100 entries.
040908 160806 TOTAL 500 input entries in 5 segments.
040908 160806 Looking for master index in null
040908 160806 Creating master unique index...
040908 160806 - creating missing index for seg0
040908 160806 No NutchFileSystem indicated, so defaulting to local fs.
040908 160806 indexing segment:
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50294\segments\seg0
040908 160806 merging segments _0 (1 docs) _1 (1 docs) _2 (1 docs) _3 (1
docs) _4 (1 docs) _5 (1 docs) _6 (1 docs) _7 (1 docs) _8 (1 docs) _9 (1
docs) _a (1 docs) _b (1 docs) _c (1 docs) _d (1 docs) _e (1 docs) _f (1
docs) _g (1 docs) _h (1 docs) _i (1 docs) _j (1 docs) _k (1 docs) _l (1
docs) _m (1 docs) _n (1 docs) _o (1 docs) _p (1 docs) _q (1 docs) _r (1
docs) _s (1 docs) _t (1 docs) _u (1 docs) _v (1 docs) _w (1 docs) _x (1
docs) _y (1 docs) _z (1 docs) _10 (1 docs) _11 (1 docs) _12 (1 docs) _13
(1 docs) _14 (1 docs) _15 (1 docs) _16 (1 docs) _17 (1 docs) _18 (1 docs)
_19 (1 docs) _1a (1 docs) _1b (1 docs) _1c (1 docs) _1d (1 docs) into _1e
(50 docs)
040908 160806 merging segments _1f (1 docs) _1g (1 docs) _1h (1 docs) _1i
(1 docs) _1j (1 docs) _1k (1 docs) _1l (1 docs) _1m (1 docs) _1n (1 docs)
_1o (1 docs) _1p (1 docs) _1q (1 docs) _1r (1 docs) _1s (1 docs) _1t (1
docs) _1u (1 docs) _1v (1 docs) _1w (1 docs) _1x (1 docs) _1y (1 docs) _1z
(1 docs) _20 (1 docs) _21 (1 docs) _22 (1 docs) _23 (1 docs) _24 (1 docs)
_25 (1 docs) _26 (1 docs) _27 (1 docs) _28 (1 docs) _29 (1 docs) _2a (1
docs) _2b (1 docs) _2c (1 docs) _2d (1 docs) _2e (1 docs) _2f (1 docs) _2g
(1 docs) _2h (1 docs) _2i (1 docs) _2j (1 docs) _2k (1 docs) _2l (1 docs)
_2m (1 docs) _2n (1 docs) _2o (1 docs) _2p (1 docs) _2q (1 docs) _2r (1
docs) _2s (1 docs) into _2t (50 docs)
040908 160806 Optimizing index...
040908 160806 merging segments _1e (50 docs) _2t (50 docs) into _2u (100
docs)
040908 160806 done indexing
040908 160806 - creating missing index for seg1
040908 160806 No NutchFileSystem indicated, so defaulting to local fs.
040908 160806 indexing segment:
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50294\segments\seg1
040908 160807 merging segments _0 (1 docs) _1 (1 docs) _2 (1 docs) _3 (1
docs) _4 (1 docs) _5 (1 docs) _6 (1 docs) _7 (1 docs) _8 (1 docs) _9 (1
docs) _a (1 docs) _b (1 docs) _c (1 docs) _d (1 docs) _e (1 docs) _f (1
docs) _g (1 docs) _h (1 docs) _i (1 docs) _j (1 docs) _k (1 docs) _l (1
docs) _m (1 docs) _n (1 docs) _o (1 docs) _p (1 docs) _q (1 docs) _r (1
docs) _s (1 docs) _t (1 docs) _u (1 docs) _v (1 docs) _w (1 docs) _x (1
docs) _y (1 docs) _z (1 docs) _10 (1 docs) _11 (1 docs) _12 (1 docs) _13
(1 docs) _14 (1 docs) _15 (1 docs) _16 (1 docs) _17 (1 docs) _18 (1 docs)
_19 (1 docs) _1a (1 docs) _1b (1 docs) _1c (1 docs) _1d (1 docs) into _1e
(50 docs)
040908 160807 merging segments _1f (1 docs) _1g (1 docs) _1h (1 docs) _1i
(1 docs) _1j (1 docs) _1k (1 docs) _1l (1 docs) _1m (1 docs) _1n (1 docs)
_1o (1 docs) _1p (1 docs) _1q (1 docs) _1r (1 docs) _1s (1 docs) _1t (1
docs) _1u (1 docs) _1v (1 docs) _1w (1 docs) _1x (1 docs) _1y (1 docs) _1z
(1 docs) _20 (1 docs) _21 (1 docs) _22 (1 docs) _23 (1 docs) _24 (1 docs)
_25 (1 docs) _26 (1 docs) _27 (1 docs) _28 (1 docs) _29 (1 docs) _2a (1
docs) _2b (1 docs) _2c (1 docs) _2d (1 docs) _2e (1 docs) _2f (1 docs) _2g
(1 docs) _2h (1 docs) _2i (1 docs) _2j (1 docs) _2k (1 docs) _2l (1 docs)
_2m (1 docs) _2n (1 docs) _2o (1 docs) _2p (1 docs) _2q (1 docs) _2r (1
docs) _2s (1 docs) into _2t (50 docs)
040908 160807 Optimizing index...
040908 160807 merging segments _1e (50 docs) _2t (50 docs) into _2u (100
docs)
040908 160807 done indexing
040908 160807 - creating missing index for seg2
040908 160807 No NutchFileSystem indicated, so defaulting to local fs.
040908 160807 indexing segment:
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50294\segments\seg2
040908 160807 merging segments _0 (1 docs) _1 (1 docs) _2 (1 docs) _3 (1
docs) _4 (1 docs) _5 (1 docs) _6 (1 docs) _7 (1 docs) _8 (1 docs) _9 (1
docs) _a (1 docs) _b (1 docs) _c (1 docs) _d (1 docs) _e (1 docs) _f (1
docs) _g (1 docs) _h (1 docs) _i (1 docs) _j (1 docs) _k (1 docs) _l (1
docs) _m (1 docs) _n (1 docs) _o (1 docs) _p (1 docs) _q (1 docs) _r (1
docs) _s (1 docs) _t (1 docs) _u (1 docs) _v (1 docs) _w (1 docs) _x (1
docs) _y (1 docs) _z (1 docs) _10 (1 docs) _11 (1 docs) _12 (1 docs) _13
(1 docs) _14 (1 docs) _15 (1 docs) _16 (1 docs) _17 (1 docs) _18 (1 docs)
_19 (1 docs) _1a (1 docs) _1b (1 docs) _1c (1 docs) _1d (1 docs) into _1e
(50 docs)
040908 160807 merging segments _1f (1 docs) _1g (1 docs) _1h (1 docs) _1i
(1 docs) _1j (1 docs) _1k (1 docs) _1l (1 docs) _1m (1 docs) _1n (1 docs)
_1o (1 docs) _1p (1 docs) _1q (1 docs) _1r (1 docs) _1s (1 docs) _1t (1
docs) _1u (1 docs) _1v (1 docs) _1w (1 docs) _1x (1 docs) _1y (1 docs) _1z
(1 docs) _20 (1 docs) _21 (1 docs) _22 (1 docs) _23 (1 docs) _24 (1 docs)
_25 (1 docs) _26 (1 docs) _27 (1 docs) _28 (1 docs) _29 (1 docs) _2a (1
docs) _2b (1 docs) _2c (1 docs) _2d (1 docs) _2e (1 docs) _2f (1 docs) _2g
(1 docs) _2h (1 docs) _2i (1 docs) _2j (1 docs) _2k (1 docs) _2l (1 docs)
_2m (1 docs) _2n (1 docs) _2o (1 docs) _2p (1 docs) _2q (1 docs) _2r (1
docs) _2s (1 docs) into _2t (50 docs)
040908 160807 Optimizing index...
040908 160807 merging segments _1e (50 docs) _2t (50 docs) into _2u (100
docs)
040908 160807 done indexing
040908 160807 - creating missing index for seg3
040908 160807 No NutchFileSystem indicated, so defaulting to local fs.
040908 160807 indexing segment:
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50294\segments\seg3
040908 160807 merging segments _0 (1 docs) _1 (1 docs) _2 (1 docs) _3 (1
docs) _4 (1 docs) _5 (1 docs) _6 (1 docs) _7 (1 docs) _8 (1 docs) _9 (1
docs) _a (1 docs) _b (1 docs) _c (1 docs) _d (1 docs) _e (1 docs) _f (1
docs) _g (1 docs) _h (1 docs) _i (1 docs) _j (1 docs) _k (1 docs) _l (1
docs) _m (1 docs) _n (1 docs) _o (1 docs) _p (1 docs) _q (1 docs) _r (1
docs) _s (1 docs) _t (1 docs) _u (1 docs) _v (1 docs) _w (1 docs) _x (1
docs) _y (1 docs) _z (1 docs) _10 (1 docs) _11 (1 docs) _12 (1 docs) _13
(1 docs) _14 (1 docs) _15 (1 docs) _16 (1 docs) _17 (1 docs) _18 (1 docs)
_19 (1 docs) _1a (1 docs) _1b (1 docs) _1c (1 docs) _1d (1 docs) into _1e
(50 docs)
040908 160807 merging segments _1f (1 docs) _1g (1 docs) _1h (1 docs) _1i
(1 docs) _1j (1 docs) _1k (1 docs) _1l (1 docs) _1m (1 docs) _1n (1 docs)
_1o (1 docs) _1p (1 docs) _1q (1 docs) _1r (1 docs) _1s (1 docs) _1t (1
docs) _1u (1 docs) _1v (1 docs) _1w (1 docs) _1x (1 docs) _1y (1 docs) _1z
(1 docs) _20 (1 docs) _21 (1 docs) _22 (1 docs) _23 (1 docs) _24 (1 docs)
_25 (1 docs) _26 (1 docs) _27 (1 docs) _28 (1 docs) _29 (1 docs) _2a (1
docs) _2b (1 docs) _2c (1 docs) _2d (1 docs) _2e (1 docs) _2f (1 docs) _2g
(1 docs) _2h (1 docs) _2i (1 docs) _2j (1 docs) _2k (1 docs) _2l (1 docs)
_2m (1 docs) _2n (1 docs) _2o (1 docs) _2p (1 docs) _2q (1 docs) _2r (1
docs) _2s (1 docs) into _2t (50 docs)
040908 160807 Optimizing index...
040908 160807 merging segments _1e (50 docs) _2t (50 docs) into _2u (100
docs)
040908 160807 done indexing
040908 160807 - creating missing index for seg4
040908 160807 No NutchFileSystem indicated, so defaulting to local fs.
040908 160807 indexing segment:
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50294\segments\seg4
040908 160807 merging segments _0 (1 docs) _1 (1 docs) _2 (1 docs) _3 (1
docs) _4 (1 docs) _5 (1 docs) _6 (1 docs) _7 (1 docs) _8 (1 docs) _9 (1
docs) _a (1 docs) _b (1 docs) _c (1 docs) _d (1 docs) _e (1 docs) _f (1
docs) _g (1 docs) _h (1 docs) _i (1 docs) _j (1 docs) _k (1 docs) _l (1
docs) _m (1 docs) _n (1 docs) _o (1 docs) _p (1 docs) _q (1 docs) _r (1
docs) _s (1 docs) _t (1 docs) _u (1 docs) _v (1 docs) _w (1 docs) _x (1
docs) _y (1 docs) _z (1 docs) _10 (1 docs) _11 (1 docs) _12 (1 docs) _13
(1 docs) _14 (1 docs) _15 (1 docs) _16 (1 docs) _17 (1 docs) _18 (1 docs)
_19 (1 docs) _1a (1 docs) _1b (1 docs) _1c (1 docs) _1d (1 docs) into _1e
(50 docs)
040908 160808 merging segments _1f (1 docs) _1g (1 docs) _1h (1 docs) _1i
(1 docs) _1j (1 docs) _1k (1 docs) _1l (1 docs) _1m (1 docs) _1n (1 docs)
_1o (1 docs) _1p (1 docs) _1q (1 docs) _1r (1 docs) _1s (1 docs) _1t (1
docs) _1u (1 docs) _1v (1 docs) _1w (1 docs) _1x (1 docs) _1y (1 docs) _1z
(1 docs) _20 (1 docs) _21 (1 docs) _22 (1 docs) _23 (1 docs) _24 (1 docs)
_25 (1 docs) _26 (1 docs) _27 (1 docs) _28 (1 docs) _29 (1 docs) _2a (1
docs) _2b (1 docs) _2c (1 docs) _2d (1 docs) _2e (1 docs) _2f (1 docs) _2g
(1 docs) _2h (1 docs) _2i (1 docs) _2j (1 docs) _2k (1 docs) _2l (1 docs)
_2m (1 docs) _2n (1 docs) _2o (1 docs) _2p (1 docs) _2q (1 docs) _2r (1
docs) _2s (1 docs) into _2t (50 docs)
040908 160808 Optimizing index...
040908 160808 merging segments _1e (50 docs) _2t (50 docs) into _2u (100
docs)
040908 160808 done indexing
040908 160808 - deleting duplicates from indexes in
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50294\segments
040908 160808 No NutchFileSystem indicated, so defaulting to local fs.
040908 160808 Reading url hashes...
040908 160808 Sorting url hashes...
040908 160808 Deleting url duplicates...
040908 160808 Deleted 400 url duplicates.
040908 160808 Reading content hashes...
040908 160808 Sorting content hashes...
040908 160808 Deleting content duplicates...
040908 160808 Deleted 0 content duplicates.
040908 160808 Duplicate deletion complete locally. Now returning to NFS...
040908 160808 DeleteDuplicates complete
040908 160808 - creating merged index in
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50294\index
040908 160808 No NutchFileSystem indicated, so defaulting to local fs.
040908 160808 merging segment indexes to:
c:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\.smttest50294\index
040908 160808 merging segments _2u (100 docs) _2u (100 docs) _2u (100
docs) _2u (100 docs) _2u (100 docs) into _0 (100 docs)
040908 160808 done merging
java.io.FileNotFoundException: C:\Documents and
Settings\Administrator\Local Settings\Temp\.smttest50294\index\segments
(The system cannot find the file specified)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:200)
at
org.apache.lucene.store.FSInputStream$Descriptor.<init>(FSDirectory.java:376)
at org.apache.lucene.store.FSInputStream.<init>(FSDirectory.java:405)
at org.apache.lucene.store.FSDirectory.openFile(FSDirectory.java:268)
at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:40)
at org.apache.lucene.index.IndexReader$1.doBody(IndexReader.java:116)
at org.apache.lucene.store.Lock$With.run(Lock.java:109)
at org.apache.lucene.index.IndexReader.open(IndexReader.java:111)
at org.apache.lucene.index.IndexReader.open(IndexReader.java:101)
at net.nutch.tools.SegmentMergeTool.run(SegmentMergeTool.java:188)
at net.nutch.tools.SegmentMergeTool.main(SegmentMergeTool.java:322)
at
net.nutch.tools.TestSegmentMergeTool.testSameMerge(TestSegmentMergeTool.java:183)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:324)
at junit.framework.TestCase.runTest(TestCase.java:154)
at junit.framework.TestCase.runBare(TestCase.java:127)
at junit.framework.TestResult$1.protect(TestResult.java:106)
at junit.framework.TestResult.runProtected(TestResult.java:124)
at junit.framework.TestResult.run(TestResult.java:109)
at junit.framework.TestCase.run(TestCase.java:118)
at junit.framework.TestSuite.runTest(TestSuite.java:208)
at junit.framework.TestSuite.run(TestSuite.java:203)
at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:326)
at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:560)
040908 160808 SEVERE C:\Documents and Settings\Administrator\Local
Settings\Temp\.smttest50294\index\segments (The system cannot find the
file specified)
------------- ---------------- ---------------
Testcase: testUniqueMerge took 4.938 sec
FAILED
null
junit.framework.AssertionFailedError
at
net.nutch.tools.TestSegmentMergeTool.testUniqueMerge(TestSegmentMergeTool.java:160)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
Testcase: testSameMerge took 2.625 sec
FAILED
null
junit.framework.AssertionFailedError
at
net.nutch.tools.TestSegmentMergeTool.testSameMerge(TestSegmentMergeTool.java:190)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> Andy Hedges wrote:
>> SegmentMergeTool seems to have stopped working normally - I ran the Unit
>> tests to sanity check and it seems they also point to this problem.
>>
>> I imagine someone familiar with the code can fix it faster than me :D
>>
>> The following test is failing:
>>
>> [junit] Running net.nutch.tools.TestSegmentMergeTool
>> [junit] Tests run: 2, Failures: 2, Errors: 0, Time elapsed: 7.578
>> sec
>> [junit] TEST net.nutch.tools.TestSegmentMergeTool FAILED
>
> Is this from a fresh version from CVS? I checked out nutch from CVS
> this morning and didn't have any problem with this unit test.
>
> Luke
>
>
> -------------------------------------------------------
> This SF.Net email is sponsored by BEA Weblogic Workshop
> FREE Java Enterprise J2EE developer tools!
> Get your free copy of BEA WebLogic Workshop 8.1 today.
> http://ads.osdn.com/?ad_id=5047&alloc_id=10808&op=click
> _______________________________________________
> Nutch-developers mailing list
> [EMAIL PROTECTED]
> https://lists.sourceforge.net/lists/listinfo/nutch-developers
>
-------------------------------------------------------
This SF.Net email is sponsored by BEA Weblogic Workshop
FREE Java Enterprise J2EE developer tools!
Get your free copy of BEA WebLogic Workshop 8.1 today.
http://ads.osdn.com/?ad_id=5047&alloc_id=10808&op=click
_______________________________________________
Nutch-developers mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/nutch-developers
