Nutch 是一个刚刚诞生开放æº?代ç ?(open-source)çš„webæ?œç´¢å¼•æ“Ž.
- - -尽管Webæ?œç´¢æ˜¯æ¼«æ¸¸Internet的基本è¦?求, 但是现有webæ?œç´¢å¼•æ“Žçš„æ•°ç›®å?´åœ¨ä¸‹é™?. -并且这很有å?¯èƒ½è¿›ä¸€æ¥æ¼”å?˜æˆ?为一个公å?¸åž„æ–äº†å‡ ä¹Žæ‰€æœ‰çš„webæ?œç´¢ä¸ºå…¶è°‹å?–商业利益.这显然 -ä¸?利于广大Internet用户.
- -Nutch为我们æ??ä¾›äº†è¿™æ ·ä¸€ä¸ªä¸?å?Œçš„选择. 相对于那些商用的æ?œç´¢å¼•æ“Ž, Nutch作为开放æº?代ç ? -æ?œç´¢å¼•æ“Žå°†ä¼šæ›´åŠ é€?明, 从而更值得大家信赖. 现在所有主è¦?çš„æ?œç´¢å¼•æ“Žéƒ½é‡‡ç”¨ç§?有的排åº?算法, -而ä¸?会解释为什么一个网页会排在一个特定的ä½?ç½®. 除æ¤ä¹‹å¤–, 有的æ?œç´¢å¼•æ“Žä¾?照网站所付的 -费用, 而ä¸?æ˜¯æ ¹æ?®å®ƒä»¬æœ¬èº«çš„价值进行排åº?. 与它们ä¸?å?Œ, Nucth没有什么需è¦?éš?çž’, 也没有 -动机去æ‰æ›²æ?œç´¢çš„结果. Nutch将尽自己最大的努力为用户æ??供最好的æ?œç´¢ç»“æžœ.
- - -Nutch 致力于让æ¯?个人能很容易, å?Œæ—¶èŠ±è´¹å¾ˆå°‘å°±å?¯ä»¥é…?置世界一æµ?çš„Webæ?œç´¢å¼•æ“Ž. -为了完æˆ?这一å®?ä¼Ÿçš„ç›®æ ‡, Nutch必须能够å?šåˆ°:
- --
-
- æ¯?个月å?–å‡ å??亿网页 -
- 为这些网页维护一个索引 -
- 对索引文件进行�秒上�次的�索 -
- æ??供高质é‡?çš„æ?œç´¢ç»“æžœ -
- 以最�的�本�作 -
这是一个巨大的挑战. å¦‚æžœä½ ç›¸ä¿¡å®ƒçš„ä»·å€¼, è¯·ä¼¸å‡ºä½ çš„æ?´æ‰‹. ä½ å?¯ä»¥ -å?‚与开å?‘, 或是æ??ä¾›æ??èµ .
- - -Nutch ÊÇÒ»¸ö¸Õ¸Õµ®Éú¿ª·ÅÔ´´úÂë(open-source)µÄwebËÑË÷ÒýÇæ.
+ + +¾¡¹ÜWebËÑË÷ÊÇÂþÓÎInternetµÄ»ù±¾ÒªÇó, µ«ÊÇÏÖÓÐwebËÑË÷ÒýÇæµÄÊýÄ¿È´ÔÚϽµ. +²¢ÇÒÕâºÜÓпÉÄܽøÒ»²½Ñݱä³ÉΪһ¸ö¹«Ë¾Â¢¶ÏÁ˼¸ºõËùÓеÄwebËÑË÷ΪÆäıȡÉÌÒµÀûÒæ.ÕâÏÔÈ» +²»ÀûÓÚ¹ã´óInternetÓû§.
+ +NutchΪÎÒÃÇÌṩÁËÕâÑùÒ»¸ö²»Í¬µÄÑ¡Ôñ. Ïà¶ÔÓÚÄÇЩÉÌÓõÄËÑË÷ÒýÇæ, Nutch×÷Ϊ¿ª·ÅÔ´´úÂë +ËÑË÷ÒýÇ潫»á¸ü¼Ó͸Ã÷, ´Ó¶ø¸üÖµµÃ´ó¼ÒÐÅÀµ. ÏÖÔÚËùÓÐÖ÷ÒªµÄËÑË÷ÒýÇ涼²ÉÓÃ˽ÓеÄÅÅÐòËã·¨, +¶ø²»»á½âÊÍΪʲôһ¸öÍøÒ³»áÅÅÔÚÒ»¸öÌض¨µÄλÖÃ. ³ý´ËÖ®Íâ, ÓеÄËÑË÷ÒýÇæÒÀÕÕÍøÕ¾Ëù¸¶µÄ +·ÑÓÃ, ¶ø²»ÊǸù¾ÝËüÃDZ¾ÉíµÄ¼ÛÖµ½øÐÐÅÅÐò. ÓëËüÃDz»Í¬, NucthûÓÐʲôÐèÒªÒþÂ÷, ҲûÓÐ +¶¯»úȥŤÇúËÑË÷µÄ½á¹û. Nutch½«¾¡×Ô¼º×î´óµÄŬÁ¦ÎªÓû§Ìṩ×îºÃµÄËÑË÷½á¹û.
+ + +Nutch ÖÂÁ¦ÓÚÈÃÿ¸öÈËÄܺÜÈÝÒ×, ͬʱ»¨·ÑºÜÉپͿÉÒÔÅäÖÃÊÀ½çÒ»Á÷µÄWebËÑË÷ÒýÇæ. +ΪÁËÍê³ÉÕâÒ»ºêΰµÄÄ¿±ê, Nutch±ØÐëÄܹ»×öµ½:
+ +-
+
- ÿ¸öÔÂÈ¡¼¸Ê®ÒÚÍøÒ³ +
- ΪÕâЩÍøҳά»¤Ò»¸öË÷Òý +
- ¶ÔË÷ÒýÎļþ½øÐÐÿÃëÉÏǧ´ÎµÄËÑË÷ +
- Ìṩ¸ßÖÊÁ¿µÄËÑË÷½á¹û +
- ÒÔ×îСµÄ³É±¾ÔË×÷ +
ÕâÊÇÒ»¸ö¾Þ´óµÄÌôÕ½. Èç¹ûÄãÏàÐÅËüµÄ¼ÛÖµ, ÇëÉì³öÄãµÄÔ®ÊÖ. Äã¿ÉÒÔ +²ÎÓ뿪·¢, »òÊÇÌṩ¾èÔù.
+ + +查询
-使用Nutchæ?œç´¢, å?ªéœ€é”®å…¥ä¸€äº›å…³é”®è¯?è¯. --
-
- �索结果�包括�有 所有查询�的网页. -
- 使用å?Œå¼•å?·å°†ç›¸é‚»çš„è¯?作为çŸè¯åŒ…å?«èµ·æ?¥, 例如, "New Zealand". -
- 英文å?•è¯?之间的符å?·ä¼šè§¦å?‘çŸè¯åŒ¹é…?. å› æ¤æ?œç´¢http://www.nutch.org/ -ç‰å?ŒäºŽæ?œç´¢"http www -nutch org". -
- æ?œç´¢è‹±æ–‡å?•è¯?ä¸?区分大å°?写, å› æ¤æ?œç´¢NuTcH ç‰å?ŒäºŽæ?œç´¢ nUtCh. -
- ä½ å?¯ä»¥åœ¨ä¸€ä¸ªè¯?å‰?é?¢åŠ å‡?å?·ä¸›è€Œç¦?æ¢å®ƒå‡ºçŽ°åœ¨æ?œç´¢ç»“æžœä¸, 例如, æ?œç´¢football --nfl 会找到讨论football, 但ä¸?出现"nfl"的网页. -
结果
-在æ?œç´¢ç»“æžœä¸æ¯?个匹é…?的页é?¢éƒ½å?«æœ‰å¦‚下链结: - --
-
- (网页快照) 显示Nutch下载该网页时的内容. -
- (评分详解)显示Nutch如何给该网页打分. -
- (anchors)显示指�该网页而被Nutch索引的anchor文本. -
²éѯ
+ʹÓÃNutchËÑË÷, Ö»Ðè¼üÈëһЩ¹Ø¼ü´ÊÓï. +-
+
- ËÑË÷½á¹ûÖ»°üÀ¨º¬ÓÐ ËùÓвéѯ´ÊµÄÍøÒ³. +
- ʹÓÃË«ÒýºÅ½«ÏàÁڵĴÊ×÷Ϊ¶ÌÓï°üº¬ÆðÀ´, ÀýÈç, "New Zealand". +
- Ó¢Îĵ¥´ÊÖ®¼äµÄ·ûºÅ»á´¥·¢¶ÌÓïÆ¥Åä. Òò´ËËÑË÷http://www.nutch.org/ +µÈͬÓÚËÑË÷"http www +nutch org". +
- ËÑË÷Ó¢Îĵ¥´Ê²»Çø·Ö´óСд, Òò´ËËÑË÷NuTcH µÈͬÓÚËÑË÷ nUtCh. +
- Äã¿ÉÒÔÔÚÒ»¸ö´ÊÇ°Ãæ¼Ó¼õºÅ´Ô¶ø½ûÖ¹Ëü³öÏÖÔÚËÑË÷½á¹ûÖÐ, ÀýÈç, ËÑË÷football +-nfl »áÕÒµ½ÌÖÂÛfootball, µ«²»³öÏÖ"nfl"µÄÍøÒ³. +
½á¹û
+ÔÚËÑË÷½á¹ûÖÐÿ¸öÆ¥ÅäµÄÒ³Ã涼º¬ÓÐÈçÏÂÁ´½á: + +-
+
- (ÍøÒ³¿ìÕÕ) ÏÔʾNutchÏÂÔظÃÍøҳʱµÄÄÚÈÝ. +
- (ÆÀ·ÖÏê½â)ÏÔʾNutchÈçºÎ¸ø¸ÃÍøÒ³´ò·Ö. +
- (anchors)ÏÔʾָÏò¸ÃÍøÒ³¶ø±»NutchË÷ÒýµÄanchorÎı¾. +
A sample HTML parser filter plugin.
This plugin adds metadata to the parse for CreativeCommons licenses +found in the document.
+ + Index: src/plugin/index-basic/src/java/net/nutch/indexer/basic/package.html =================================================================== RCS file: src/plugin/index-basic/src/java/net/nutch/indexer/basic/package.html diff -N src/plugin/index-basic/src/java/net/nutch/indexer/basic/package.html --- /dev/null 1 Jan 1970 00:00:00 -0000 +++ src/plugin/index-basic/src/java/net/nutch/indexer/basic/package.html 1 Jan 1970 00:00:00 -0000 @@ -0,0 +1,5 @@ + + +A basic indexing plugin.
+ + Index: src/plugin/parse-html/src/java/net/nutch/parse/html/package.html =================================================================== RCS file: src/plugin/parse-html/src/java/net/nutch/parse/html/package.html diff -N src/plugin/parse-html/src/java/net/nutch/parse/html/package.html --- /dev/null 1 Jan 1970 00:00:00 -0000 +++ src/plugin/parse-html/src/java/net/nutch/parse/html/package.html 1 Jan 1970 00:00:00 -0000 @@ -0,0 +1,5 @@ + + +An HTML document parsing plugin.
This package relies on NekoHTML.
+ + Index: src/plugin/parse-msword/src/java/net/nutch/parse/msword/package.html =================================================================== RCS file: src/plugin/parse-msword/src/java/net/nutch/parse/msword/package.html diff -N src/plugin/parse-msword/src/java/net/nutch/parse/msword/package.html --- /dev/null 1 Jan 1970 00:00:00 -0000 +++ src/plugin/parse-msword/src/java/net/nutch/parse/msword/package.html 1 Jan 1970 00:00:00 -0000 @@ -0,0 +1,5 @@ + + +A Word document parsing plugin.
This package relies on POI.
+ + Index: src/plugin/parse-pdf/src/java/net/nutch/parse/pdf/package.html =================================================================== RCS file: src/plugin/parse-pdf/src/java/net/nutch/parse/pdf/package.html diff -N src/plugin/parse-pdf/src/java/net/nutch/parse/pdf/package.html --- /dev/null 1 Jan 1970 00:00:00 -0000 +++ src/plugin/parse-pdf/src/java/net/nutch/parse/pdf/package.html 1 Jan 1970 00:00:00 -0000 @@ -0,0 +1,5 @@ + + +A pdf parsing plugin.
This package relies on PDFBox.
+ + Index: src/plugin/parse-text/src/java/net/nutch/parse/text/package.html =================================================================== RCS file: src/plugin/parse-text/src/java/net/nutch/parse/text/package.html diff -N src/plugin/parse-text/src/java/net/nutch/parse/text/package.html --- /dev/null 1 Jan 1970 00:00:00 -0000 +++ src/plugin/parse-text/src/java/net/nutch/parse/text/package.html 1 Jan 1970 00:00:00 -0000 @@ -0,0 +1,5 @@ + + +A plain text parsing plugin.
+ + Index: src/plugin/protocol-file/src/java/net/nutch/protocol/file/package.html =================================================================== RCS file: src/plugin/protocol-file/src/java/net/nutch/protocol/file/package.html diff -N src/plugin/protocol-file/src/java/net/nutch/protocol/file/package.html --- /dev/null 1 Jan 1970 00:00:00 -0000 +++ src/plugin/protocol-file/src/java/net/nutch/protocol/file/package.html 1 Jan 1970 00:00:00 -0000 @@ -0,0 +1,5 @@ + + +Protocol plugin which supports retrieving local file resources.
+ + Index: src/plugin/protocol-ftp/src/java/net/nutch/protocol/ftp/package.html =================================================================== RCS file: src/plugin/protocol-ftp/src/java/net/nutch/protocol/ftp/package.html diff -N src/plugin/protocol-ftp/src/java/net/nutch/protocol/ftp/package.html --- /dev/null 1 Jan 1970 00:00:00 -0000 +++ src/plugin/protocol-ftp/src/java/net/nutch/protocol/ftp/package.html 1 Jan 1970 00:00:00 -0000 @@ -0,0 +1,5 @@ + + +Protocol plugin which supports retrieving documents via the ftp protocol.
+ + Index: src/plugin/protocol-http/src/java/net/nutch/protocol/http/package.html =================================================================== RCS file: src/plugin/protocol-http/src/java/net/nutch/protocol/http/package.html diff -N src/plugin/protocol-http/src/java/net/nutch/protocol/http/package.html --- /dev/null 1 Jan 1970 00:00:00 -0000 +++ src/plugin/protocol-http/src/java/net/nutch/protocol/http/package.html 1 Jan 1970 00:00:00 -0000 @@ -0,0 +1,5 @@ + + +Protocol plugin which supports retrieving documents via the http protocol.
+ +