Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change 
notification.

The "IndexStructure" page has been changed by LewisJohnMcgibbney:
http://wiki.apache.org/nutch/IndexStructure?action=diff&rev1=10&rev2=11

  ||'''Field Name'''||'''Stored'''||'''Index'''|| '''Indexing Filter/Plugin''' 
||'''Comment'''||
  ||    boost    ||     YES     ||      Not Indexed     ||      Indexer || ||
  ||    digest  ||      YES     ||      Not Indexed     ||      Indexer || ||
- ||    lang    ||      YES     ||      Un-Tokenized    ||      
language-identifier || ||
+ ||    lang    ||      YES     ||      Un-Tokenized    ||      
language-identifier || Add a '''lang''', language field to a document.||
  ||    segment ||              YES     ||      Not Indexed     ||      Indexer 
|| ||
  ||    tstamp  ||      YES     ||      Tokenized       ||      Indexer || ||
+ ||    cc:license      ||      YES     ||      Indexed, Tokenized      || 
creativecommons || Adds the entire license as '''cc:license=xxx''' and 
'''attributes''' extracted of the license url||
+ ||    cc:meta ||      YES     ||      Indexed, Tokenized      ||      
creativecommons || Adds the license location as '''cc:meta=xxx''' ||
+ ||    cc:type ||      YES     ||      Indexed,Tokenized       ||      
creativecommons || Adds the work type as '''cc:type=xxx'''||
  ||    anchor  ||      NO      ||      Tokenized       ||      index-anchor || 
Indexing filter that indexes all inbound '''anchor text''' for a document.||
  ||    title   ||      YES     ||      Tokenized       ||      index-basic     
|| Adds basic searchable '''title field''' to a document. Also indexed by 
index-more ||
  ||    site    ||      NO      ||      Un-Tokenized    ||      index-basic || 
Adds basic searchable '''site field''' to a document. ||
@@ -18, +21 @@

  ||    content         ||      NO      ||      Tokenized       ||      
index-basic     || Adds basic searchable '''content field''' to a document. ||
  ||    lastModified    ||      NO      ||      Indexed, Un-Tokenized   ||      
index-more || Adds some time related meta info in the form of 
'''last-modified''' if present. ||
  ||    date    ||      NO      ||      Indexed, Un-Tokenized   ||      
index-more || Index date as last-modified, or, if that's not present, uses 
fetch time. ||
- ||    contentLength   ||      NO      ||      Indexed, Un-Tokenized   ||      
index-more ||  ||
+ ||    contentLength   ||      NO      ||      Indexed, Un-Tokenized   ||      
index-more || /!\ NEEDS COMMENT/!\ ||
  ||    type    ||      NO      ||      Indexed, Un-Tokenized   ||      
index-more      || Adds contentType, primaryType, subType (all mime-types) ||
- ||    primaryType     ||      YES     ||      Un-Tokenized    ||      
index-more      ||      primaryType (mime-type) ||
+ ||    primaryType     ||      NO      ||      Indexed, Un-Tokenized   ||      
index-more      ||      primaryType (mime-type) ||
- ||    subType         ||      YES     ||      Un-Tokenized    ||      
index-more      ||      subType (mime-type) ||
+ ||    subType         ||      NO      ||      Indexed, Un-Tokenized   ||      
index-more      ||      subType (mime-type) ||
+ ||      tld             ||     YES      || Un-Tokenized / NotStored(based on 
conf) || tld || Adds a '''top level domain''' field to the document.  ||
+ ||      subcollection   ||    YES || Tokenized || subcollection || For 
Comprehensive description see 
src/java/org/apache/nutch/collection/'''package.html'''   ||
- ||      tld             ||     YES      || Un-Tokenized / NotStored(based on 
conf) || tld || see http://issues.apache.org/jira/browse/NUTCH-439 ||
- ||      category        ||    NO        || Un-Tokenized || index-url-category 
|| see http://issues.apache.org/jira/browse/NUTCH-386 ||
- ||      subcollection   ||    YES || Tokenized || subcollection || see 
subcollection plugin ||
  
  ----
  Jira Issues about indexing and IndexingFilterPlugins are 

Reply via email to