Displaying search result data - stored fields vs external source

2009-09-15 Thread Joel Halbert
Hi, When using Lucene I always consider two approaches to displaying search result data to users: 1. Store any fields that we index and display to users in the Lucene Documents themselves. When we perform a search simply retrieve the data to be displayed from the Lucence documents themselves. or

Re: Displaying search result data - stored fields vs external source

2009-09-15 Thread Erick Erickson
Categorically I store everything in the index unless/until I *know* it doesn'twork. With some things, it's easy to know from the outset, like if I have 20T of data to store. First, storing fields has minimal impact on the search speed, the stored text isn't interleaved with the search tokens, so t

Re: Displaying search result data - stored fields vs external source

2009-09-17 Thread Savvas-Andreas Moysidis
Hello , I would also prefer to store the content in the index because, as Erick points out this leads to a more simplified design but also because it allows me to preserve the relevance sort. If you store only the item id in the index then when extracting all the other required data from supp