Thanks again. I personally would think putting the doc in payload is cleaner because I'd have one less system to worry about. But if payload is one big field, retrieving specific fields would require additional parsing. Other than this, is there any reason I should not put the document in payload?
On Sun, Mar 8, 2009 at 12:02 PM, Otis Gospodnetic <otis_gospodne...@yahoo.com> wrote: > > Combining Lucene/Solr with an external document storage system is common. > CouchDB, BDB, etc. are all fine candidates. > Payloads are relatively new, yes. Storing fields in an external storage > system is the cleaner way to go. > > Otis > -- > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch > > > > ----- Original Message ---- >> From: jlist9 <jli...@gmail.com> >> To: solr-user@lucene.apache.org >> Sent: Sunday, March 8, 2009 2:59:50 PM >> Subject: Re: Store fields that are not defined in schema? >> >> Thanks Otis, for the quick reply. >> >> I see. I haven't used Payload before. Is it new in 1.3? >> >> So if I have documents that have very different fields, I should >> use an external document storage, such as CouchDB, and only >> store the indexed fields in Solr? Is this a recommended set up? >> How does this compare with using Payload? I'm assuming payload >> will be stored on disk only and will not affect indexing and searching >> performance. >> >> On Sun, Mar 8, 2009 at 11:54 AM, Otis Gospodnetic >> wrote: >> > >> > Hello, >> > >> > All fields you want to index or store in the index must be defined in the >> > Solr >> schema. If you prefer having schemaless indices, that's where straight >> Lucene >> without Solr can be helpful. You can store additional information for each >> term, though. This is known as "Payload". Perhaps that is how you can >> sneak in >> additional data in your documents. >> > >> > >> > Otis-- >> > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch >> > >> > >> > >> > ----- Original Message ---- >> >> From: jlist9 >> >> To: solr-user@lucene.apache.org >> >> Sent: Sunday, March 8, 2009 2:33:03 PM >> >> Subject: Store fields that are not defined in schema? >> >> >> >> I haven't tried this but is it possible to store fields that are not >> >> defined in solr schema and retrieve them in the result? >> >> >> >> I understand there could be conflicts in terms of how each document >> >> understand/defines these fields but since these fields are not >> >> defined, and thus not index, it should cause no trouble to the solr >> >> engine. So these fields would become document-local. >> >> >> >> This sounds useful in the case where multiple doc types are indexed in >> >> the same index. >> > >> > > >
