Re: SOLR-1131: disconnect between fields created by poly fields

2009-12-13 Thread Grant Ingersoll
On Dec 12, 2009, at 12:08 AM, Lance Norskog wrote: There are already components (ExtractingRequestHandler, Deduplication) that secretly add fields which violate the schema. Personally I would nuke this ability; I've had major problems with junk in the indexed data and discovering secret

Re: SOLR-1131: disconnect between fields created by poly fields

2009-12-11 Thread Grant Ingersoll
On Dec 10, 2009, at 11:30 PM, Mattmann, Chris A (388J) wrote: Hi Yonik, While thinking about SOLR-1131, something important just came to mind. If we allow poly fields to add fields to the schema (be it via dynamic fields, or explicit field decls, either way), then we introduce a disconnect

Re: SOLR-1131: disconnect between fields created by poly fields

2009-12-11 Thread Mattmann, Chris A (388J)
Hi Grant: By declaring the poly field, you are declaring the dynamic field. I don't see why this leads to drift. Sure, it is an abstraction and their are Lucene fields that will be created under the hood, but that is one of the primary features of Solr, it hides all that mess. Actually if

Re: SOLR-1131: disconnect between fields created by poly fields

2009-12-11 Thread Yonik Seeley
On Fri, Dec 11, 2009 at 9:53 AM, Mattmann, Chris A (388J) chris.a.mattm...@jpl.nasa.gov wrote: Actually if it was the case that poly field mapped to a single dynamic field, then I would agree with you, but as is the discussion, poly field can map to _many_ dynamic fields, which is where the

Re: SOLR-1131: disconnect between fields created by poly fields

2009-12-11 Thread Lance Norskog
There are already components (ExtractingRequestHandler, Deduplication) that secretly add fields which violate the schema. Personally I would nuke this ability; I've had major problems with junk in the indexed data and discovering secret fields would have made my head explode that much louder. On

Re: SOLR-1131: disconnect between fields created by poly fields

2009-12-11 Thread Mattmann, Chris A (388J)
Hi Lance, On 12/11/09 9:08 PM, Lance Norskog goks...@gmail.com wrote: There are already components (ExtractingRequestHandler, Deduplication) that secretly add fields which violate the schema. Personally I would nuke this ability; I've had major problems with junk in the indexed data and

Re: SOLR-1131: disconnect between fields created by poly fields

2009-12-11 Thread Erik Hatcher
They don't violate the schema, do they? The fields added from both of those (and DIH too) all must be either fields or match dynamic field patterns. Right? Erik On Dec 12, 2009, at 6:08 AM, Lance Norskog wrote: There are already components (ExtractingRequestHandler,

SOLR-1131: disconnect between fields created by poly fields

2009-12-10 Thread Mattmann, Chris A (388J)
Hi All, While thinking about SOLR-1131, something important just came to mind. If we allow poly fields to add fields to the schema (be it via dynamic fields, or explicit field decls, either way), then we introduce a disconnect between the existing XML schema, and the runtime schema instance. To

Re: SOLR-1131: disconnect between fields created by poly fields

2009-12-10 Thread Yonik Seeley
On Thu, Dec 10, 2009 at 6:35 PM, Mattmann, Chris A (388J) chris.a.mattm...@jpl.nasa.gov wrote: While thinking about SOLR-1131, something important just came to mind. If we allow poly fields to add fields to the schema (be it via dynamic fields, or explicit field decls, either way), then we

Re: SOLR-1131: disconnect between fields created by poly fields

2009-12-10 Thread Mattmann, Chris A (388J)
Hi Yonik, While thinking about SOLR-1131, something important just came to mind. If we allow poly fields to add fields to the schema (be it via dynamic fields, or explicit field decls, either way), then we introduce a disconnect between the existing XML schema, and the runtime schema