Do you have the original document available ? Or stored in the field of interest ? Should be quite an easy test to reproduce the Analysis simply using the analysis tool Upaya and Erick suggested. Just use your real document content and you will see how it is exactly analysed.
Cheers 2015-06-30 15:03 GMT+01:00 dinesh naik <dineshkumarn...@gmail.com>: > Hi Erick, > > I agree with you. > > But i was checking if we could get hold on the whole document (to see all > analyzed field values) . > > There might be chances that field value is common for multiple documents . > In such cases it will be difficult to backtrack which document has the > issue . Because admin/analysis can be used to see for field level analysis > only. > > > > Best Regards, > Dinesh Naik > > On Tue, Jun 30, 2015 at 7:08 PM, Erick Erickson <erickerick...@gmail.com> > wrote: > > > Dinesh: > > > > This is what the admin/analysis page is for. It shows you exactly > > what tokens are produced by what steps in the analysis chain. > > That would be far better than trying to analyze the indexed > > terms. > > > > Best, > > Erick > > > > On Tue, Jun 30, 2015 at 8:35 AM, dinesh naik <dineshkumarn...@gmail.com> > > wrote: > > > Hi Erick, > > > This is mainly for debugging purpose. If i have 20M records and few > > fields > > > in some of the documents are not indexed as expected or something went > > > wrong during indexing then how do we pin point the exact issue and fix > > the > > > problem? > > > > > > > > > Best Regards, > > > Dinesh Naik > > > > > > On Tue, Jun 30, 2015 at 5:56 PM, Erick Erickson < > erickerick...@gmail.com > > > > > > wrote: > > > > > >> In short, not unless you want to get into low-level Lucene coding. > > >> Inverted indexes are, well, inverted so their very structure makes > > >> this difficult. It looks like this: > > >> > > >> But I'm not convinced yet that this isn't an XY problem. What is the > > >> high-level problem you're trying to solve here? Maybe there's another > > >> way to go about it. > > >> > > >> Best, > > >> Erick > > >> > > >> On Tue, Jun 30, 2015 at 3:32 AM, dinesh naik < > dineshkumarn...@gmail.com > > > > > >> wrote: > > >> > Thanks Eric and Upayavira for your inputs. > > >> > > > >> > Is there a way i can associate this to a unique id of document, > either > > >> > using schema browser or TermsComponent? > > >> > > > >> > Best Regards, > > >> > Dinesh Naik > > >> > > > >> > On Tue, Jun 30, 2015 at 2:55 AM, Upayavira <u...@odoko.co.uk> wrote: > > >> > > > >> >> Use the schema browser on the admin UI, and click the "load term > > info" > > >> >> button. It'll show you the terms in your index. > > >> >> > > >> >> You can also use the analysis tab which will show you how it would > > >> >> tokenise stuff for a specific field. > > >> >> > > >> >> Upayavira > > >> >> > > >> >> On Mon, Jun 29, 2015, at 06:53 PM, Dinesh Naik wrote: > > >> >> > Hi Eric, > > >> >> > By compressed value I meant value of a field after removing > special > > >> >> > characters . In my example its "-". Compressed form of red-apple > is > > >> >> > redapple . > > >> >> > > > >> >> > I wanted to know if we can see the analyzed version of fields . > > >> >> > > > >> >> > For example if I use ngram on a field , how do I see the analyzed > > >> values > > >> >> > in index ? > > >> >> > > > >> >> > > > >> >> > > > >> >> > > > >> >> > -----Original Message----- > > >> >> > From: "Erick Erickson" <erickerick...@gmail.com> > > >> >> > Sent: 29-06-2015 18:12 > > >> >> > To: "solr-user@lucene.apache.org" <solr-user@lucene.apache.org> > > >> >> > Subject: Re: Reading indexed data from solr 5.1.0 using > admin/luke? > > >> >> > > > >> >> > Not quite sure what you mean by "compressed values". admin/luke > > >> >> > doesn't show the results of the compression of the stored values, > > >> there's > > >> >> > no way I know of to do that. > > >> >> > > > >> >> > Best, > > >> >> > Erick > > >> >> > > > >> >> > On Mon, Jun 29, 2015 at 8:20 AM, dinesh naik < > > >> dineshkumarn...@gmail.com> > > >> >> > wrote: > > >> >> > > Hi all, > > >> >> > > > > >> >> > > Is there a way to read the indexed data for field on which the > > >> >> > > analysis/processing has been done ? > > >> >> > > > > >> >> > > I know using admin GUI we can see field wise analysis But how > > can i > > >> get > > >> >> > > hold on the complete document using admin/luke? or any other > way? > > >> >> > > > > >> >> > > For example, if i have 2 fields called name and compressedname. > > >> >> > > > > >> >> > > name has values like apple, green-apple,red-apple > > >> >> > > compressedname has values like apple,greenapple,redapple > > >> >> > > > > >> >> > > Even though i make both these field indexed=true and > stored=true > > >> >> > > > > >> >> > > I am not able to see the compressed values using > > >> >> admin/luke?id=<mydocid> > > >> >> > > > > >> >> > > in response i see something like this- > > >> >> > > > > >> >> > > > > >> >> > > <lst name="name "> > > >> >> > > <str name="type">string</str> > > >> >> > > <str name="schema">ITS--------------</str> > > >> >> > > <str name="flags">ITS--------------</str> > > >> >> > > <str name="value">GREEN-APPLE</str> > > >> >> > > <str name="internal">GREEN-APPLE</str> > > >> >> > > <float name="boost">1.0</float> > > >> >> > > <int name="docFreq">0</int> > > >> >> > > </lst> > > >> >> > > <lst name="compressedname"> > > >> >> > > <str name="type">string</str> > > >> >> > > <str name="schema">ITS--------------</str> > > >> >> > > <str name="flags">ITS--------------</str> > > >> >> > > <str name="value">GREEN-APPLE</str> > > >> >> > > <str name="internal">GREEN-APPLE</str> > > >> >> > > <float name="boost">1.0</float> > > >> >> > > <int name="docFreq">0</int> > > >> >> > > </lst> > > >> >> > > > > >> >> > > > > >> >> > > > > >> >> > > -- > > >> >> > > Best Regards, > > >> >> > > Dinesh Naik > > >> >> > > >> > > > >> > > > >> > > > >> > -- > > >> > Best Regards, > > >> > Dinesh Naik > > >> > > > > > > > > > > > > -- > > > Best Regards, > > > Dinesh Naik > > > > > > -- > Best Regards, > Dinesh Naik > -- -------------------------- Benedetti Alessandro Visiting card : http://about.me/alessandro_benedetti "Tyger, tyger burning bright In the forests of the night, What immortal hand or eye Could frame thy fearful symmetry?" William Blake - Songs of Experience -1794 England
