Sorry, forgot to say: We use solr, so we apply the standard highlighter component (ie you could use lucene contrib one) -- this highlights either institute or organisation in the stored field string:
... / institute organisation / .... but we modify our JavaScript to display only the first term Eg 'institute' regardless of which term in the set matched. Ie we know the first term in the same position Was the original one, but leverage the in built Highlighter for simplicity (ESP in solr). bec :) Sent from my iPhone On 09/06/2010, at 10:32 AM, Rebecca Watson <bec.wat...@gmail.com> wrote: Hi aad, See the search.payload package if you want examples of reading in payloads at query time for scoring purposes, but returning the payload/ using it to highlight will require you to write more custom lucene classes. We work with synonyms too, but rather than store the synonym in payload like you do, we store any number of synonyms in the same position ie the standard trick for index-time synonym injection -- better because phrase queries will match across synonyms in the same doc. However, we define synonyms / equivalent terms prior to indexing so we don't use an anaylzer to add the extra terms-- instead we use an analyzer that sets the position increment attribute to 1 if it hits a special character and otherwise sets it to 0. See for eg of setting position attribute: org.apache.lucene.analysis.position.PositionFilter So eg if we use '/' to indicate new position we would use: ... / institute organisation / .... We apply this filter early on and it's still compatible with other lucene analysers. If you injected new synonyms in an analyzer, you would keep setting the term attribute until new synonyms are all added, then once you move to the next term, change position increment to 1 and update the term attribute. For the first synonym, make sure you set the position increment attribute back to 0. Hope that helps, bec :) Sent from my iPhone On 08/06/2010, at 3:19 PM, Aad Nales <aad.na...@gmail.com> wrote: Hi All, I storing synonyms in an index. e.g. 'institute' as a synonym for 'organization'. Since I want to highlight the orginal term when showing the result i am storing a Payload with each synononym. So in this case the term 'institute' has a payload for 'organization'. I execute a search and the document is found. Now i want to create the highlighting and here is where it goes wrong. I am unable to figure out how to 'read' the Payload from the document. Perhaps i am looking at it the wrong way? What i want to avoid is having to expand my search query with the synonyms. Is there anybody who could give me a hint how to go about this in lucene 3.0.1 tia, Aad --------------------------------------------------------------------- To unsubscribe, e-mail: <java-user-unsubscr...@lucene.apache.org> java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: <java-user-h...@lucene.apache.org> java-user-h...@lucene.apache.org
