AW: StandardTokenizerFactory behaviour
The behaviour of the StandardTokenizerFactory changed with solr 3.1. The actual output is now: Please, email, john.doe, foo.com, by, 03, 09, re, m37,xq Viele Grüße aus Augsburg Markus Klose SHI Elektronische Medien GmbH -Ursprüngliche Nachricht- Von: Alok Bhandari [mailto:alokomprakashbhand...@gmail.com] Gesendet: Dienstag, 19. Juni 2012 07:33 An: solr-user@lucene.apache.org Betreff: Re: StandardTokenizerFactory behaviour Just to make sure that there is no ambiguity the In: Please, email john@foo.com by 03-09, re: m37-xq. is the input given to this field for indexing and the Expected Out: Please, email, john@foo.com, by, 03-09, re, m37-xq is expected output tokens. -- View this message in context: http://lucene.472066.n3.nabble.com/StandardTokenizerFactory-behaviour-tp3990215p3990216.html Sent from the Solr - User mailing list archive at Nabble.com.
StandardTokenizerFactory behaviour
Hello , I am working on Solr from last few months and stuck some where , Analyzer in Field Definition : -- analyzer tokenizer class=solr.StandardTokenizerFactory/ /analyzer In: Please, email john@foo.com by 03-09, re: m37-xq. Expected Out: Please, email, john@foo.com, by, 03-09, re, m37-xq but not getting this. Is something wrong with my understanding of StandardTokenizer? I am using solr 3.6. Please let me know what is wrong with this. Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/StandardTokenizerFactory-behaviour-tp3990215.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: StandardTokenizerFactory behaviour
Just to make sure that there is no ambiguity the In: Please, email john@foo.com by 03-09, re: m37-xq. is the input given to this field for indexing and the Expected Out: Please, email, john@foo.com, by, 03-09, re, m37-xq is expected output tokens. -- View this message in context: http://lucene.472066.n3.nabble.com/StandardTokenizerFactory-behaviour-tp3990215p3990216.html Sent from the Solr - User mailing list archive at Nabble.com.
