Re: Standard tokenizer not considering emojis as special chars in solr 8.4.1, it does in solr 5

Hi All, Any suggestions on below observation, can i use Char Filter to retain old behavior of Standard Tokenizer ? Thanks, Deepu On Sat, Nov 28, 2020 at 4:59 PM Deepu wrote: > Hi All, > > We are in process of migrating from Solr 5 to solr 8, during testing > observed that Standard tokenizer

Standard tokenizer not considering emojis as special chars in solr 8.4.1, it does in solr 5

Hi All, We are in process of migrating from Solr 5 to solr 8, during testing observed that Standard tokenizer in Solr 5 was considering emojis as special chars and removing them apparently in Solr 8 it's considering them as regular chars so not removing while indexing. We need to retain same