Hi solr-user, Ya, I thought about replacing C1 with C2 in the underground raw data. However, it's a huge data set (over 10M news articles) so I give up this strategy eariler. My current temporary solution is going back to use 1-gram tokenizer ((i.e.StandardTokenizer) so I can only set 1 rule. But it is kinda ugly, especially when applying highlight, e.g. search "C1C2" Solr returns highlight snippet such as "...<em>C1</em><em>C2<em>...".
Scott Chu，scott....@udngroup.com 2015/10/22 ----- Original Message ----- From: Emir Arnautovic To: solr-user Date: 2015-10-22, 17:08:26 Subject: Re: Is it possible to specigfy only one-character term synonym for2-gram tokenizer? Hi Scott, I don't have experience with Chinese, but SynonymFilter works on tokens, so if CJKTokenizer recognizes C1 and Cm as tokens, it should work. If not, than you can try configuring PatternReplaceCharFilter to replace C1 to C2 during indexing and searching and get a match. Thanks, Emir On 22.10.2015 10:53, Scott Chu wrote: > Hi solr-user, > I always uses CJKTokenizer on appropriate amount of Chinese news > articles. Say in Chinese, character C1 has same meaning as > character C2 (e.g 台=臺), Is it possible that I only add this line in > synonym.txt: > C1,C2 (and in true exmaple: 台, 臺) > and by applying CJKTokenizer and SynonymFilter, I only have to query > "C1Cm..." (say Cm is arbitrary Chinese character) and Solr will > return documents that matche whether "C1Cm" or "C2Cm"? > Scott Chu，scott....@udngroup.com <mailto:scott....@udngroup.com> > 2015/10/22 > -- Monitoring * Alerting * Anomaly Detection * Centralized Log Management Solr & Elasticsearch Support * http://sematext.com/ ----- 未在此訊息中找到病毒。 已透過 AVG 檢查 - www.avg.com 版本: 2015.0.6172 / 病毒庫: 4450/10867 - 發佈日期: 10/21/15
