Re: boosting words from specific list
Dear Koji, Hi, Thank you very much. Do you know any example code for UpdateRequestProcessor? Anything would be appreciated. Best regards. On Tue, Sep 30, 2014 at 3:41 AM, Koji Sekiguchi k...@r.email.ne.jp wrote: Hi Ali, I don't think Solr has such function OOTB. One way I can think of is that you can implement UpdateRequestProcessor. In processAdd() method of the UpdateRequestProcessor, as you can read field values, you can calculate the total score and copy the total score to a field e.g. total_score. Then you can sort the query result on total_score field when you query. Koji -- http://soleami.com/blog/comparing-document-classification-functions-of- lucene-and-mahout.html (2014/09/29 4:25), Ali Nazemian wrote: Dear all, Hi, I was wondering how can I implement solr boosting words from specific list of important words? I mean I want to have a list of important words and tell solr to score documents based on the weighted sum of these words. For example let word school has weight of 2 and word president has the weight of 5. In this case a doc with 2 school words and 3 president words will has the total score of 19! I want to sort documents based on this score. How such procedure is possible in solr? Thank you very much. Best regards. -- A.Nazemian
Re: boosting words from specific list
Dear Koji, Also would you please tell me how can I access the term frequency for each word? Should I do a word count on content or Is it possible to have access to reverse index information to make the process more efficient? I dont want to add too much time to the time of indexing documents. On Tue, Sep 30, 2014 at 7:07 PM, Ali Nazemian alinazem...@gmail.com wrote: Dear Koji, Hi, Thank you very much. Do you know any example code for UpdateRequestProcessor? Anything would be appreciated. Best regards. On Tue, Sep 30, 2014 at 3:41 AM, Koji Sekiguchi k...@r.email.ne.jp wrote: Hi Ali, I don't think Solr has such function OOTB. One way I can think of is that you can implement UpdateRequestProcessor. In processAdd() method of the UpdateRequestProcessor, as you can read field values, you can calculate the total score and copy the total score to a field e.g. total_score. Then you can sort the query result on total_score field when you query. Koji -- http://soleami.com/blog/comparing-document-classification-functions-of- lucene-and-mahout.html (2014/09/29 4:25), Ali Nazemian wrote: Dear all, Hi, I was wondering how can I implement solr boosting words from specific list of important words? I mean I want to have a list of important words and tell solr to score documents based on the weighted sum of these words. For example let word school has weight of 2 and word president has the weight of 5. In this case a doc with 2 school words and 3 president words will has the total score of 19! I want to sort documents based on this score. How such procedure is possible in solr? Thank you very much. Best regards. -- A.Nazemian -- A.Nazemian
Re: boosting words from specific list
I have not tried it but I would check the option of using the synonymFilter to duplicate certain query words . Anothe opt - you can detect these word at index time (eg. UpdateProcessor) to give these documents a document boost in case it fits your logic. Or even make a copy field that contains a whitelist words and query two fields each query - the original and the copyField. With debug query you'll be able to get the scores and adjust your boosts. Small issue, many solutions. Look what works for you Manuel
Re: boosting words from specific list
Hi Ali, May be you can leverage filter class=solr.KeepWordFilterFactory words=words.txt ignoreCase=true/ Ahmet On Sunday, September 28, 2014 10:25 PM, Ali Nazemian alinazem...@gmail.com wrote: Dear all, Hi, I was wondering how can I implement solr boosting words from specific list of important words? I mean I want to have a list of important words and tell solr to score documents based on the weighted sum of these words. For example let word school has weight of 2 and word president has the weight of 5. In this case a doc with 2 school words and 3 president words will has the total score of 19! I want to sort documents based on this score. How such procedure is possible in solr? Thank you very much. Best regards. -- A.Nazemian
Re: boosting words from specific list
Hi Ali, I don't think Solr has such function OOTB. One way I can think of is that you can implement UpdateRequestProcessor. In processAdd() method of the UpdateRequestProcessor, as you can read field values, you can calculate the total score and copy the total score to a field e.g. total_score. Then you can sort the query result on total_score field when you query. Koji -- http://soleami.com/blog/comparing-document-classification-functions-of-lucene-and-mahout.html (2014/09/29 4:25), Ali Nazemian wrote: Dear all, Hi, I was wondering how can I implement solr boosting words from specific list of important words? I mean I want to have a list of important words and tell solr to score documents based on the weighted sum of these words. For example let word school has weight of 2 and word president has the weight of 5. In this case a doc with 2 school words and 3 president words will has the total score of 19! I want to sort documents based on this score. How such procedure is possible in solr? Thank you very much. Best regards.
