Re: Refresh of synonyms.txt without reload
Hi again, Walter Underwood wrote: More details on index-time vs. query-time synonyms are here: http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#SynonymFilter thx, for pointing that out - That's definitely s.th. worth revising. Butimho the issue of a changing synonyms.txt remainse, since the same FilterFactory is used to create the Filters for the index-time analyzer - so the question remains: How do I take care that if I reindex documents affected by new synonyms with the updated synonyms.txt without having to restart solr ? cheers, Axel -- View this message in context: http://www.nabble.com/Refresh-of-synonyms.txt-without-reload-tp19629361p19669366.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Refresh of synonyms.txt without reload
First, define separate analyzer/filter chains for index and query. Do not include synonyms in the query chain. Second, use a separate indexing system and use Solr index distribution to sync the indexes to one or more query systems. This will create a new Searcher and caches on the query systems, but it is less drastic than a restart. wunder On 9/25/08 6:19 AM, Batzenmann [EMAIL PROTECTED] wrote: thx, for pointing that out - That's definitely s.th. worth revising. Butimho the issue of a changing synonyms.txt remainse, since the same FilterFactory is used to create the Filters for the index-time analyzer - so the question remains: How do I take care that if I reindex documents affected by new synonyms with the updated synonyms.txt without having to restart solr ?
Re: Refresh of synonyms.txt without reload
Walter Underwood wrote: First, define separate analyzer/filter chains for index and query. Do not include synonyms in the query chain. Second, use a separate indexing system and use Solr index distribution to sync the indexes to one or more query systems. This will create a new Searcher and caches on the query systems, but it is less drastic than a restart. We already have separate analyzers for index/query-time as well as index distribution for master/slave searchers in place. Synonyms can be maintained via a web-app by our customer. Assuming you suggest to use solr as 'separate indexing system', I'll run into the same issue, where I still think restarting the app every time s.o. adds/removes/alters a synonym is not an desirable solution. Axel -- View this message in context: http://www.nabble.com/Refresh-of-synonyms.txt-without-reload-tp19629361p19671877.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Refresh of synonyms.txt without reload
Depending on how often synonyms are added you may or may not have/want to make Solr reload your synonyms. If you use index-time synonyms you definitely don't want to reindex every time they change if they change more frequently than what it takes to reindex. I believe you can use new MultiCore methods for loading/reloading cores to get synonyms to reload. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: Batzenmann [EMAIL PROTECTED] To: solr-user@lucene.apache.org Sent: Thursday, September 25, 2008 11:24:02 AM Subject: Re: Refresh of synonyms.txt without reload Walter Underwood wrote: First, define separate analyzer/filter chains for index and query. Do not include synonyms in the query chain. Second, use a separate indexing system and use Solr index distribution to sync the indexes to one or more query systems. This will create a new Searcher and caches on the query systems, but it is less drastic than a restart. We already have separate analyzers for index/query-time as well as index distribution for master/slave searchers in place. Synonyms can be maintained via a web-app by our customer. Assuming you suggest to use solr as 'separate indexing system', I'll run into the same issue, where I still think restarting the app every time s.o. adds/removes/alters a synonym is not an desirable solution. Axel -- View this message in context: http://www.nabble.com/Refresh-of-synonyms.txt-without-reload-tp19629361p19671877.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Refresh of synonyms.txt without reload
More details on index-time vs. query-time synonyms are here: http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#SynonymFilter wunder On 9/23/08 7:47 AM, Walter Underwood [EMAIL PROTECTED] wrote: This is probably not useful because synonyms work better at index time than at query time. Reloading synonyms also requires reindexing all the affected documents. wunder On 9/23/08 7:45 AM, Batzenmann [EMAIL PROTECTED] wrote: Hi, I'm quite new to solr and I'm looking for a way to extend the list of used synonyms used at query-time without having to reload the config. What I've found so far are these tow thread linked to below, of which neither really helped me out. Especially the MultiCore solution seems a little bit too much for 'just reloading' the synonyms.. Right now I would choose a solution where I'd extend the SynonymFilterFactory with a parameter for an interval in which it would look for an update of the synonyms source file (synonyms.txt). In case of an updated file the SynMap would be updated and from that point on the new synonyms would be included in the query analysis. Is this a valid approach? Would someone else find this usefull to? cheers, Axel http://www.nabble.com/SolrCore%2C-reload%2C-synonyms-not-reloaded-td19339767. h tml Multiple Solr Cores http://www.nabble.com/Re%3A-Is-it-possible-to-add-synonyms-run-time--td15089 1 11.html Re: Is it possible to add synonyms run time?
Refresh of synonyms.txt without reload
Hi, I'm quite new to solr and I'm looking for a way to extend the list of used synonyms used at query-time without having to reload the config. What I've found so far are these tow thread linked to below, of which neither really helped me out. Especially the MultiCore solution seems a little bit too much for 'just reloading' the synonyms.. Right now I would choose a solution where I'd extend the SynonymFilterFactory with a parameter for an interval in which it would look for an update of the synonyms source file (synonyms.txt). In case of an updated file the SynMap would be updated and from that point on the new synonyms would be included in the query analysis. Is this a valid approach? Would someone else find this usefull to? cheers, Axel http://www.nabble.com/SolrCore%2C-reload%2C-synonyms-not-reloaded-td19339767.html Multiple Solr Cores http://www.nabble.com/Re%3A-Is-it-possible-to-add-synonyms-run-time--td15089111.html Re: Is it possible to add synonyms run time? -- View this message in context: http://www.nabble.com/Refresh-of-synonyms.txt-without-reload-tp19629361p19629361.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Refresh of synonyms.txt without reload
This is probably not useful because synonyms work better at index time than at query time. Reloading synonyms also requires reindexing all the affected documents. wunder On 9/23/08 7:45 AM, Batzenmann [EMAIL PROTECTED] wrote: Hi, I'm quite new to solr and I'm looking for a way to extend the list of used synonyms used at query-time without having to reload the config. What I've found so far are these tow thread linked to below, of which neither really helped me out. Especially the MultiCore solution seems a little bit too much for 'just reloading' the synonyms.. Right now I would choose a solution where I'd extend the SynonymFilterFactory with a parameter for an interval in which it would look for an update of the synonyms source file (synonyms.txt). In case of an updated file the SynMap would be updated and from that point on the new synonyms would be included in the query analysis. Is this a valid approach? Would someone else find this usefull to? cheers, Axel http://www.nabble.com/SolrCore%2C-reload%2C-synonyms-not-reloaded-td19339767.h tml Multiple Solr Cores http://www.nabble.com/Re%3A-Is-it-possible-to-add-synonyms-run-time--td150891 11.html Re: Is it possible to add synonyms run time?
