Re: does solr support query time only stopwords?
Thanks to you all and finally it seems that I figured out a workaround. Yes I used edismax, but my test query was very simple, it only queries one field and uses only one stopword. So i see no chance it would hit another field (but datastax might have done something we don't know). &debug didn't yield useful information either. So what I did was to keep the stopFilterFactory element for index analyzer but without specifying our stopword file. I reindexed all solr cores. This time it seems like I could get stopwords frequency info from Luke, while queying stopwords returned 0 match. my wild guess is that the stopFilterFactory for index analyze serves as an overall "on" switch for the stopwords feature. Erick Erickson wrote > My _guess_ is that you're perhaps using > edismax or similar and getting matches from > fields you don't expect on terms you that are > not stopwords. Try adding &debug=query and > seeing what the parsed query actually is. > > And, of course, I have no idea what Datastax is > doing. > > And, you have to at least reload the core > to pick up the new stopwords. > > Best > Erick > > On Sat, Jun 8, 2013 at 6:33 PM, jchen2000 < > jchen200@ > > wrote: >> I wanted to analyze high frequency terms using Solr's Luke request >> handler >> and keep updating the stopwords file for new queries from time to time. >> Obviously I have to index all terms whether they belong to stopwords list >> or >> not. >> >> So I configured query analyzer stopwords list but disabled index analyzer >> stopwords list, However, it seems like the query would return all records >> containing stopwords after this. >> >> Anybody has an idea why this would happen? >> >> ps. I am using Datastax Enterprise 3.0.2 and the solr version is 4.0 >> >> >> >> -- >> View this message in context: >> http://lucene.472066.n3.nabble.com/does-solr-support-query-time-only-stopwords-tp4069087.html >> Sent from the Solr - User mailing list archive at Nabble.com. -- View this message in context: http://lucene.472066.n3.nabble.com/does-solr-support-query-time-only-stopwords-tp4069087p4069464.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: does solr support query time only stopwords?
My _guess_ is that you're perhaps using edismax or similar and getting matches from fields you don't expect on terms you that are not stopwords. Try adding &debug=query and seeing what the parsed query actually is. And, of course, I have no idea what Datastax is doing. And, you have to at least reload the core to pick up the new stopwords. Best Erick On Sat, Jun 8, 2013 at 6:33 PM, jchen2000 wrote: > I wanted to analyze high frequency terms using Solr's Luke request handler > and keep updating the stopwords file for new queries from time to time. > Obviously I have to index all terms whether they belong to stopwords list or > not. > > So I configured query analyzer stopwords list but disabled index analyzer > stopwords list, However, it seems like the query would return all records > containing stopwords after this. > > Anybody has an idea why this would happen? > > ps. I am using Datastax Enterprise 3.0.2 and the solr version is 4.0 > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/does-solr-support-query-time-only-stopwords-tp4069087.html > Sent from the Solr - User mailing list archive at Nabble.com.
Re: does solr support query time only stopwords?
Can you give examples? Show your field type config, the search terms you used. Also, did you reindex after changing your field type? As the index will be written using the analyser that was active at the time of indexing, so maybe your index still contains stop words. Upayavira On Sun, Jun 9, 2013, at 08:09 AM, jchen2000 wrote: > Nope. I only searched with individual stop words. Very strange to me > > > Otis Gospodnetic-5 wrote > > Maybe returned hits match other query terms. > > > > Otis > > Solr & ElasticSearch Support > > http://sematext.com/ > > On Jun 8, 2013 6:34 PM, "jchen2000" < > > > jchen200@ > > > > wrote: > > > >> I wanted to analyze high frequency terms using Solr's Luke request > >> handler > >> and keep updating the stopwords file for new queries from time to time. > >> Obviously I have to index all terms whether they belong to stopwords list > >> or > >> not. > >> > >> So I configured query analyzer stopwords list but disabled index analyzer > >> stopwords list, However, it seems like the query would return all records > >> containing stopwords after this. > >> > >> Anybody has an idea why this would happen? > >> > >> ps. I am using Datastax Enterprise 3.0.2 and the solr version is 4.0 > >> > >> > >> > >> -- > >> View this message in context: > >> http://lucene.472066.n3.nabble.com/does-solr-support-query-time-only-stopwords-tp4069087.html > >> Sent from the Solr - User mailing list archive at Nabble.com. > >> > > > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/does-solr-support-query-time-only-stopwords-tp4069087p4069143.html > Sent from the Solr - User mailing list archive at Nabble.com.
Re: does solr support query time only stopwords?
Nope. I only searched with individual stop words. Very strange to me Otis Gospodnetic-5 wrote > Maybe returned hits match other query terms. > > Otis > Solr & ElasticSearch Support > http://sematext.com/ > On Jun 8, 2013 6:34 PM, "jchen2000" < > jchen200@ > > wrote: > >> I wanted to analyze high frequency terms using Solr's Luke request >> handler >> and keep updating the stopwords file for new queries from time to time. >> Obviously I have to index all terms whether they belong to stopwords list >> or >> not. >> >> So I configured query analyzer stopwords list but disabled index analyzer >> stopwords list, However, it seems like the query would return all records >> containing stopwords after this. >> >> Anybody has an idea why this would happen? >> >> ps. I am using Datastax Enterprise 3.0.2 and the solr version is 4.0 >> >> >> >> -- >> View this message in context: >> http://lucene.472066.n3.nabble.com/does-solr-support-query-time-only-stopwords-tp4069087.html >> Sent from the Solr - User mailing list archive at Nabble.com. >> -- View this message in context: http://lucene.472066.n3.nabble.com/does-solr-support-query-time-only-stopwords-tp4069087p4069143.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: does solr support query time only stopwords?
Maybe returned hits match other query terms. Otis Solr & ElasticSearch Support http://sematext.com/ On Jun 8, 2013 6:34 PM, "jchen2000" wrote: > I wanted to analyze high frequency terms using Solr's Luke request handler > and keep updating the stopwords file for new queries from time to time. > Obviously I have to index all terms whether they belong to stopwords list > or > not. > > So I configured query analyzer stopwords list but disabled index analyzer > stopwords list, However, it seems like the query would return all records > containing stopwords after this. > > Anybody has an idea why this would happen? > > ps. I am using Datastax Enterprise 3.0.2 and the solr version is 4.0 > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/does-solr-support-query-time-only-stopwords-tp4069087.html > Sent from the Solr - User mailing list archive at Nabble.com. >
