Ultimately this is dependent on what your metrics for success are. For some
places it may be just raw CTR (did my click through rate increase) but for
other places it may be a function of money (either it may be gross revenue,
profits, # items sold etc). I don't know if there is a generic answer
All,
Thank you for your comments and links, I will explore them.
I think that many people are facing similar questions - when they tune
their search engines. Especially in Solr/Lucene community. While the
requirements will be different, ultimately it is what they can do w
lucene/solr that guides
-
From:Roman Chyla roman.ch...@gmail.com
Sent: Tue 12-Feb-2013 23:04
To: solr-user@lucene.apache.org
Subject: what do you use for testing relevance?
Hi,
I do realize this is a very broad question, but still I need to ask it.
Suppose you make a change into the scoring formula. How do you
test
/A/B_testing
Cheers
Markus
-Original message-
From:Roman Chyla roman.ch...@gmail.com
Sent: Tue 12-Feb-2013 23:04
To: solr-user@lucene.apache.org
Subject: what do you use for testing relevance?
Hi,
I do realize this is a very broad question, but still I need to ask
Hi Roman,
We use our own Search Analytics service. It's free and open to anyone - see
http://sematext.com/search-analytics/index.html
And this post talks exactly about the topic you are asking about:
Hi Roman,
If you're looking for regression testing then
https://github.com/sul-dlss/rspec-solr might be worth looking at. If you're not
a ruby shop, doing something similar in another language shouldn't be to hard.
The basic idea is that you setup a set of tests like
If the query is X,
