Re: [ANN] vifun: tool to help visually tweak Solr boosting
Hello Xavier, Thanks for uploading this and sharing. I also read the other messages in the thread. I'm able to get part way through your Getting Started section, I get results, but I get stuck on the editing values. I've tried with Java 6 and 7, with both the 0.5 binary and from the source distribution. What's working: * Default Solr 4.1 install (plus a couple extra fields in schema) * Able to connect to Solr (/collection1) * Able to select handler (/select) * Able to run a search: q=bandwidth rows=10 fl=title rest: pt=45.15,-93.85 (per your example) * Get 2 search results with titles * Able to select a result, mouse over, highlight score, etc. However, what I'm stuck on: * Below the Run Query button, I only see the grayed out Scoring slider. * The instructions say to highlight some numbers - I tried highlighting the 10 in rows paramour - I also tried the 45.15 in rest, and some of the scores in the results list I never see the extra parameters you show in this screen shot: https://raw.github.com/jmlucjav/vifun/master/img/screenshot-selecttarget.jpg I see the word Scoring: I don't see the blue text Select a number as a target to tweak I don't see the parameters qf, bf_0, 1, 2, bq_0, etc. I'm not sure how to get those extra fields to appear in the UI. I also tried adding defType=edismax, no luck The Handlers it sees: /select, /query, /browse, /spell, /tvrh, /clustering, /terms, /elevate (from default Solr 4.1 solrconfig.xml) I'm using /select -- Mark Bennett / LucidWorks: Search Big Data / mark.benn...@lucidworks.com Office: 408-898-4201 / Telecommute: 408-733-0387 / Cell: 408-829-6513 On Feb 23, 2013, at 6:12 AM, jmlucjav jmluc...@gmail.com wrote: Hi, I have built a small tool to help me tweak some params in Solr (typically qf, bf in edismax). As maybe others find it useful, I am open sourcing it on github: https://github.com/jmlucjav/vifun Check github for some more info and screenshots. I include part of the github page below. regards Description Did you ever spend lots of time trying to tweak all numbers in a *edismax* handler *qf*, *bf*, etc params so docs get scored to your liking? Imagine you have the params below, is 20 the right boosting for *name* or is it too much? Is *population* being boosted too much versus distance? What about new documents? !-- fields, boost some -- str name=qfname^20 textsuggest^10 edge^5 ngram^2 phonetic^1/str str name=mm33%/str !-- boost closest hits -- str name=bfrecip(geodist(),1,500,0)/str !-- boost by population -- str name=bfproduct(log(sum(population,1)),100)/str !-- boost newest docs -- str name=bfrecip(rord(moddate),1,1000,1000)/str This tool was developed in order to help me tweak the values of boosting functions etc in Solr, typically when using edismax handler. If you are fed up of: change a number a bit, restart Solr, run the same query to see how documents are scored now...then this tool is for you. https://github.com/jmlucjav/vifun#featuresFeatures - Can tweak numeric values in the following params: *qf, pf, bf, bq, boost, mm* (others can be easily added) even in *appends or invariants* - View side by side a Baseline query result and how it changes when you gradually change each value in the params - Colorized values, color depends on how the document does related to baseline query - Tooltips give you Explain info - Works on remote Solr installations - Tested with Solr 3.6, 4.0 and 4.1 (other versions would work too, as long as wt=javabin format is compatible) - Developed using Groovy/Griffon https://github.com/jmlucjav/vifun#requirementsRequirements - */select* handler should be available, and not have any *appends or invariants*, as it could interfere with how vifun works. - Java6 is needed (maybe it runs on Java5 too). A JRE should be enough. https://github.com/jmlucjav/vifun#getting-startedGetting started https://github.com/jmlucjav/vifun#click-here-to-download-latest-version-and-unzipClick here to download latest versionhttp://code.google.com/p/vifun/downloads/detail?name=vifun-0.4.zip and unzip - Run vifun-0.4\bin\vifun.bat or vifun-04\bin\vifun if on linux/OSX - Edit *Solr URL* to match yours (in Sol4.1 default is http://localhost:8983/solr/collection1 for example) [image: hander selection]https://github.com/jmlucjav/vifun/raw/master/img/screenshot-handlers.jpg - *Show Handerls*, and select the handler you wish to tweak from * Handerls* dropdown. The text area below shows the parameters of the handler. - Modify the values to run a baseline query: - *q*: query string you want to use - *rows*: as in Solr, don't choose a number too small, so you can see more documents, I typically use 500 - *fl*: comma separated list of fields you want to show for each doc, keep it
Re: [ANN] vifun: tool to help visually tweak Solr boosting
Hi Mark, Thanks for trying it out. Let me see if I explain it better: the number you have to select (in order to later being able to tweak it with the slider), is any number that must be in one of the parameters in the Scoring section. The issue you have, is that you are using /select handler from the example distribution, and that handler does not have any of these parameters (qf, pf, pf2, pf3, ps, ps2, ps3, bf, bq, boost, mm, tie), so it's normal they don't show up, there is nothing to tweak... In the example configuration from 4.1, you can select /browse handler, as it uses qf and mm, and you should be able to tweak them. Of course If you were using a real Solr installation with a sizable number of documents and some complex usage of edismax, you would be able to see much better what the tool can do. xavier On Mon, Mar 4, 2013 at 10:52 PM, Mark Bennett mark.benn...@lucidworks.comwrote: Hello Xavier, Thanks for uploading this and sharing. I also read the other messages in the thread. I'm able to get part way through your Getting Started section, I get results, but I get stuck on the editing values. I've tried with Java 6 and 7, with both the 0.5 binary and from the source distribution. What's working: * Default Solr 4.1 install (plus a couple extra fields in schema) * Able to connect to Solr (/collection1) * Able to select handler (/select) * Able to run a search: q=bandwidth rows=10 fl=title rest: pt=45.15,-93.85 (per your example) * Get 2 search results with titles * Able to select a result, mouse over, highlight score, etc. However, what I'm stuck on: * Below the Run Query button, I only see the grayed out Scoring slider. * The instructions say to highlight some numbers - I tried highlighting the 10 in rows paramour - I also tried the 45.15 in rest, and some of the scores in the results list I never see the extra parameters you show in this screen shot: https://raw.github.com/jmlucjav/vifun/master/img/screenshot-selecttarget.jpg I see the word Scoring: I don't see the blue text Select a number as a target to tweak I don't see the parameters qf, bf_0, 1, 2, bq_0, etc. I'm not sure how to get those extra fields to appear in the UI. I also tried adding defType=edismax, no luck The Handlers it sees: /select, /query, /browse, /spell, /tvrh, /clustering, /terms, /elevate (from default Solr 4.1 solrconfig.xml) I'm using /select -- Mark Bennett / LucidWorks: Search Big Data / mark.benn...@lucidworks.com Office: 408-898-4201 / Telecommute: 408-733-0387 / Cell: 408-829-6513 On Feb 23, 2013, at 6:12 AM, jmlucjav jmluc...@gmail.com wrote: Hi, I have built a small tool to help me tweak some params in Solr (typically qf, bf in edismax). As maybe others find it useful, I am open sourcing it on github: https://github.com/jmlucjav/vifun Check github for some more info and screenshots. I include part of the github page below. regards Description Did you ever spend lots of time trying to tweak all numbers in a *edismax* handler *qf*, *bf*, etc params so docs get scored to your liking? Imagine you have the params below, is 20 the right boosting for *name* or is it too much? Is *population* being boosted too much versus distance? What about new documents? !-- fields, boost some -- str name=qfname^20 textsuggest^10 edge^5 ngram^2 phonetic^1/str str name=mm33%/str !-- boost closest hits -- str name=bfrecip(geodist(),1,500,0)/str !-- boost by population -- str name=bfproduct(log(sum(population,1)),100)/str !-- boost newest docs -- str name=bfrecip(rord(moddate),1,1000,1000)/str This tool was developed in order to help me tweak the values of boosting functions etc in Solr, typically when using edismax handler. If you are fed up of: change a number a bit, restart Solr, run the same query to see how documents are scored now...then this tool is for you. https://github.com/jmlucjav/vifun#featuresFeatures - Can tweak numeric values in the following params: *qf, pf, bf, bq, boost, mm* (others can be easily added) even in *appends or invariants* - View side by side a Baseline query result and how it changes when you gradually change each value in the params - Colorized values, color depends on how the document does related to baseline query - Tooltips give you Explain info - Works on remote Solr installations - Tested with Solr 3.6, 4.0 and 4.1 (other versions would work too, as long as wt=javabin format is compatible) - Developed using Groovy/Griffon https://github.com/jmlucjav/vifun#requirementsRequirements - */select* handler should be available, and not have any *appends or invariants*, as it could interfere with how vifun works. - Java6 is needed (maybe it runs on Java5 too). A JRE should be enough.
Re: [ANN] vifun: tool to help visually tweak Solr boosting
Still problems running from source, see https://github.com/jmlucjav/vifun/issues/27 -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com Solr Training - www.solrtraining.com 26. feb. 2013 kl. 09:42 skrev jmlucjav jmluc...@gmail.com: To anyone that has tested this and is having an error: 2013-02-25 18:34:17,684 [main] INFO griffon.swing.SwingApplication - Initializing all startup groups: [vifun] 2013-02-25 18:34:18,575 [main] ERROR griffon.util.GriffonExceptionHandler - Uncaught Exception java.lang.NoClassDefFoundError: java.lang.invoke.MethodHandles at vifun.SolrOps.class$(SolrOps.groovy) at vifun.SolrOps.$get$$class$java$lang$invoke$ MethodHandles(SolrOps.groovy) The tool needs jdk1.7 to run, so if you are running something else you will get this error. I have updated the readme and I will upload a new dist that runs on jdk1.6 later today. xavier On Sat, Feb 23, 2013 at 3:12 PM, jmlucjav jmluc...@gmail.com wrote: Hi, I have built a small tool to help me tweak some params in Solr (typically qf, bf in edismax). As maybe others find it useful, I am open sourcing it on github: https://github.com/jmlucjav/vifun Check github for some more info and screenshots. I include part of the github page below. regards Description Did you ever spend lots of time trying to tweak all numbers in a *edismax* handler *qf*, *bf*, etc params so docs get scored to your liking? Imagine you have the params below, is 20 the right boosting for *name* or is it too much? Is *population* being boosted too much versus distance? What about new documents? !-- fields, boost some -- str name=qfname^20 textsuggest^10 edge^5 ngram^2 phonetic^1/str str name=mm33%/str !-- boost closest hits -- str name=bfrecip(geodist(),1,500,0)/str !-- boost by population -- str name=bfproduct(log(sum(population,1)),100)/str !-- boost newest docs -- str name=bfrecip(rord(moddate),1,1000,1000)/str This tool was developed in order to help me tweak the values of boosting functions etc in Solr, typically when using edismax handler. If you are fed up of: change a number a bit, restart Solr, run the same query to see how documents are scored now...then this tool is for you. https://github.com/jmlucjav/vifun#featuresFeatures - Can tweak numeric values in the following params: *qf, pf, bf, bq, boost, mm* (others can be easily added) even in *appends or invariants* - View side by side a Baseline query result and how it changes when you gradually change each value in the params - Colorized values, color depends on how the document does related to baseline query - Tooltips give you Explain info - Works on remote Solr installations - Tested with Solr 3.6, 4.0 and 4.1 (other versions would work too, as long as wt=javabin format is compatible) - Developed using Groovy/Griffon https://github.com/jmlucjav/vifun#requirementsRequirements - */select* handler should be available, and not have any *appends or invariants*, as it could interfere with how vifun works. - Java6 is needed (maybe it runs on Java5 too). A JRE should be enough. https://github.com/jmlucjav/vifun#getting-startedGetting started https://github.com/jmlucjav/vifun#click-here-to-download-latest-version-and-unzipClick here to download latest versionhttp://code.google.com/p/vifun/downloads/detail?name=vifun-0.4.zip and unzip - Run vifun-0.4\bin\vifun.bat or vifun-04\bin\vifun if on linux/OSX - Edit *Solr URL* to match yours (in Sol4.1 default is http://localhost:8983/solr/collection1 for example) [image: hander selection]https://github.com/jmlucjav/vifun/raw/master/img/screenshot-handlers.jpg - *Show Handerls*, and select the handler you wish to tweak from * Handerls* dropdown. The text area below shows the parameters of the handler. - Modify the values to run a baseline query: - *q*: query string you want to use - *rows*: as in Solr, don't choose a number too small, so you can see more documents, I typically use 500 - *fl*: comma separated list of fields you want to show for each doc, keep it short (other fields needed will be added, like the id, score) - *rest*: in case you need to add more params, for example: sfield, fq etc) [image: query params]https://github.com/jmlucjav/vifun/raw/master/img/screenshot-qparams.jpg - *Run Query*. The two panels on the right will show the same result, sorted by score.[image: results]https://github.com/jmlucjav/vifun/raw/master/img/screenshot-results.jpg - Use the mouse to select the number you want to tweak in Score params (select all the digits). Note the label of the field is highlighted with current value. [image: target selection]https://github.com/jmlucjav/vifun/raw/master/img/screenshot-selecttarget.jpg - Move the slider, release and see how a new query
Re: [ANN] vifun: tool to help visually tweak Solr boosting
Cool. I tried running from source (using the bundled griffonw), but I think the instructions may be wrong, had to download binary dist. The file permissions for bin/vifun in binary dist should have +w so you can execute it with ./vifun What about the ability to override the wt param, so that you can point it to the /browse handler directly? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com Solr Training - www.solrtraining.com 23. feb. 2013 kl. 15:12 skrev jmlucjav jmluc...@gmail.com: Hi, I have built a small tool to help me tweak some params in Solr (typically qf, bf in edismax). As maybe others find it useful, I am open sourcing it on github: https://github.com/jmlucjav/vifun Check github for some more info and screenshots. I include part of the github page below. regards Description Did you ever spend lots of time trying to tweak all numbers in a *edismax* handler *qf*, *bf*, etc params so docs get scored to your liking? Imagine you have the params below, is 20 the right boosting for *name* or is it too much? Is *population* being boosted too much versus distance? What about new documents? !-- fields, boost some -- str name=qfname^20 textsuggest^10 edge^5 ngram^2 phonetic^1/str str name=mm33%/str !-- boost closest hits -- str name=bfrecip(geodist(),1,500,0)/str !-- boost by population -- str name=bfproduct(log(sum(population,1)),100)/str !-- boost newest docs -- str name=bfrecip(rord(moddate),1,1000,1000)/str This tool was developed in order to help me tweak the values of boosting functions etc in Solr, typically when using edismax handler. If you are fed up of: change a number a bit, restart Solr, run the same query to see how documents are scored now...then this tool is for you. https://github.com/jmlucjav/vifun#featuresFeatures - Can tweak numeric values in the following params: *qf, pf, bf, bq, boost, mm* (others can be easily added) even in *appends or invariants* - View side by side a Baseline query result and how it changes when you gradually change each value in the params - Colorized values, color depends on how the document does related to baseline query - Tooltips give you Explain info - Works on remote Solr installations - Tested with Solr 3.6, 4.0 and 4.1 (other versions would work too, as long as wt=javabin format is compatible) - Developed using Groovy/Griffon https://github.com/jmlucjav/vifun#requirementsRequirements - */select* handler should be available, and not have any *appends or invariants*, as it could interfere with how vifun works. - Java6 is needed (maybe it runs on Java5 too). A JRE should be enough. https://github.com/jmlucjav/vifun#getting-startedGetting started https://github.com/jmlucjav/vifun#click-here-to-download-latest-version-and-unzipClick here to download latest versionhttp://code.google.com/p/vifun/downloads/detail?name=vifun-0.4.zip and unzip - Run vifun-0.4\bin\vifun.bat or vifun-04\bin\vifun if on linux/OSX - Edit *Solr URL* to match yours (in Sol4.1 default is http://localhost:8983/solr/collection1 for example) [image: hander selection]https://github.com/jmlucjav/vifun/raw/master/img/screenshot-handlers.jpg - *Show Handerls*, and select the handler you wish to tweak from * Handerls* dropdown. The text area below shows the parameters of the handler. - Modify the values to run a baseline query: - *q*: query string you want to use - *rows*: as in Solr, don't choose a number too small, so you can see more documents, I typically use 500 - *fl*: comma separated list of fields you want to show for each doc, keep it short (other fields needed will be added, like the id, score) - *rest*: in case you need to add more params, for example: sfield, fq etc) [image: query params]https://github.com/jmlucjav/vifun/raw/master/img/screenshot-qparams.jpg - *Run Query*. The two panels on the right will show the same result, sorted by score.[image: results]https://github.com/jmlucjav/vifun/raw/master/img/screenshot-results.jpg - Use the mouse to select the number you want to tweak in Score params (select all the digits). Note the label of the field is highlighted with current value. [image: target selection]https://github.com/jmlucjav/vifun/raw/master/img/screenshot-selecttarget.jpg - Move the slider, release and see how a new query is run, and you can compare how result changes with the current value. In the Current table, you can see current position/score and also delta relative to the baseline. The colour of the row reflects how much the doc gained/lost. [image: tweaking a value]https://github.com/jmlucjav/vifun/raw/master/img/screenshot-baseline.jpg - You can increase the limits of the slider, and if you are satisfied with a value, set it, so it will be set to current value.
Re: [ANN] vifun: tool to help visually tweak Solr boosting
Jan, thanks for looking at this! - Running from source: would you care to send me the error you get (if any) when running from source? I assume you have griffon1.1.0 installed right? - Binary dist: the distrib is created by griffon, so I'll check if the permission issue (I develop on windows, and tested on a clean windows too, so I don't face the issue you mention) is known or can be fixed somehow. I'll update the doc anyway. - wt param: I am already overriding wt param (in order to use javabin). What I didn't allow is to choose the handler to be used when submitting the query. I guess any handler that does not have appends/invariants that would interfere would work fine, I just thought /select is mostly available in most installations and that is one thing less to configure. But yes, I could let the user configure it, I'll open an issue. xavier On Mon, Feb 25, 2013 at 3:10 PM, Jan Høydahl jan@cominvent.com wrote: Cool. I tried running from source (using the bundled griffonw), but I think the instructions may be wrong, had to download binary dist. The file permissions for bin/vifun in binary dist should have +w so you can execute it with ./vifun What about the ability to override the wt param, so that you can point it to the /browse handler directly? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com Solr Training - www.solrtraining.com 23. feb. 2013 kl. 15:12 skrev jmlucjav jmluc...@gmail.com: Hi, I have built a small tool to help me tweak some params in Solr (typically qf, bf in edismax). As maybe others find it useful, I am open sourcing it on github: https://github.com/jmlucjav/vifun Check github for some more info and screenshots. I include part of the github page below. regards Description Did you ever spend lots of time trying to tweak all numbers in a *edismax* handler *qf*, *bf*, etc params so docs get scored to your liking? Imagine you have the params below, is 20 the right boosting for *name* or is it too much? Is *population* being boosted too much versus distance? What about new documents? !-- fields, boost some -- str name=qfname^20 textsuggest^10 edge^5 ngram^2 phonetic^1/str str name=mm33%/str !-- boost closest hits -- str name=bfrecip(geodist(),1,500,0)/str !-- boost by population -- str name=bfproduct(log(sum(population,1)),100)/str !-- boost newest docs -- str name=bfrecip(rord(moddate),1,1000,1000)/str This tool was developed in order to help me tweak the values of boosting functions etc in Solr, typically when using edismax handler. If you are fed up of: change a number a bit, restart Solr, run the same query to see how documents are scored now...then this tool is for you. https://github.com/jmlucjav/vifun#featuresFeatures - Can tweak numeric values in the following params: *qf, pf, bf, bq, boost, mm* (others can be easily added) even in *appends or invariants* - View side by side a Baseline query result and how it changes when you gradually change each value in the params - Colorized values, color depends on how the document does related to baseline query - Tooltips give you Explain info - Works on remote Solr installations - Tested with Solr 3.6, 4.0 and 4.1 (other versions would work too, as long as wt=javabin format is compatible) - Developed using Groovy/Griffon https://github.com/jmlucjav/vifun#requirementsRequirements - */select* handler should be available, and not have any *appends or invariants*, as it could interfere with how vifun works. - Java6 is needed (maybe it runs on Java5 too). A JRE should be enough. https://github.com/jmlucjav/vifun#getting-startedGetting started https://github.com/jmlucjav/vifun#click-here-to-download-latest-version-and-unzip Click here to download latest version http://code.google.com/p/vifun/downloads/detail?name=vifun-0.4.zip and unzip - Run vifun-0.4\bin\vifun.bat or vifun-04\bin\vifun if on linux/OSX - Edit *Solr URL* to match yours (in Sol4.1 default is http://localhost:8983/solr/collection1 for example) [image: hander selection] https://github.com/jmlucjav/vifun/raw/master/img/screenshot-handlers.jpg - *Show Handerls*, and select the handler you wish to tweak from * Handerls* dropdown. The text area below shows the parameters of the handler. - Modify the values to run a baseline query: - *q*: query string you want to use - *rows*: as in Solr, don't choose a number too small, so you can see more documents, I typically use 500 - *fl*: comma separated list of fields you want to show for each doc, keep it short (other fields needed will be added, like the id, score) - *rest*: in case you need to add more params, for example: sfield, fq etc) [image: query params]
Re: [ANN] vifun: tool to help visually tweak Solr boosting
Oh, wonderful! Thank you :) I was hacking some simple python/R scripts that can do a similar job for qf... the idea was to let the algorithm create possible combinations of params and compare that against the baseline. Would it be possible/easy to instruct the tool to harvest results for different combinations and export it? I would like to make plots similar to those: https://github.com/romanchyla/r-ranking-fun/blob/master/plots/raw/test-plot-showing-factors.pdf?raw=true roman On Sat, Feb 23, 2013 at 9:12 AM, jmlucjav jmluc...@gmail.com wrote: Hi, I have built a small tool to help me tweak some params in Solr (typically qf, bf in edismax). As maybe others find it useful, I am open sourcing it on github: https://github.com/jmlucjav/vifun Check github for some more info and screenshots. I include part of the github page below. regards Description Did you ever spend lots of time trying to tweak all numbers in a *edismax* handler *qf*, *bf*, etc params so docs get scored to your liking? Imagine you have the params below, is 20 the right boosting for *name* or is it too much? Is *population* being boosted too much versus distance? What about new documents? !-- fields, boost some -- str name=qfname^20 textsuggest^10 edge^5 ngram^2 phonetic^1/str str name=mm33%/str !-- boost closest hits -- str name=bfrecip(geodist(),1,500,0)/str !-- boost by population -- str name=bfproduct(log(sum(population,1)),100)/str !-- boost newest docs -- str name=bfrecip(rord(moddate),1,1000,1000)/str This tool was developed in order to help me tweak the values of boosting functions etc in Solr, typically when using edismax handler. If you are fed up of: change a number a bit, restart Solr, run the same query to see how documents are scored now...then this tool is for you. https://github.com/jmlucjav/vifun#featuresFeatures - Can tweak numeric values in the following params: *qf, pf, bf, bq, boost, mm* (others can be easily added) even in *appends or invariants* - View side by side a Baseline query result and how it changes when you gradually change each value in the params - Colorized values, color depends on how the document does related to baseline query - Tooltips give you Explain info - Works on remote Solr installations - Tested with Solr 3.6, 4.0 and 4.1 (other versions would work too, as long as wt=javabin format is compatible) - Developed using Groovy/Griffon https://github.com/jmlucjav/vifun#requirementsRequirements - */select* handler should be available, and not have any *appends or invariants*, as it could interfere with how vifun works. - Java6 is needed (maybe it runs on Java5 too). A JRE should be enough. https://github.com/jmlucjav/vifun#getting-startedGetting started https://github.com/jmlucjav/vifun#click-here-to-download-latest-version-and-unzip Click here to download latest versionhttp://code.google.com/p/vifun/downloads/detail?name=vifun-0.4.zip and unzip - Run vifun-0.4\bin\vifun.bat or vifun-04\bin\vifun if on linux/OSX - Edit *Solr URL* to match yours (in Sol4.1 default is http://localhost:8983/solr/collection1 for example) [image: hander selection] https://github.com/jmlucjav/vifun/raw/master/img/screenshot-handlers.jpg - *Show Handerls*, and select the handler you wish to tweak from * Handerls* dropdown. The text area below shows the parameters of the handler. - Modify the values to run a baseline query: - *q*: query string you want to use - *rows*: as in Solr, don't choose a number too small, so you can see more documents, I typically use 500 - *fl*: comma separated list of fields you want to show for each doc, keep it short (other fields needed will be added, like the id, score) - *rest*: in case you need to add more params, for example: sfield, fq etc) [image: query params] https://github.com/jmlucjav/vifun/raw/master/img/screenshot-qparams.jpg - *Run Query*. The two panels on the right will show the same result, sorted by score.[image: results] https://github.com/jmlucjav/vifun/raw/master/img/screenshot-results.jpg - Use the mouse to select the number you want to tweak in Score params (select all the digits). Note the label of the field is highlighted with current value. [image: target selection] https://github.com/jmlucjav/vifun/raw/master/img/screenshot-selecttarget.jpg - Move the slider, release and see how a new query is run, and you can compare how result changes with the current value. In the Current table, you can see current position/score and also delta relative to the baseline. The colour of the row reflects how much the doc gained/lost. [image: tweaking a value] https://github.com/jmlucjav/vifun/raw/master/img/screenshot-baseline.jpg - You can increase the limits of the
Re: [ANN] vifun: tool to help visually tweak Solr boosting
Hi Roman, I read with interest your thread about relevance testing a couple of weeks ago and yes, I noticed it was related somehow. But what you were proposing there is a different approach I think. In my tool, you have some baseline setting (it might be good or bad), and using a single query, you can visually see how documents rank differently when changing parameters. But the way to see the difference is the user's eye, and I am not using any statistical measurement to compare both settings. So it is a bit limited. In your approach I understand that you have some data that allows you to measure how well queries do (like clicks etc). So I think your approach is more useful, but probably harder to achieve. Not sure how I could merge that into my tool. In order to test, myself, I am working on some Geb tests ( http://www.gebish.org/testing) to check things like Steffen proposes on your thread. regards xavier On Mon, Feb 25, 2013 at 8:23 PM, Roman Chyla roman.ch...@gmail.com wrote: Oh, wonderful! Thank you :) I was hacking some simple python/R scripts that can do a similar job for qf... the idea was to let the algorithm create possible combinations of params and compare that against the baseline. Would it be possible/easy to instruct the tool to harvest results for different combinations and export it? I would like to make plots similar to those: https://github.com/romanchyla/r-ranking-fun/blob/master/plots/raw/test-plot-showing-factors.pdf?raw=true roman On Sat, Feb 23, 2013 at 9:12 AM, jmlucjav jmluc...@gmail.com wrote: Hi, I have built a small tool to help me tweak some params in Solr (typically qf, bf in edismax). As maybe others find it useful, I am open sourcing it on github: https://github.com/jmlucjav/vifun Check github for some more info and screenshots. I include part of the github page below. regards Description Did you ever spend lots of time trying to tweak all numbers in a *edismax* handler *qf*, *bf*, etc params so docs get scored to your liking? Imagine you have the params below, is 20 the right boosting for *name* or is it too much? Is *population* being boosted too much versus distance? What about new documents? !-- fields, boost some -- str name=qfname^20 textsuggest^10 edge^5 ngram^2 phonetic^1/str str name=mm33%/str !-- boost closest hits -- str name=bfrecip(geodist(),1,500,0)/str !-- boost by population -- str name=bfproduct(log(sum(population,1)),100)/str !-- boost newest docs -- str name=bfrecip(rord(moddate),1,1000,1000)/str This tool was developed in order to help me tweak the values of boosting functions etc in Solr, typically when using edismax handler. If you are fed up of: change a number a bit, restart Solr, run the same query to see how documents are scored now...then this tool is for you. https://github.com/jmlucjav/vifun#featuresFeatures - Can tweak numeric values in the following params: *qf, pf, bf, bq, boost, mm* (others can be easily added) even in *appends or invariants* - View side by side a Baseline query result and how it changes when you gradually change each value in the params - Colorized values, color depends on how the document does related to baseline query - Tooltips give you Explain info - Works on remote Solr installations - Tested with Solr 3.6, 4.0 and 4.1 (other versions would work too, as long as wt=javabin format is compatible) - Developed using Groovy/Griffon https://github.com/jmlucjav/vifun#requirementsRequirements - */select* handler should be available, and not have any *appends or invariants*, as it could interfere with how vifun works. - Java6 is needed (maybe it runs on Java5 too). A JRE should be enough. https://github.com/jmlucjav/vifun#getting-startedGetting started https://github.com/jmlucjav/vifun#click-here-to-download-latest-version-and-unzip Click here to download latest version http://code.google.com/p/vifun/downloads/detail?name=vifun-0.4.zip and unzip - Run vifun-0.4\bin\vifun.bat or vifun-04\bin\vifun if on linux/OSX - Edit *Solr URL* to match yours (in Sol4.1 default is http://localhost:8983/solr/collection1 for example) [image: hander selection] https://github.com/jmlucjav/vifun/raw/master/img/screenshot-handlers.jpg - *Show Handerls*, and select the handler you wish to tweak from * Handerls* dropdown. The text area below shows the parameters of the handler. - Modify the values to run a baseline query: - *q*: query string you want to use - *rows*: as in Solr, don't choose a number too small, so you can see more documents, I typically use 500 - *fl*: comma separated list of fields you want to show for each doc, keep it short (other fields needed will be added, like the
Re: [ANN] vifun: tool to help visually tweak Solr boosting
This is cool! I had done something similar except changing via JConsole/JMX: https://issues.apache.org/jira/browse/SOLR-2306 We had something not as nice at Zvents but I wanted to expose these as MBean properties so you could change them via any JMX UI like JVisualVM Cheers! Amit On Mon, Feb 25, 2013 at 2:36 PM, jmlucjav jmluc...@gmail.com wrote: Apologies...instructions are wrong on the cd, these commands are to be run at the top level of the project...I fixed the doc to read: cd vifun griffon run-app On Mon, Feb 25, 2013 at 10:45 PM, Jan Høydahl jan@cominvent.com wrote: Hi, I actually tried ../griffonw run-app but it says griffon-app does not appear to be part of a Griffon application. I installed griffon and tried again griffon run-app inside of griffon-app, but same error. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com Solr Training - www.solrtraining.com 25. feb. 2013 kl. 19:51 skrev jmlucjav jmluc...@gmail.com: Jan, thanks for looking at this! - Running from source: would you care to send me the error you get (if any) when running from source? I assume you have griffon1.1.0 installed right? - Binary dist: the distrib is created by griffon, so I'll check if the permission issue (I develop on windows, and tested on a clean windows too, so I don't face the issue you mention) is known or can be fixed somehow. I'll update the doc anyway. - wt param: I am already overriding wt param (in order to use javabin). What I didn't allow is to choose the handler to be used when submitting the query. I guess any handler that does not have appends/invariants that would interfere would work fine, I just thought /select is mostly available in most installations and that is one thing less to configure. But yes, I could let the user configure it, I'll open an issue. xavier On Mon, Feb 25, 2013 at 3:10 PM, Jan Høydahl jan@cominvent.com wrote: Cool. I tried running from source (using the bundled griffonw), but I think the instructions may be wrong, had to download binary dist. The file permissions for bin/vifun in binary dist should have +w so you can execute it with ./vifun What about the ability to override the wt param, so that you can point it to the /browse handler directly? -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com Solr Training - www.solrtraining.com 23. feb. 2013 kl. 15:12 skrev jmlucjav jmluc...@gmail.com: Hi, I have built a small tool to help me tweak some params in Solr (typically qf, bf in edismax). As maybe others find it useful, I am open sourcing it on github: https://github.com/jmlucjav/vifun Check github for some more info and screenshots. I include part of the github page below. regards Description Did you ever spend lots of time trying to tweak all numbers in a *edismax* handler *qf*, *bf*, etc params so docs get scored to your liking? Imagine you have the params below, is 20 the right boosting for *name* or is it too much? Is *population* being boosted too much versus distance? What about new documents? !-- fields, boost some -- str name=qfname^20 textsuggest^10 edge^5 ngram^2 phonetic^1/str str name=mm33%/str !-- boost closest hits -- str name=bfrecip(geodist(),1,500,0)/str !-- boost by population -- str name=bfproduct(log(sum(population,1)),100)/str !-- boost newest docs -- str name=bfrecip(rord(moddate),1,1000,1000)/str This tool was developed in order to help me tweak the values of boosting functions etc in Solr, typically when using edismax handler. If you are fed up of: change a number a bit, restart Solr, run the same query to see how documents are scored now...then this tool is for you. https://github.com/jmlucjav/vifun#featuresFeatures - Can tweak numeric values in the following params: *qf, pf, bf, bq, boost, mm* (others can be easily added) even in *appends or invariants* - View side by side a Baseline query result and how it changes when you gradually change each value in the params - Colorized values, color depends on how the document does related to baseline query - Tooltips give you Explain info - Works on remote Solr installations - Tested with Solr 3.6, 4.0 and 4.1 (other versions would work too, as long as wt=javabin format is compatible) - Developed using Groovy/Griffon https://github.com/jmlucjav/vifun#requirementsRequirements - */select* handler should be available, and not have any *appends or invariants*, as it could interfere with how vifun works. - Java6 is needed (maybe it runs on Java5 too). A JRE should be enough. https://github.com/jmlucjav/vifun#getting-startedGetting started
