OK - so I have my SOLR instance running on AWS. Any suggestions on how to safely share the link? Right now, the whole SOLR instance is totally open.
Gagandeep singh <gagan.g...@gmail.com> wrote: >say &debugQuery=true&mlt=true and see the scores for the MLT query, not a >sample query. You can use Amazon ec2 to bring up your solr, you should be >able to get a micro instance for free trial. > > >On Mon, Apr 1, 2013 at 5:10 AM, dc tech <dctech1...@gmail.com> wrote: > >> I did try the raw query against the *simi* field and those seem to return >> results in the order expected. >> For instance, Acura MDX has ( large, SUV, 4WD Luxury) in the simi field. >> Running a query with those words against the simi field returns the >> expected models (X5, Audi Q5, etc) and then the subsequent documents have >> decreasing relevance. So the basic query mechanism seems to be fine. >> >> The issue just seems to be with MoreLikeThis component and handler. >> I can post the index on a public SOLR instance - any suggestions? (or for >> hosting) >> >> >> On Sun, Mar 31, 2013 at 1:54 PM, Gagandeep singh <gagan.g...@gmail.com >> >wrote: >> >> > If you can bring up your solr setup on a public machine then im sure a >> lot >> > of debugging can be done. Without that, i think what you should look at >> is >> > the tf-idf scores of the terms like "camry" etc. Usually idf is the >> > deciding factor into which results show at the top (tf should be 1 for >> your >> > data). >> > Enable &debugQuery=true and look at explain section to see show score is >> > getting calculated. >> > >> > You should try giving different boosts to class, type, drive, size to >> > control the results. >> > >> > >> > On Sun, Mar 31, 2013 at 8:52 PM, dc tech <dctech1...@gmail.com> wrote: >> > >> >> I am running some experiments on more like this and the results seem >> >> rather odd - I am doing something wrong but just cannot figure out what. >> >> Basically, the similarity results are decent - but not great. >> >> >> >> *Issue 1 = Quality* >> >> Toyota Camry : finds Altima (good) but then next one is Camry Hybrid >> >> whereas it should have found Accord. >> >> I have normalized the data into a simi field which has only the >> >> attributes that I care about. >> >> Without the simi field, I could not get mlt.qf boosts to work well >> enough >> >> to return results >> >> >> >> *Issue 2* >> >> Some fields do not work at all. For instance, text+simi (in mlt.fl) >> works >> >> whereas just simi does not. >> >> So some weirdness that am just not understanding. >> >> >> >> Would be grateful for your guidance ! >> >> >> >> >> >> Here is the setup: >> >> *1. SOLR Version* >> >> solr-spec 4.2.0.2013.03.06.22.32.13 >> >> solr-impl 4.2.0 1453694 rmuir - 2013-03-06 22:32:13 >> >> lucene-spec 4.2.0 >> >> lucene-impl 4.2.0 1453694 - rmuir - 2013-03-06 22:25:29 >> >> >> >> *2. Machine Information* >> >> Sun Microsystems Inc. Java HotSpot(TM) 64-Bit Server VM (1.6.0_23 >> >> 19.0-b09) >> >> Windows 7 Home 64 Bit with 4 GB RAM >> >> >> >> *3. Sample Data * >> >> I created this 'dummy' data of cars - the idea being that these would >> be >> >> sufficient and simple to generate similarity and understand how it would >> >> work. >> >> There are 181 rows in the data set (I have attached it for reference in >> >> CSV format) >> >> >> >> [image: Inline image 1] >> >> >> >> *4. SCHEMA* >> >> *Field Definitions* >> >> <field name="id" type="string" indexed="true" stored="true" >> >> termVectors="true" multiValued="false"/> >> >> <field name="make" type="string" indexed="true" stored="true" >> >> termVectors="true" multiValued="false"/> >> >> <field name="model" type="string" indexed="true" stored="true" >> >> termVectors="true" multiValued="false"/> >> >> <field name="class" type="string" indexed="true" stored="true" >> >> termVectors="true" multiValued="false"/> >> >> <field name="type" type="string" indexed="true" stored="true" >> >> termVectors="true" multiValued="false"/> >> >> <field name="drive" type="string" indexed="true" stored="true" >> >> termVectors="true" multiValued="false"/> >> >> <field name="comment" type="text_general" indexed="true" >> stored="true" >> >> termVectors="true" multiValued="true"/> >> >> <field name="size" type="string" indexed="true" stored="true" >> >> termVectors="true" multiValued="false"/> >> >> * >> >> * >> >> *Copy Fields* >> >> <copyField source="make" dest="make_en" /> <!-- Search --> >> >> <copyField source="model" dest="model_en" /> <!-- Search --> >> >> <copyField source="class" dest="class_en" /> <!-- Search --> >> >> <copyField source="type" dest="type_en" /> <!-- Search --> >> >> <copyField source="drive" dest="drive_en" /> <!-- Search --> >> >> <copyField source="comment" dest="comment_en" /> <!-- Search >> --> >> >> <copyField source="size" dest="size_en" /> <!-- Search --> >> >> <copyField source="id" dest="text" /> <!-- Glob --> >> >> <copyField source="make" dest="text" /> <!-- Glob --> >> >> <copyField source="model" dest="text" /> <!-- Glob --> >> >> <copyField source="class" dest="text" /> <!-- Glob --> >> >> <copyField source="type" dest="text" /> <!-- Glob --> >> >> <copyField source="drive" dest="text" /> <!-- Glob --> >> >> <copyField source="comment" dest="text" /> <!-- Glob --> >> >> <copyField source="size" dest="text" /> <!-- Glob --> >> >> <copyField source="size" dest="text" /> <!-- Glob --> >> >> *<copyField source="class" dest="simi_en" /> <!-- similarity >> >> -->* >> >> *<copyField source="type" dest="simi_en" /> <!-- similarity >> --> >> >> * >> >> *<copyField source="drive" dest="simi_en" /> <!-- similarity >> >> -->* >> >> *<copyField source="size" dest="simi_en" /> <!-- similarity >> --> >> >> * >> >> >> >> Note that the "simi" field ends up with values like make, class, size >> >> and drive: >> >> - Luxury SUV 4WD Large >> >> - Standard Sedan Front Familt >> >> >> >> >> >> *5. MLT Setup* >> >> a. mlt.FL = *text* QF=*text* Works but results are obviously not good >> >> (make is not a good similarity indicator) >> >> >> >> >> http://localhost:8983/solr/cars/select/?q=id:2&mlt=true&fl=text&mlt.fl=text&mlt.qf=text >> >> >> >> b. mlt.FL = *simi* QF=*simi* Does not work at all (0 results) >> >> >> >> >> http://localhost:8983/solr/cars/select/?q=id:2&mlt=true&fl=text&mlt.fl=simi&mlt.qf=simi >> >> >> >> c. mlt.FL = *simi,text * QF=*simi^10 text^.1* Works with decent >> >> results in most cases >> >> >> >> >> http://localhost:8983/solr/cars/select/?q=id:2&mlt=true&fl=text&mlt.fl=simi,text&mlt.qf=simi >> >> ^10%20text^.01 >> >> Works for getting similarity for Acura MDX (Luxury SUV 4WD Large) >> >> But for Toyota Camry - it finds hybrid family cars (Prius) ahead of >> Honda. >> >> >> >> >> >> * >> >> * >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> > >>
