Hi again Everyone, I didn't get any replies to this, so I thought I'd re-send in case anyone missed it and has any thoughts.
Thanks, Eric On Aug 7, 2013, at 1:51 PM, Eric O'Hanlon <elo2...@columbia.edu> wrote: > Hi Everyone, > > I'm facing an issue in which my solr query is returning highlighted snippets > for some, but not all results. For reference, I'm searching through an index > that contains web crawls of human-rights-related websites. I'm running solr > as a webapp under Tomcat and I've included the query's solr params from the > Tomcat log: > > ... > webapp=/solr-4.2 > path=/select > params={facet=true&sort=score+desc&group.limit=10&spellcheck.q=Unangan&f.mimetype_code.facet.limit=7&hl.simple.pre=<code>&q.alt=*:*&f.organization_type__facet.facet.limit=6&f.language__facet.facet.limit=6&hl=true&f.date_of_capture_yyyy.facet.limit=6&group.field=original_url&hl.simple.post=</code>&facet.field=domain&facet.field=date_of_capture_yyyy&facet.field=mimetype_code&facet.field=geographic_focus__facet&facet.field=organization_based_in__facet&facet.field=organization_type__facet&facet.field=language__facet&facet.field=creator_name__facet&hl.fragsize=600&f.creator_name__facet.facet.limit=6&facet.mincount=1&qf=text^1&hl.fl=contents&hl.fl=title&hl.fl=original_url&wt=ruby&f.geographic_focus__facet.facet.limit=6&defType=edismax&rows=10&f.domain.facet.limit=6&q=Unangan&f.organization_based_in__facet.facet.limit=6&q.op=AND&group=true&hl.usePhraseHighlighter=true} > hits=8 status=0 QTime=108 > ... > > For the query above (which can be simplified to say: find all documents that > contain the word "unangan" and return facets, highlights, etc.), I get five > search results. Only three of these are returning highlighted snippets. > Here's the "highlighting" portion of the solr response (note: printed in ruby > notation because I'm receiving this response in a Rails app): > > -------- > "highlighting"=> > > {"20100602195444/http://www.kontras.org/uu_ri_ham/UU%20Nomor%2023%20Tahun%202002%20tentang%20Perlindungan%20Anak.pdf"=> > {}, > > "20100902203939/http://www.kontras.org/uu_ri_ham/UU%20Nomor%2023%20Tahun%202002%20tentang%20Perlindungan%20Anak.pdf"=> > {}, > > "20111202233029/http://www.kontras.org/uu_ri_ham/UU%20Nomor%2023%20Tahun%202002%20tentang%20Perlindungan%20Anak.pdf"=> > {}, > "20100618201646/http://www.komnasham.go.id/portal/files/39-99.pdf"=> > {"contents"=> > ["...actual snippet is returned here..."]}, > "20100902235358/http://www.komnasham.go.id/portal/files/39-99.pdf"=> > {"contents"=> > ["...actual snippet is returned here..."]}, > > "20110302213056/http://www.komnasham.go.id/publikasi/doc_download/2-uu-no-39-tahun-1999"=> > {"contents"=> > ["...actual snippet is returned here..."]}, > > "20110302213102/http://www.komnasham.go.id/publikasi/doc_view/2-uu-no-39-tahun-1999?tmpl=component&format=raw"=> > {"contents"=> > ["...actual snippet is returned here..."]}, > > "20120303113654/http://www.iwgia.org/iwgia_files_publications_files/0028_Utimut_heritage.pdf"=> > {}} > -------- > > I have eight (as opposed to five) results above because I'm also doing a > grouped query, grouping by a field called "original_url", and this leads to > five grouped results. > > I've confirmed that my highlight-lacking results DO contain the word > "unangan", as expected, and this term is appearing in a text field that's > indexed and stored, and being searched for all text searches. For example, > one of the search results is for a crawl of this document: > http://www.iwgia.org/iwgia_files_publications_files/0028_Utimut_heritage.pdf > > And if you view that document on the web, you'll see that it does contain > "unangan". > > Has anyone seen this before? And does anyone have any good suggestions for > troubleshooting/fixing the problem? > > Thanks! > > - Eric