Re: PostingsSolrHighlighter
Hi Josip Hi Liu, that's quite weird, to my experience highlight is strict on string field which needs a exact match, text fields should be fine. I copy your schema definition and do a quick test in a new core, everything is default from the tutorial, and the search component is using solr.HighlightComponent . I think there is a misunderstanding the normal solr.HighlightComponent is working just fine, but with the PostingsSolrHighlighter i get no results. search on searchable_text can highlight text, I copied your search url and just change the host part, the input parameters are exactly the same, result is attached. Can you upload your complete solrconfig.xml and schema.xml? Cya Josip
Re: PostingsSolrHighlighter
hi Josip for the 1 question we've done similar things: copying search field to a text field. But highlighting is normally on specific fields such as tittle depending on how the search content is displayed to the front end, you can search on text and highlight on the field you wanted by specify hl.fl ref: http://wiki.apache.org/solr/HighlightingParameters#hl.fl On 17 December 2013 02:29, Josip Delic j...@lugensa.com wrote: Hi @all, i am playing with the PostingsSolrHighlighter. I'm running solr 4.6.0 and my configuration is from here: https://lucene.apache.org/solr/4_6_0/solr-core/org/apache/solr/highlight/ PostingsSolrHighlighter.html Search query and result (not working): http://pastebin.com/13Uan0ZF Schema (not complete): http://pastebin.com/JGa38UDT Search query and result (working): http://pastebin.com/4CP8XKnr Solr config: searchComponent class=solr.HighlightComponent name=highlight highlighting class=org.apache.solr.highlight.PostingsSolrHighlighter/ /searchComponent So this is working just fine, but now i have some questions: 1.) With the old default highlighter component it was possible to search in searchable_text and to retrive highlighted text. This is essential, because we use copyfield to put almost everything to searchable_text (title, subtitle, description, ...) 2.) I can't get ellipsis working i tried hl.tag.ellipsis=..., f.text.hl.tag.ellipsis=..., configuring it in RequestHandler noting seems to work, maxAnalyzedChars is just cutting the sentence? Kind Regards Josip Delic -- All the best Liu Bo
Re: PostingsSolrHighlighter
Am 18.12.2013 09:55, schrieb Liu Bo: hi Josip hi liu, for the 1 question we've done similar things: copying search field to a text field. But highlighting is normally on specific fields such as tittle depending on how the search content is displayed to the front end, you can search on text and highlight on the field you wanted by specify hl.fl ref: http://wiki.apache.org/solr/HighlightingParameters#hl.fl thats exactly what i'm doing in that pastebin: http://pastebin.com/13Uan0ZF I'm searing there for 'q=searchable_text:labore' this is present in 'text' and in the copyfield 'searchable_text' but it is not highlighted in 'text' (hl.fl=text) The same query is working if set 'q=text:labore' as you can see in http://pastebin.com/4CP8XKnr For 2 question i figured out that the PostingsSolrHighlighter ellipsis is not like i thought for adding ellipsis to start or/and end in highlighted text. It is instead used to combine multiple snippets together if snippets is 1. cheers josip On 17 December 2013 02:29, Josip Delic j...@lugensa.com wrote: Hi @all, i am playing with the PostingsSolrHighlighter. I'm running solr 4.6.0 and my configuration is from here: https://lucene.apache.org/solr/4_6_0/solr-core/org/apache/solr/highlight/ PostingsSolrHighlighter.html Search query and result (not working): http://pastebin.com/13Uan0ZF Schema (not complete): http://pastebin.com/JGa38UDT Search query and result (working): http://pastebin.com/4CP8XKnr Solr config: searchComponent class=solr.HighlightComponent name=highlight highlighting class=org.apache.solr.highlight.PostingsSolrHighlighter/ /searchComponent So this is working just fine, but now i have some questions: 1.) With the old default highlighter component it was possible to search in searchable_text and to retrive highlighted text. This is essential, because we use copyfield to put almost everything to searchable_text (title, subtitle, description, ...) 2.) I can't get ellipsis working i tried hl.tag.ellipsis=..., f.text.hl.tag.ellipsis=..., configuring it in RequestHandler noting seems to work, maxAnalyzedChars is just cutting the sentence? Kind Regards Josip Delic smime.p7s Description: S/MIME Cryptographic Signature
Re: PostingsSolrHighlighter
Hi Josip
that's quite weird, to my experience highlight is strict on string field
which needs a exact match, text fields should be fine.
I copy your schema definition and do a quick test in a new core, everything
is default from the tutorial, and the search component is
using solr.HighlightComponent .
search on searchable_text can highlight text, I copied your search url and
just change the host part, the input parameters are exactly the same,
result is attached.
Can you upload your complete solrconfig.xml and schema.xml?
On 18 December 2013 19:02, Josip Delic j...@lugensa.com wrote:
Am 18.12.2013 09:55, schrieb Liu Bo:
hi Josip
hi liu,
for the 1 question we've done similar things: copying search field to a
text field. But highlighting is normally on specific fields such as tittle
depending on how the search content is displayed to the front end, you can
search on text and highlight on the field you wanted by specify hl.fl
ref: http://wiki.apache.org/solr/HighlightingParameters#hl.fl
thats exactly what i'm doing in that pastebin:
http://pastebin.com/13Uan0ZF
I'm searing there for 'q=searchable_text:labore' this is present in 'text'
and in the copyfield 'searchable_text' but it is not highlighted in 'text'
(hl.fl=text)
The same query is working if set 'q=text:labore' as you can see in
http://pastebin.com/4CP8XKnr
For 2 question i figured out that the PostingsSolrHighlighter ellipsis
is not like i thought for adding ellipsis to start or/and end in
highlighted text. It is instead used to combine multiple snippets together
if snippets is 1.
cheers
josip
On 17 December 2013 02:29, Josip Delic j...@lugensa.com wrote:
Hi @all,
i am playing with the PostingsSolrHighlighter. I'm running solr 4.6.0
and my configuration is from here:
https://lucene.apache.org/solr/4_6_0/solr-core/org/
apache/solr/highlight/
PostingsSolrHighlighter.html
Search query and result (not working):
http://pastebin.com/13Uan0ZF
Schema (not complete):
http://pastebin.com/JGa38UDT
Search query and result (working):
http://pastebin.com/4CP8XKnr
Solr config:
searchComponent class=solr.HighlightComponent name=highlight
highlighting class=org.apache.solr.highlight.
PostingsSolrHighlighter/
/searchComponent
So this is working just fine, but now i have some questions:
1.) With the old default highlighter component it was possible to search
in searchable_text and to retrive highlighted text. This is
essential,
because we use copyfield to put almost everything to searchable_text
(title, subtitle, description, ...)
2.) I can't get ellipsis working i tried hl.tag.ellipsis=...,
f.text.hl.tag.ellipsis=..., configuring it in RequestHandler noting seems
to work, maxAnalyzedChars is just cutting the sentence?
Kind Regards
Josip Delic
--
All the best
Liu Bo
http://localhost:8080/solr/try/select?wt=jsonfl=text%2Cscore=hl=truehl.fl=textq=%28searchable_text%3Alabore%29rows=10sort=score+descstart=0
{
responseHeader: {
status: 0,
QTime: 36,
params: {
sort: score desc,
fl: text,
start: 0,
,score: ,
q: (searchable_text:labore),
hl.fl: text,
wt: json,
hl: true,
rows: 10
}
},
response: {
numFound: 3,
start: 0,
docs: [
{
text: Lorem ipsum dolor sit amet, consetetur sadipscing
elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magna
aliquyam erat, sed diam voluptua. At vero eos et accusam et justo duo dolores
et ea rebum. Stet clita kasd gubergren, no sea takimata sanctus est Lorem ipsum
dolor sit amet. Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed
diam nonumy eirmod tempor invidunt ut labore et dolore magna aliquyam erat, sed
diam voluptua. At vero eos et accusam et justo duo dolores et ea rebum. Stet
clita kasd gubergren, no sea takimata sanctus est Lorem ipsum dolor sit amet.
},
{
text: Lorem ipsum dolor sit amet, consetetur sadipscing
elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magna
aliquyam erat, sed diam voluptua. At vero eos et accusam et justo duo dolores
et ea rebum. Stet clita kasd gubergren, no sea takimata sanctus est Lorem ipsum
dolor sit amet. Lorem ipsum dolor sit amet, consetetur sadipscing elitr, sed
diam nonumy eirmod tempor invidunt ut labore et dolore magna aliquyam erat, sed
diam voluptua. At vero eos et accusam et justo duo dolores et ea rebum. Stet
clita kasd gubergren, no sea takimata sanctus est Lorem ipsum dolor sit amet.
},
{
text: Lorem ipsum dolor sit amet, consetetur sadipscing
elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore magna
aliquyam erat, sed diam voluptua. At vero eos et accusam et justo duo dolores
et ea rebum. Stet clita kasd gubergren, no sea takimata
PostingsSolrHighlighter
Hi @all, i am playing with the PostingsSolrHighlighter. I'm running solr 4.6.0 and my configuration is from here: https://lucene.apache.org/solr/4_6_0/solr-core/org/apache/solr/highlight/PostingsSolrHighlighter.html Search query and result (not working): http://pastebin.com/13Uan0ZF Schema (not complete): http://pastebin.com/JGa38UDT Search query and result (working): http://pastebin.com/4CP8XKnr Solr config: searchComponent class=solr.HighlightComponent name=highlight highlighting class=org.apache.solr.highlight.PostingsSolrHighlighter/ /searchComponent So this is working just fine, but now i have some questions: 1.) With the old default highlighter component it was possible to search in searchable_text and to retrive highlighted text. This is essential, because we use copyfield to put almost everything to searchable_text (title, subtitle, description, ...) 2.) I can't get ellipsis working i tried hl.tag.ellipsis=..., f.text.hl.tag.ellipsis=..., configuring it in RequestHandler noting seems to work, maxAnalyzedChars is just cutting the sentence? Kind Regards Josip Delic smime.p7s Description: S/MIME Cryptographic Signature
Re: PostingsSolrHighlighter not working on Multivalue field
Any idea can help on this? 2013/6/22 Erick Erickson erickerick...@gmail.com Unfortunately, from here I need to leave it to people who know the highlighting code Erick On Wed, Jun 19, 2013 at 8:40 PM, Floyd Wu floyd...@gmail.com wrote: Hi Erick, multivalue is my typo, thanks for your reminding. There is no log show anything wrong or exception occurred. The field definition as following field name=summary type=text indexed=true stored=true omitNorms=false termVectors=true termPositions=true termOffsets=true storeOffsetsWithPositions=true/ dynamicField name=* type=text indexed=true stored=true multiValued=true termVectors=true termPositions=true termOffsets=true omitNorms=false storeOffsetsWithPositions=true/ The PostingSolrHighlighter only do highlight on summary field. When I send a xml file to solr like this ?xml version=1.0 encoding=utf-8? command add doc field name=summaryfacebook yahoo plurk twitter social nextworing/field field name=body_0facebook yahoo plurk twitter social nextworing/field /doc /add /command As you can see the body_0 will be treated using dynamicField definition. Part of the debug response return of Solr like this lst name=highlighting lst name=645 arr name=summary stremFacebook/em... emFacebook/em/str /arr arr name=body_0/ /lst I'm sure hl.fl contains both summary and body_0. This behavior is different between PostingSolrHighlighter and FastVectorhighlighter. Please kindly help on this. Many thanks. Floyd 2013/6/19 Erick Erickson erickerick...@gmail.com Well, _how_ does it fail? unless it's a type it should be multiValued (not capital 'V'). This probably isn't the problem, but just in case. Anything in the logs? What is the field definition? Did you re-index after changing to multiValued? Best Erick On Tue, Jun 18, 2013 at 11:01 PM, Floyd Wu floyd...@gmail.com wrote: In my test case, it seems this new highlighter not working. When field set multivalue=true, the stored text in this field can not be highlighted. Am I miss something? Or this is current limitation? I have no luck to find any documentations mentioned this. Floyd
Re: PostingsSolrHighlighter not working on Multivalue field
Unfortunately, from here I need to leave it to people who know the highlighting code Erick On Wed, Jun 19, 2013 at 8:40 PM, Floyd Wu floyd...@gmail.com wrote: Hi Erick, multivalue is my typo, thanks for your reminding. There is no log show anything wrong or exception occurred. The field definition as following field name=summary type=text indexed=true stored=true omitNorms=false termVectors=true termPositions=true termOffsets=true storeOffsetsWithPositions=true/ dynamicField name=* type=text indexed=true stored=true multiValued=true termVectors=true termPositions=true termOffsets=true omitNorms=false storeOffsetsWithPositions=true/ The PostingSolrHighlighter only do highlight on summary field. When I send a xml file to solr like this ?xml version=1.0 encoding=utf-8? command add doc field name=summaryfacebook yahoo plurk twitter social nextworing/field field name=body_0facebook yahoo plurk twitter social nextworing/field /doc /add /command As you can see the body_0 will be treated using dynamicField definition. Part of the debug response return of Solr like this lst name=highlighting lst name=645 arr name=summary stremFacebook/em... emFacebook/em/str /arr arr name=body_0/ /lst I'm sure hl.fl contains both summary and body_0. This behavior is different between PostingSolrHighlighter and FastVectorhighlighter. Please kindly help on this. Many thanks. Floyd 2013/6/19 Erick Erickson erickerick...@gmail.com Well, _how_ does it fail? unless it's a type it should be multiValued (not capital 'V'). This probably isn't the problem, but just in case. Anything in the logs? What is the field definition? Did you re-index after changing to multiValued? Best Erick On Tue, Jun 18, 2013 at 11:01 PM, Floyd Wu floyd...@gmail.com wrote: In my test case, it seems this new highlighter not working. When field set multivalue=true, the stored text in this field can not be highlighted. Am I miss something? Or this is current limitation? I have no luck to find any documentations mentioned this. Floyd
Re: PostingsSolrHighlighter not working on Multivalue field
Well, _how_ does it fail? unless it's a type it should be multiValued (not capital 'V'). This probably isn't the problem, but just in case. Anything in the logs? What is the field definition? Did you re-index after changing to multiValued? Best Erick On Tue, Jun 18, 2013 at 11:01 PM, Floyd Wu floyd...@gmail.com wrote: In my test case, it seems this new highlighter not working. When field set multivalue=true, the stored text in this field can not be highlighted. Am I miss something? Or this is current limitation? I have no luck to find any documentations mentioned this. Floyd
Re: PostingsSolrHighlighter not working on Multivalue field
Hi Erick, multivalue is my typo, thanks for your reminding. There is no log show anything wrong or exception occurred. The field definition as following field name=summary type=text indexed=true stored=true omitNorms=false termVectors=true termPositions=true termOffsets=true storeOffsetsWithPositions=true/ dynamicField name=* type=text indexed=true stored=true multiValued=true termVectors=true termPositions=true termOffsets=true omitNorms=false storeOffsetsWithPositions=true/ The PostingSolrHighlighter only do highlight on summary field. When I send a xml file to solr like this ?xml version=1.0 encoding=utf-8? command add doc field name=summaryfacebook yahoo plurk twitter social nextworing/field field name=body_0facebook yahoo plurk twitter social nextworing/field /doc /add /command As you can see the body_0 will be treated using dynamicField definition. Part of the debug response return of Solr like this lst name=highlighting lst name=645 arr name=summary stremFacebook/em... emFacebook/em/str /arr arr name=body_0/ /lst I'm sure hl.fl contains both summary and body_0. This behavior is different between PostingSolrHighlighter and FastVectorhighlighter. Please kindly help on this. Many thanks. Floyd 2013/6/19 Erick Erickson erickerick...@gmail.com Well, _how_ does it fail? unless it's a type it should be multiValued (not capital 'V'). This probably isn't the problem, but just in case. Anything in the logs? What is the field definition? Did you re-index after changing to multiValued? Best Erick On Tue, Jun 18, 2013 at 11:01 PM, Floyd Wu floyd...@gmail.com wrote: In my test case, it seems this new highlighter not working. When field set multivalue=true, the stored text in this field can not be highlighted. Am I miss something? Or this is current limitation? I have no luck to find any documentations mentioned this. Floyd
PostingsSolrHighlighter not working on Multivalue field
In my test case, it seems this new highlighter not working. When field set multivalue=true, the stored text in this field can not be highlighted. Am I miss something? Or this is current limitation? I have no luck to find any documentations mentioned this. Floyd
