Cross field highlighting

2013-01-06 Thread AlexeyK
Hi,
I would like to store the document content into a single special field (non
indexed, stored only), and create several indexed copy fields (different
analysis applied).
During highlighting, the analysis definitions of the stored field are used,
so that improper or no highlighting is done.
Is there any workaround for this? Duplicating the stored field is not a good
idea, considering the overwhelming storage overhead.

Thanks,
Alexey



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Cross-field-highlighting-tp4031103.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Field highlighting

2010-01-31 Thread Koji Sekiguchi

Jan Høydahl / Cominvent wrote:

Did you solve this?
If yes, what was wrong?
If no, can you specify one concrete example document and a matching query which 
fails to highlight?

--
Jan Høydahl  - search architect
Cominvent AS - www.cominvent.com

On 7. jan. 2010, at 15.23, Xavier Schepler wrote:

  

Erick Erickson a écrit :


It's really hard to provide any response with so little information,
could you show us the difference between a field that works
and one that doesn't? Especially the relevant schema.xml entries
and the query that fails to highlight

Erick

On Thu, Jan 7, 2010 at 7:47 AM, Xavier Schepler <
xavier.schep...@sciences-po.fr> wrote:

 
  

Hi,

I'm trying to highlight short text values. The field they came from has a
type shared with other fields. I have highlighting working on other fields
but not on this one.
Why ?

   

 
  

Thanks for your response.
Here are some extracts from my schema.xml :



  
  
  
  
  
  
  
  
  
  
  
  
  
  

  

Here's a field on which highlighting works :



Here's the field on which it doesn't :

 

They are kinda the same.

But modalitiesLabelFr contains mostly short strings like :

Côtes-d Armor
Creuse
Dordogne
Doubs
Drôme
Eure
Eure-et-Loir
Finistère

When matches are found in them, I get a list like this, with no text :







The name attribute is the uid of the document.

I tryed several values for hl.fragsize (0, 1, 2, ...) with no success at all.




  

If you are using trunk version, because those fields'
termVectors/termPositions/termOffsets are all on, DefaultSolrHighlighter
uses FastVectorHighlighter unless you set hl.useHighlighter to true 
explicitly.

And FVH doesn't support dismax at the moment. It has been fixed in
Lucene trunk:

https://issues.apache.org/jira/browse/LUCENE-2243

If you want to use the fix, download Lucene trunk, execute ant 
build-contrib,

cp lucene-fast-vector-highlighter-3.1-dev.jar to solr/lib and delete old
FVH jar in solr/lib.

Koji

--
http://www.rondhuit.com/en/



Re: Field highlighting

2010-01-31 Thread Jan Høydahl / Cominvent
Did you solve this?
If yes, what was wrong?
If no, can you specify one concrete example document and a matching query which 
fails to highlight?

--
Jan Høydahl  - search architect
Cominvent AS - www.cominvent.com

On 7. jan. 2010, at 15.23, Xavier Schepler wrote:

> Erick Erickson a écrit :
>> It's really hard to provide any response with so little information,
>> could you show us the difference between a field that works
>> and one that doesn't? Especially the relevant schema.xml entries
>> and the query that fails to highlight
>> 
>> Erick
>> 
>> On Thu, Jan 7, 2010 at 7:47 AM, Xavier Schepler <
>> xavier.schep...@sciences-po.fr> wrote:
>> 
>>  
>>> Hi,
>>> 
>>> I'm trying to highlight short text values. The field they came from has a
>>> type shared with other fields. I have highlighting working on other fields
>>> but not on this one.
>>> Why ?
>>> 
>>>
>> 
>>  
> Thanks for your response.
> Here are some extracts from my schema.xml :
> 
> 
> 
>   
>ignoreCase="true"/>
>   
>   
>   
>   
>   
>   
>   
>   
>   
>   
>   
>ignoreCase="true" expand="true"/>
> 
>   
> 
> Here's a field on which highlighting works :
> 
>required="false"
>   type="textFr"
>   multiValued="true"
>   indexed="true"
>   stored="true"
>   compressed="false"
>   omitNorms="false"
>   termVectors="true"
>   termPositions="true"
>   termOffsets="true"
>   />
> 
> Here's the field on which it doesn't :
> 
> required="false"
>   type="textFr"
>   multiValued="true"
>   indexed="true"
>   stored="true"
>   compressed="false"
>   omitNorms="false"
>   termVectors="true"
>   termPositions="true"
>   termOffsets="true"
>   />
> 
> They are kinda the same.
> 
> But modalitiesLabelFr contains mostly short strings like :
> 
> Côtes-d Armor
> Creuse
> Dordogne
> Doubs
> Drôme
> Eure
> Eure-et-Loir
> Finistère
> 
> When matches are found in them, I get a list like this, with no text :
> 
> 
> 
> 
> 
> 
> 
> The name attribute is the uid of the document.
> 
> I tryed several values for hl.fragsize (0, 1, 2, ...) with no success at all.



Re: Field highlighting

2010-01-07 Thread Xavier Schepler

Erick Erickson a écrit :

It's really hard to provide any response with so little information,
could you show us the difference between a field that works
and one that doesn't? Especially the relevant schema.xml entries
and the query that fails to highlight

Erick

On Thu, Jan 7, 2010 at 7:47 AM, Xavier Schepler <
xavier.schep...@sciences-po.fr> wrote:

  

Hi,

I'm trying to highlight short text values. The field they came from has a
type shared with other fields. I have highlighting working on other fields
but not on this one.
Why ?




  

Thanks for your response.
Here are some extracts from my schema.xml :


 
   
   words="french-stopwords.txt" ignoreCase="true"/>

   
   
   
   
   
   
   
   
   
   
   
   synonyms="test-synonyms.txt" ignoreCase="true" expand="true"/>

 
   

Here's a field on which highlighting works :



Here's the field on which it doesn't :

  

They are kinda the same.

But modalitiesLabelFr contains mostly short strings like :

Côtes-d Armor
Creuse
Dordogne
Doubs
Drôme
Eure
Eure-et-Loir
Finistère

When matches are found in them, I get a list like this, with no text :







The name attribute is the uid of the document.

I tryed several values for hl.fragsize (0, 1, 2, ...) with no success at 
all.


Re: Field highlighting

2010-01-07 Thread Erick Erickson
It's really hard to provide any response with so little information,
could you show us the difference between a field that works
and one that doesn't? Especially the relevant schema.xml entries
and the query that fails to highlight

Erick

On Thu, Jan 7, 2010 at 7:47 AM, Xavier Schepler <
xavier.schep...@sciences-po.fr> wrote:

> Hi,
>
> I'm trying to highlight short text values. The field they came from has a
> type shared with other fields. I have highlighting working on other fields
> but not on this one.
> Why ?
>


Field highlighting

2010-01-07 Thread Xavier Schepler

Hi,

I'm trying to highlight short text values. The field they came from has 
a type shared with other fields. I have highlighting working on other 
fields but not on this one.

Why ?