[jira] [Updated] (SOLR-2396) add [ICU]CollationField

2011-03-21 Thread Robert Muir (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Muir updated SOLR-2396:
--

Description: 
In LUCENE-2551 collation support was changed to use byte[] keys.

Previously it encoded sort keys with IndexableBinaryString into char[],
but this is wasteful with regards to RAM and disk when terms can be byte.

A better solution would be [ICU]CollationFieldTypes, as this would also allow 
locale-sensitive range queries.


  was:
In LUCENE-2551 collation support was changed to use byte[] keys.

Previously it encoded sort keys with IndexableBinaryString into char[],
but this is wasteful with regards to RAM and disk when terms can be byte.

A simple solution is to create tokenizer factories which are KeywordTokenizer + 
[ICU]CollationAttributeFactory.

A better solution would be [ICU]CollationFieldTypes, as this would allow 
locale-sensitive
range queries, but I found this to be more difficult due to the fact that the 
indexed values
are byte[] not String...

Summary: add [ICU]CollationField  (was: deprecated char[] based 
collation factories / replace with byte[]-based)

editing summary/description to fit

 add [ICU]CollationField
 ---

 Key: SOLR-2396
 URL: https://issues.apache.org/jira/browse/SOLR-2396
 Project: Solr
  Issue Type: Improvement
Reporter: Robert Muir
 Fix For: 4.0

 Attachments: SOLR-2396.patch, SOLR-2396.patch, SOLR-2396.patch


 In LUCENE-2551 collation support was changed to use byte[] keys.
 Previously it encoded sort keys with IndexableBinaryString into char[],
 but this is wasteful with regards to RAM and disk when terms can be byte.
 A better solution would be [ICU]CollationFieldTypes, as this would also allow 
 locale-sensitive range queries.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-2396) add [ICU]CollationField

2011-03-21 Thread Robert Muir (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Muir updated SOLR-2396:
--

Attachment: SOLR-2396.patch

now that the lucene issues are resolved, I think this patch is really close.

It could use a review though from someone who knows the fieldtype stuff better. 


 add [ICU]CollationField
 ---

 Key: SOLR-2396
 URL: https://issues.apache.org/jira/browse/SOLR-2396
 Project: Solr
  Issue Type: Improvement
Reporter: Robert Muir
 Fix For: 4.0

 Attachments: SOLR-2396.patch, SOLR-2396.patch, SOLR-2396.patch, 
 SOLR-2396.patch


 In LUCENE-2551 collation support was changed to use byte[] keys.
 Previously it encoded sort keys with IndexableBinaryString into char[],
 but this is wasteful with regards to RAM and disk when terms can be byte.
 A better solution would be [ICU]CollationFieldTypes, as this would also allow 
 locale-sensitive range queries.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org