[jira] [Issue Comment Edited] (SOLR-236) Field collapsing
[ https://issues.apache.org/jira/browse/SOLR-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13011812#comment-13011812 ] George P. Stathis edited comment on SOLR-236 at 3/27/11 4:00 PM: - Bump on Yuriy's last question: - Are performance issues around the number of documents matched, the size of the index, or both? E.g. our index contains over 12 million documents already. Should we even consider using this feature? Adding a few more questions: - Are performance concerns around the 1.4 patch, the current Solr 4.0 branch or both? - Is sharding an option to alleviate some of these issues? Reading the comments in this ticket, it seems there are caveats getting this to work with shards? was (Author: gstathis): Bump on Yuriy's last question: - Are performance issues around the number of documents matched, the size of the index, or both? E.g. our index contains over 12 million documents already. Should we even consider using this feature? Adding a few more questions: - Are performance concerns around the 1.4 patch, the current Solr 4.0 branch or both? - Is sharding an option to alleviate some of these issues? Reading the comments in this ticket, it seems there are caveats getting this to work with shards? - Would this work with distributed solr and if so, would it have the same issues? > Field collapsing > > > Key: SOLR-236 > URL: https://issues.apache.org/jira/browse/SOLR-236 > Project: Solr > Issue Type: New Feature > Components: search >Affects Versions: 1.3 >Reporter: Emmanuel Keller >Assignee: Shalin Shekhar Mangar > Fix For: Next > > Attachments: DocSetScoreCollector.java, > NonAdjacentDocumentCollapser.java, NonAdjacentDocumentCollapserTest.java, > SOLR-236-1_4_1-NPEfix.patch, SOLR-236-1_4_1-paging-totals-working.patch, > SOLR-236-1_4_1.patch, SOLR-236-FieldCollapsing.patch, > SOLR-236-FieldCollapsing.patch, SOLR-236-FieldCollapsing.patch, > SOLR-236-branch_3x.patch, SOLR-236-distinctFacet.patch, SOLR-236-trunk.patch, > SOLR-236-trunk.patch, SOLR-236-trunk.patch, SOLR-236-trunk.patch, > SOLR-236-trunk.patch, SOLR-236.patch, SOLR-236.patch, SOLR-236.patch, > SOLR-236.patch, SOLR-236.patch, SOLR-236.patch, SOLR-236.patch, > SOLR-236.patch, SOLR-236_collapsing.patch, SOLR-236_collapsing.patch, > collapsing-patch-to-1.3.0-dieter.patch, collapsing-patch-to-1.3.0-ivan.patch, > collapsing-patch-to-1.3.0-ivan_2.patch, > collapsing-patch-to-1.3.0-ivan_3.patch, field-collapse-3.patch, > field-collapse-4-with-solrj.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, > field-collapse-solr-236-2.patch, field-collapse-solr-236.patch, > field-collapsing-extended-592129.patch, field_collapsing_1.1.0.patch, > field_collapsing_1.3.patch, field_collapsing_dsteigerwald.diff, > field_collapsing_dsteigerwald.diff, field_collapsing_dsteigerwald.diff, > quasidistributed.additional.patch, solr-236.patch > > > This patch include a new feature called "Field collapsing". > "Used in order to collapse a group of results with similar value for a given > field to a single entry in the result set. Site collapsing is a special case > of this, where all results for a given web site is collapsed into one or two > entries in the result set, typically with an associated "more documents from > this site" link. See also Duplicate detection." > http://www.fastsearch.com/glossary.aspx?m=48&amid=299 > The implementation add 3 new query parameters (SolrParams): > "collapse.field" to choose the field used to group results > "collapse.type" normal (default value) or adjacent > "collapse.max" to select how many continuous results are allowed before > collapsing > TODO (in progress): > - More documentation (on source code) > - Test cases > Two patches: > - "field_collapsing.patch" for current development version > - "field_collapsing_1.1.0.patch" for Solr-1.1.0 > P.S.: Feedback and misspelling correction are welcome ;-) -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] Issue Comment Edited: (SOLR-236) Field collapsing
[ https://issues.apache.org/jira/browse/SOLR-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12894129#action_12894129 ] cruz fernandez edited comment on SOLR-236 at 8/2/10 5:35 PM: - I'm having an issue with the facet exclude filter parameters (http://wiki.apache.org/solr/SimpleFacetParameters#Tagging_and_excluding_Filters). I have added this exclude tags and the facet result I'm getting is without collapsing (it's counting the uncollapsed items). For example, in my first page it shows something like this (the facet result gives something like this): * book (11) * website (20) * journal (5) after clicking on book it shows 11 results correctly, but the faceting with the exclude applied shows: * book (230) * website (25) * journal (5) I am using the parameter collapse.facet=after The collapsed count of books is 11, and the uncollapsed count is 230, I verified it. was (Author: cruzf): I'm having an issue with the facet exclude filter parameters (http://wiki.apache.org/solr/SimpleFacetParameters#Tagging_and_excluding_Filters). I have added this exclude tags and the facet result I'm getting is without collapsing (it's counting the uncollapsed items). For example, in my first page it shows something like this (the facet result gives something like this): * book (11) * website (20) * journal (5) after clicking on book it shows 11 results correctly, but the faceting with the exclude applied shows: * book (230) * website (25) * journal (5) The collapsed count of books is 11, and the uncollapsed count is 230, I verified it. > Field collapsing > > > Key: SOLR-236 > URL: https://issues.apache.org/jira/browse/SOLR-236 > Project: Solr > Issue Type: New Feature > Components: search >Affects Versions: 1.3 >Reporter: Emmanuel Keller >Assignee: Shalin Shekhar Mangar > Fix For: Next > > Attachments: collapsing-patch-to-1.3.0-dieter.patch, > collapsing-patch-to-1.3.0-ivan.patch, collapsing-patch-to-1.3.0-ivan_2.patch, > collapsing-patch-to-1.3.0-ivan_3.patch, DocSetScoreCollector.java, > field-collapse-3.patch, field-collapse-4-with-solrj.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-solr-236-2.patch, field-collapse-solr-236.patch, > field-collapsing-extended-592129.patch, field_collapsing_1.1.0.patch, > field_collapsing_1.3.patch, field_collapsing_dsteigerwald.diff, > field_collapsing_dsteigerwald.diff, field_collapsing_dsteigerwald.diff, > NonAdjacentDocumentCollapser.java, NonAdjacentDocumentCollapserTest.java, > quasidistributed.additional.patch, SOLR-236-1_4_1.patch, > SOLR-236-FieldCollapsing.patch, SOLR-236-FieldCollapsing.patch, > SOLR-236-FieldCollapsing.patch, SOLR-236-trunk.patch, SOLR-236-trunk.patch, > SOLR-236-trunk.patch, SOLR-236-trunk.patch, SOLR-236-trunk.patch, > SOLR-236.patch, SOLR-236.patch, SOLR-236.patch, SOLR-236.patch, > SOLR-236.patch, SOLR-236.patch, SOLR-236.patch, solr-236.patch, > SOLR-236_collapsing.patch, SOLR-236_collapsing.patch > > > This patch include a new feature called "Field collapsing". > "Used in order to collapse a group of results with similar value for a given > field to a single entry in the result set. Site collapsing is a special case > of this, where all results for a given web site is collapsed into one or two > entries in the result set, typically with an associated "more documents from > this site" link. See also Duplicate detection." > http://www.fastsearch.com/glossary.aspx?m=48&amid=299 > The implementation add 3 new query parameters (SolrParams): > "collapse.field" to choose the field used to group results > "collapse.type" normal (default value) or adjacent > "collapse.max" to select how many continuous results are allowed before > collapsing > TODO (in progress): > - More documentation (on source code) > - Test cases > Two patches: > - "field_collapsing.patch" for current development version > - "field_collapsing_1.1.0.patch" for Solr-1.1.0 > P.S.: Feedback and misspelling correction are welcome ;-) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] Issue Comment Edited: (SOLR-236) Field collapsing
[ https://issues.apache.org/jira/browse/SOLR-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12932905#action_12932905 ] peterwang edited comment on SOLR-236 at 11/17/10 6:21 AM: -- SOLR-236-1_4_1-paging-totals-working.patch patch failed with following errors: patch: malformed patch at line 3348: Index: src/test/org/apache/solr/search/fieldcollapse/DistributedFieldCollapsingIntegrationTest.java seems caused by hand edit (delete 6 lines without fix diff hunk number) patch files, possible fix: $ diff -u SOLR-236-1_4_1.patch SOLR-236-1_4_1-paging-totals-working.patch --- SOLR-236-1_4_1.patch2010-11-17 18:22:25.0 +0800 +++ SOLR-236-1_4_1-paging-totals-working.patch 2010-11-17 19:17:20.0 +0800 @@ -2834,7 +2834,7 @@ === --- src/java/org/apache/solr/search/fieldcollapse/NonAdjacentDocumentCollapser.java (revision ) +++ src/java/org/apache/solr/search/fieldcollapse/NonAdjacentDocumentCollapser.java (revision ) -@@ -0,0 +1,517 @@ +@@ -0,0 +1,511 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with @@ -2939,12 +2939,6 @@ +collapseDoc = new NonAdjacentCollapseGroup(0, 0, documentComparator, collapseThreshold, currentValue); +collapsedDocs.put(currentValue, collapseDoc); +collapsedGroupPriority.add(collapseDoc); -+ -+if (collapsedGroupPriority.size() > maxNumberOfGroups) { -+ NonAdjacentCollapseGroup inferiorGroup = collapsedGroupPriority.first(); -+ collapsedDocs.remove(inferiorGroup.fieldValue); -+ collapsedGroupPriority.remove(inferiorGroup); -+} + } + // dropoutId has a value smaller than the smallest value in the queue and therefore it was removed from the queue + Integer dropOutId = (Integer) collapseDoc.priorityQueue.insertWithOverflow(currentId); was (Author: peterwang): SOLR-236-1_4_1-paging-totals-working.patch patch failed with following errors: patch: malformed patch at line 3348: Index: src/test/org/apache/solr/search/fieldcollapse/DistributedFieldCollapsingIntegrationTest.java seems caused by hand edit (delete 6 lines without fix diff hunk number) patch files, possible fix: # diff -u SOLR-236-1_4_1.patch SOLR-236-1_4_1-paging-totals-working.patch --- SOLR-236-1_4_1.patch2010-11-17 18:22:25.0 +0800 +++ SOLR-236-1_4_1-paging-totals-working.patch 2010-11-17 19:17:20.0 +0800 @@ -2834,7 +2834,7 @@ === --- src/java/org/apache/solr/search/fieldcollapse/NonAdjacentDocumentCollapser.java (revision ) +++ src/java/org/apache/solr/search/fieldcollapse/NonAdjacentDocumentCollapser.java (revision ) -@@ -0,0 +1,517 @@ +@@ -0,0 +1,511 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with @@ -2939,12 +2939,6 @@ +collapseDoc = new NonAdjacentCollapseGroup(0, 0, documentComparator, collapseThreshold, currentValue); +collapsedDocs.put(currentValue, collapseDoc); +collapsedGroupPriority.add(collapseDoc); -+ -+if (collapsedGroupPriority.size() > maxNumberOfGroups) { -+ NonAdjacentCollapseGroup inferiorGroup = collapsedGroupPriority.first(); -+ collapsedDocs.remove(inferiorGroup.fieldValue); -+ collapsedGroupPriority.remove(inferiorGroup); -+} + } + // dropoutId has a value smaller than the smallest value in the queue and therefore it was removed from the queue + Integer dropOutId = (Integer) collapseDoc.priorityQueue.insertWithOverflow(currentId); > Field collapsing > > > Key: SOLR-236 > URL: https://issues.apache.org/jira/browse/SOLR-236 > Project: Solr > Issue Type: New Feature > Components: search >Affects Versions: 1.3 >Reporter: Emmanuel Keller >Assignee: Shalin Shekhar Mangar > Fix For: Next > > Attachments: collapsing-patch-to-1.3.0-dieter.patch, > collapsing-patch-to-1.3.0-ivan.patch, collapsing-patch-to-1.3.0-ivan_2.patch, > collapsing-patch-to-1.3.0-ivan_3.patch, DocSetScoreCollector.java, > field-collapse-3.patch, field-collapse-4-with-solrj.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-solr-236-2.patch, field-c
[jira] Issue Comment Edited: (SOLR-236) Field collapsing
[ https://issues.apache.org/jira/browse/SOLR-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12932905#action_12932905 ] peterwang edited comment on SOLR-236 at 11/17/10 6:23 AM: -- SOLR-236-1_4_1-paging-totals-working.patch patch failed with following errors: patch: malformed patch at line 3348: Index: src/test/org/apache/solr/search/fieldcollapse/DistributedFieldCollapsingIntegrationTest.java seems caused by hand edit (delete 6 lines without fix diff hunk number) patch files, possible fix: {code} $ diff -u SOLR-236-1_4_1.patch SOLR-236-1_4_1-paging-totals-working.patch --- SOLR-236-1_4_1.patch2010-11-17 18:22:25.0 +0800 +++ SOLR-236-1_4_1-paging-totals-working.patch 2010-11-17 19:17:20.0 +0800 @@ -2834,7 +2834,7 @@ === --- src/java/org/apache/solr/search/fieldcollapse/NonAdjacentDocumentCollapser.java (revision ) +++ src/java/org/apache/solr/search/fieldcollapse/NonAdjacentDocumentCollapser.java (revision ) -@@ -0,0 +1,517 @@ +@@ -0,0 +1,511 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with @@ -2939,12 +2939,6 @@ +collapseDoc = new NonAdjacentCollapseGroup(0, 0, documentComparator, collapseThreshold, currentValue); +collapsedDocs.put(currentValue, collapseDoc); +collapsedGroupPriority.add(collapseDoc); -+ -+if (collapsedGroupPriority.size() > maxNumberOfGroups) { -+ NonAdjacentCollapseGroup inferiorGroup = collapsedGroupPriority.first(); -+ collapsedDocs.remove(inferiorGroup.fieldValue); -+ collapsedGroupPriority.remove(inferiorGroup); -+} + } + // dropoutId has a value smaller than the smallest value in the queue and therefore it was removed from the queue + Integer dropOutId = (Integer) collapseDoc.priorityQueue.insertWithOverflow(currentId); {code} was (Author: peterwang): SOLR-236-1_4_1-paging-totals-working.patch patch failed with following errors: patch: malformed patch at line 3348: Index: src/test/org/apache/solr/search/fieldcollapse/DistributedFieldCollapsingIntegrationTest.java seems caused by hand edit (delete 6 lines without fix diff hunk number) patch files, possible fix: $ diff -u SOLR-236-1_4_1.patch SOLR-236-1_4_1-paging-totals-working.patch --- SOLR-236-1_4_1.patch2010-11-17 18:22:25.0 +0800 +++ SOLR-236-1_4_1-paging-totals-working.patch 2010-11-17 19:17:20.0 +0800 @@ -2834,7 +2834,7 @@ === --- src/java/org/apache/solr/search/fieldcollapse/NonAdjacentDocumentCollapser.java (revision ) +++ src/java/org/apache/solr/search/fieldcollapse/NonAdjacentDocumentCollapser.java (revision ) -@@ -0,0 +1,517 @@ +@@ -0,0 +1,511 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with @@ -2939,12 +2939,6 @@ +collapseDoc = new NonAdjacentCollapseGroup(0, 0, documentComparator, collapseThreshold, currentValue); +collapsedDocs.put(currentValue, collapseDoc); +collapsedGroupPriority.add(collapseDoc); -+ -+if (collapsedGroupPriority.size() > maxNumberOfGroups) { -+ NonAdjacentCollapseGroup inferiorGroup = collapsedGroupPriority.first(); -+ collapsedDocs.remove(inferiorGroup.fieldValue); -+ collapsedGroupPriority.remove(inferiorGroup); -+} + } + // dropoutId has a value smaller than the smallest value in the queue and therefore it was removed from the queue + Integer dropOutId = (Integer) collapseDoc.priorityQueue.insertWithOverflow(currentId); > Field collapsing > > > Key: SOLR-236 > URL: https://issues.apache.org/jira/browse/SOLR-236 > Project: Solr > Issue Type: New Feature > Components: search >Affects Versions: 1.3 >Reporter: Emmanuel Keller >Assignee: Shalin Shekhar Mangar > Fix For: Next > > Attachments: collapsing-patch-to-1.3.0-dieter.patch, > collapsing-patch-to-1.3.0-ivan.patch, collapsing-patch-to-1.3.0-ivan_2.patch, > collapsing-patch-to-1.3.0-ivan_3.patch, DocSetScoreCollector.java, > field-collapse-3.patch, field-collapse-4-with-solrj.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-solr-236-2.p
[jira] Issue Comment Edited: (SOLR-236) Field collapsing
[ https://issues.apache.org/jira/browse/SOLR-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12932905#action_12932905 ] peterwang edited comment on SOLR-236 at 11/17/10 6:28 AM: -- SOLR-236-1_4_1-paging-totals-working.patch patch failed with following errors: patch: malformed patch at line 3348: Index: src/test/org/apache/solr/search/fieldcollapse/DistributedFieldCollapsingIntegrationTest.java seems caused by hand edit SOLR-236-1_4_1.patch to produce SOLR-236-1_4_1-paging-totals-working.patch (delete 6 lines without fix diff hunk number) possible fix: {code} diff -u SOLR-236-1_4_1-paging-totals-working.patch.orig SOLR-236-1_4_1-paging-totals-working.patch --- SOLR-236-1_4_1-paging-totals-working.patch.orig 2010-11-17 19:26:05.0 +0800 +++ SOLR-236-1_4_1-paging-totals-working.patch 2010-11-17 19:17:20.0 +0800 @@ -2834,7 +2834,7 @@ === --- src/java/org/apache/solr/search/fieldcollapse/NonAdjacentDocumentCollapser.java (revision ) +++ src/java/org/apache/solr/search/fieldcollapse/NonAdjacentDocumentCollapser.java (revision ) -@@ -0,0 +1,517 @@ +@@ -0,0 +1,511 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with {code} was (Author: peterwang): SOLR-236-1_4_1-paging-totals-working.patch patch failed with following errors: patch: malformed patch at line 3348: Index: src/test/org/apache/solr/search/fieldcollapse/DistributedFieldCollapsingIntegrationTest.java seems caused by hand edit (delete 6 lines without fix diff hunk number) patch files, possible fix: {code} $ diff -u SOLR-236-1_4_1.patch SOLR-236-1_4_1-paging-totals-working.patch --- SOLR-236-1_4_1.patch2010-11-17 18:22:25.0 +0800 +++ SOLR-236-1_4_1-paging-totals-working.patch 2010-11-17 19:17:20.0 +0800 @@ -2834,7 +2834,7 @@ === --- src/java/org/apache/solr/search/fieldcollapse/NonAdjacentDocumentCollapser.java (revision ) +++ src/java/org/apache/solr/search/fieldcollapse/NonAdjacentDocumentCollapser.java (revision ) -@@ -0,0 +1,517 @@ +@@ -0,0 +1,511 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with @@ -2939,12 +2939,6 @@ +collapseDoc = new NonAdjacentCollapseGroup(0, 0, documentComparator, collapseThreshold, currentValue); +collapsedDocs.put(currentValue, collapseDoc); +collapsedGroupPriority.add(collapseDoc); -+ -+if (collapsedGroupPriority.size() > maxNumberOfGroups) { -+ NonAdjacentCollapseGroup inferiorGroup = collapsedGroupPriority.first(); -+ collapsedDocs.remove(inferiorGroup.fieldValue); -+ collapsedGroupPriority.remove(inferiorGroup); -+} + } + // dropoutId has a value smaller than the smallest value in the queue and therefore it was removed from the queue + Integer dropOutId = (Integer) collapseDoc.priorityQueue.insertWithOverflow(currentId); {code} > Field collapsing > > > Key: SOLR-236 > URL: https://issues.apache.org/jira/browse/SOLR-236 > Project: Solr > Issue Type: New Feature > Components: search >Affects Versions: 1.3 >Reporter: Emmanuel Keller >Assignee: Shalin Shekhar Mangar > Fix For: Next > > Attachments: collapsing-patch-to-1.3.0-dieter.patch, > collapsing-patch-to-1.3.0-ivan.patch, collapsing-patch-to-1.3.0-ivan_2.patch, > collapsing-patch-to-1.3.0-ivan_3.patch, DocSetScoreCollector.java, > field-collapse-3.patch, field-collapse-4-with-solrj.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-solr-236-2.patch, field-collapse-solr-236.patch, > field-collapsing-extended-592129.patch, field_collapsing_1.1.0.patch, > field_collapsing_1.3.patch, field_collapsing_dsteigerwald.diff, > field_collapsing_dsteigerwald.diff, field_collapsing_dsteigerwald.diff, > NonAdjacentDocumentCollapser.java, NonAdjacentDocumentCollapserTest.java, > quasidistributed.additional.patch, > SOLR-236-1_4_1-paging-totals-working.patch, SOLR-236-1_4_1.patch, > SOLR-236-FieldCollapsing.patch, SOLR-236-FieldCollapsing.patch, > SOLR-236-FieldCollapsing.patch, SOLR-236-trunk.patch, SOLR-236-trunk.patch, > SOLR-236-trunk.patch, SOLR-236-trunk.patch, SOL
[jira] Issue Comment Edited: (SOLR-236) Field collapsing
[ https://issues.apache.org/jira/browse/SOLR-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934825#action_12934825 ] Luke Bochsler edited comment on SOLR-236 at 11/23/10 9:03 AM: -- "Is anyone working on the ability to calculate facets AFTER the group?" This would be great to have that possibility! Sorry I'm not a Java Programmer so I cannot contribute a solution, instead I contribute to other open source systems. However, would that be a big deal for you guys to implement it? I'm using Solr in a web project as search solution and desperately need this feature along with the great grouping functionality. The grouping in general has made my life so much easier so far, so it seems we are just one step away from having it all covered by Solr! Thank you so much! Luke > Field collapsing > > > Key: SOLR-236 > URL: https://issues.apache.org/jira/browse/SOLR-236 > Project: Solr > Issue Type: New Feature > Components: search >Affects Versions: 1.3 >Reporter: Emmanuel Keller >Assignee: Shalin Shekhar Mangar > Fix For: Next > > Attachments: collapsing-patch-to-1.3.0-dieter.patch, > collapsing-patch-to-1.3.0-ivan.patch, collapsing-patch-to-1.3.0-ivan_2.patch, > collapsing-patch-to-1.3.0-ivan_3.patch, DocSetScoreCollector.java, > field-collapse-3.patch, field-collapse-4-with-solrj.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-5.patch, field-collapse-5.patch, field-collapse-5.patch, > field-collapse-solr-236-2.patch, field-collapse-solr-236.patch, > field-collapsing-extended-592129.patch, field_collapsing_1.1.0.patch, > field_collapsing_1.3.patch, field_collapsing_dsteigerwald.diff, > field_collapsing_dsteigerwald.diff, field_collapsing_dsteigerwald.diff, > NonAdjacentDocumentCollapser.java, NonAdjacentDocumentCollapserTest.java, > quasidistributed.additional.patch, > SOLR-236-1_4_1-paging-totals-working.patch, SOLR-236-1_4_1.patch, > SOLR-236-distinctFacet.patch, SOLR-236-FieldCollapsing.patch, > SOLR-236-FieldCollapsing.patch, SOLR-236-FieldCollapsing.patch, > SOLR-236-trunk.patch, SOLR-236-trunk.patch, SOLR-236-trunk.patch, > SOLR-236-trunk.patch, SOLR-236-trunk.patch, SOLR-236.patch, SOLR-236.patch, > SOLR-236.patch, SOLR-236.patch, SOLR-236.patch, SOLR-236.patch, > SOLR-236.patch, SOLR-236.patch, solr-236.patch, SOLR-236_collapsing.patch, > SOLR-236_collapsing.patch > > > This patch include a new feature called "Field collapsing". > "Used in order to collapse a group of results with similar value for a given > field to a single entry in the result set. Site collapsing is a special case > of this, where all results for a given web site is collapsed into one or two > entries in the result set, typically with an associated "more documents from > this site" link. See also Duplicate detection." > http://www.fastsearch.com/glossary.aspx?m=48&amid=299 > The implementation add 3 new query parameters (SolrParams): > "collapse.field" to choose the field used to group results > "collapse.type" normal (default value) or adjacent > "collapse.max" to select how many continuous results are allowed before > collapsing > TODO (in progress): > - More documentation (on source code) > - Test cases > Two patches: > - "field_collapsing.patch" for current development version > - "field_collapsing_1.1.0.patch" for Solr-1.1.0 > P.S.: Feedback and misspelling correction are welcome ;-) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org