[ 
https://issues.apache.org/jira/browse/SOLR-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13991118#comment-13991118
 ] 

Hoss Man commented on SOLR-2894:
--------------------------------

bq. He said it's important that we don't use the variable number of shards in 
this particular because it exercises a number of specific sharding situations 
to ensure that we get the correct answers.

that makes complete sense -- i just wanted to make sure it's a _test_ 
requirement and not a _feature_ requirement.  We should definitely comment the 
test to that effect, and add a more randomized cloud based test with some 
dynamic shard assignment as well to try and help catch strange edge cases.  
I'll try to work on that to help me better understand the feature (in general, 
it's been a long time since i looved at pivot faceting)

bq.  I will spend some time on this on Thursday to see if I can clean this area 
up and make it a little more straight forward.

that would be great, thanks.  The Map vs Set aspect would be a trivial 
improvement, but in general i'm more concerned about the odd flow -- it seems 
like something that could easily bite us in the ass later when people try to 
maintain it.  It seems like it would be a lot more straight forward to:
* have modifyRequest unconditionally remove all limit/offset/overrequest params 
from the shard requests
* have a simple "getOverrequestLimitAmount(String fieldName)" method in the 
FacetInfo class (that consults the _original_ request params)
* have each code path (facet.field & facet.pivot & whatever down the road...) 
that sets params on the shard request and cares about over requesting call 
{{sreq.params.set(pre + FACET_LIMIT, getOverrequestLimitAmount(fieldName))}}

bq. Having two different purposes allows us to call refineFacets and/or 
refinePivotFacets only as needed to avoid looping through the shard responses 
an extra time. If your comment is more to the effect that the loop in 
refineFacets() and refinePivotFacets() could be merged into a single loop...

I don't have an opinion, i just wanted to understand the purpose of the new 
"PURPOSE" (heh) since we don't have a special one for range facets or query 
facets -- but in hindsight i realize that of course we don't: those don't need 
refinement. 


> Implement distributed pivot faceting
> ------------------------------------
>
>                 Key: SOLR-2894
>                 URL: https://issues.apache.org/jira/browse/SOLR-2894
>             Project: Solr
>          Issue Type: Improvement
>            Reporter: Erik Hatcher
>             Fix For: 4.9, 5.0
>
>         Attachments: SOLR-2894-reworked.patch, SOLR-2894.patch, 
> SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, 
> SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, 
> SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, 
> SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, 
> SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, 
> dateToObject.patch
>
>
> Following up on SOLR-792, pivot faceting currently only supports 
> undistributed mode.  Distributed pivot faceting needs to be implemented.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to