Re: Advice for performance issues with group.facet=true

[Daniel Bryant]

Many thanks for your response Otis - I had feared as much, but it's good 
to have it confirmed.


Best wishes,

Daniel


On 03/07/2013 17:05, Otis Gospodnetic wrote:

Hi,

I think nobody in the community is focused on field
collapsing/grouping, so I suspect there won't be a fix until somebody
gets a strong-enough itch or business requires it so much that it
decides it pays to invests in the contribution.

Otis
--
Solr & ElasticSearch Support -- http://sematext.com/
Performance Monitoring -- http://sematext.com/spm



On Wed, Jul 3, 2013 at 5:54 AM, Daniel Bryant
 wrote:

Hi everyone,

I'm seeing very bad performance when grouping (field collapsing) using
group.facet=true with a large result set.

- I have an index with 2 million documents, and I query with five facet
fields (each with 30+ groups)
- If I set group.facet=false the query can take 2000ms on first run, but no
more than 250ms on subsequent execution
- If I set group.facet=true it takes on average 18000ms on the first run,
and the same time on all subsequent runs (suggesting to me that a cache is
not being used)

I've checked the Solr Jira and several others are experiencing the same
issue:

https://issues.apache.org/jira/browse/SOLR-4763

Could anyone offer any advice or suggestions please? This is becoming a
blocking issue for us, and I'm very curious if this will be fixed in the
near future?

Best wishes,

Daniel

--
*Daniel Bryant  |  Software Development Consultant  | www.tai-dev.co.uk
*
daniel.bry...@tai-dev.co.uk   |  +44 (0)
7799406399  |  Twitter: @taidevcouk 


--
*Daniel Bryant  |  Software Development Consultant  | www.tai-dev.co.uk 
*
daniel.bry...@tai-dev.co.uk   |  +44 
(0) 7799406399  |  Twitter: @taidevcouk 

Re: Advice for performance issues with group.facet=true

[Otis Gospodnetic]

Hi,

I think nobody in the community is focused on field
collapsing/grouping, so I suspect there won't be a fix until somebody
gets a strong-enough itch or business requires it so much that it
decides it pays to invests in the contribution.

Otis
--
Solr & ElasticSearch Support -- http://sematext.com/
Performance Monitoring -- http://sematext.com/spm



On Wed, Jul 3, 2013 at 5:54 AM, Daniel Bryant
 wrote:
> Hi everyone,
>
> I'm seeing very bad performance when grouping (field collapsing) using
> group.facet=true with a large result set.
>
> - I have an index with 2 million documents, and I query with five facet
> fields (each with 30+ groups)
> - If I set group.facet=false the query can take 2000ms on first run, but no
> more than 250ms on subsequent execution
> - If I set group.facet=true it takes on average 18000ms on the first run,
> and the same time on all subsequent runs (suggesting to me that a cache is
> not being used)
>
> I've checked the Solr Jira and several others are experiencing the same
> issue:
>
> https://issues.apache.org/jira/browse/SOLR-4763
>
> Could anyone offer any advice or suggestions please? This is becoming a
> blocking issue for us, and I'm very curious if this will be fixed in the
> near future?
>
> Best wishes,
>
> Daniel
>
> --
> *Daniel Bryant  |  Software Development Consultant  | www.tai-dev.co.uk
> *
> daniel.bry...@tai-dev.co.uk   |  +44 (0)
> 7799406399  |  Twitter: @taidevcouk 

Advice for performance issues with group.facet=true

[Daniel Bryant]

Hi everyone,

I'm seeing very bad performance when grouping (field collapsing) using 
group.facet=true with a large result set.


- I have an index with 2 million documents, and I query with five facet 
fields (each with 30+ groups)
- If I set group.facet=false the query can take 2000ms on first run, but 
no more than 250ms on subsequent execution
- If I set group.facet=true it takes on average 18000ms on the first 
run, and the same time on all subsequent runs (suggesting to me that a 
cache is not being used)


I've checked the Solr Jira and several others are experiencing the same 
issue:


https://issues.apache.org/jira/browse/SOLR-4763

Could anyone offer any advice or suggestions please? This is becoming a 
blocking issue for us, and I'm very curious if this will be fixed in the 
near future?


Best wishes,

Daniel

--
*Daniel Bryant  |  Software Development Consultant  | www.tai-dev.co.uk 
*
daniel.bry...@tai-dev.co.uk   |  +44 
(0) 7799406399  |  Twitter: @taidevcouk