BTW, I'm using thinking sphinx 2.0.11.
On Wednesday, October 3, 2012 5:05:32 AM UTC-7, Eric wrote:
>
> RIght, I'm using search_for_ids and it works; Thinking Sphinx only fetches
> the list of IDs not ActiveRecord objects. But when it loads the list of
> matching records from sphinx, the underlying protocol returns an enormous
> hash (in my case) for each document like this:
>
> {:doc=>31848312, :weight=>1, :index=>22813,
> :attributes=>{\"sphinx_internal_id\"=>41015, \"sphinx_deleted\"=>0,
> \"class_crc\"=>1924706381, \"sphinx_internal_class\"=>\"GrantRequest\",
> \"fip_title_sort\"=>\"..........\", \"request_id_sort\"=>\".............\",
> \"project_summary_sort\"=>\"...............\"
> .....
> }
>
> I have a lot of attributes associated with each document in the index, so
> the result is enormous. I debugged the thinking sphinx code, looking
> at search.rb's compose_ids_results and it actually includes the text of
> each full text field as well as all the attributes, no idea why. I really
> need to figure out how to avoid this as it adds significant overhead and I
> don't see a need for returning all this data.
>
> Thanks,
> Eric
>
> On Tuesday, October 2, 2012 9:00:21 PM UTC-7, Chris wrote:
>>
>> There is a search_for_ids method. See this
>> page<http://pat.github.com/ts/en/searching.html#ids>
>> .
>>
>> On Tuesday, October 2, 2012 8:27:16 PM UTC-4, Eric wrote:
>>>
>>> I'm returning a fairly large data set from sphinx for a client with a
>>> lot of filter attributes. I'm trying to get just the active record IDs.
>>>
>>> I'm seeing significant delays and a lot of memory usage. In debugging
>>> this I noticed that in search.rb's compose_ids_results, the @results object
>>> contains not only the active record IDs but pretty much my entire index
>>> with all the filter attributes. This is a lot of data and very slow for
>>> sphinx to return to my rails app.
>>>
>>> I'm wondering if there is a way to tell sphinx not to return everything
>>> it knows about each document and just return the sphinx_internal_id?
>>>
>>> Thanks much,
>>> Eric
>>>
>>
--
You received this message because you are subscribed to the Google Groups
"Thinking Sphinx" group.
To view this discussion on the web visit
https://groups.google.com/d/msg/thinking-sphinx/-/G_jig2U6AU8J.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/thinking-sphinx?hl=en.
