Hey all, I'm bashing my head on this one and I can't believe that I'm doing it right.
Our setup is, we have a dedicated server with sphinx serving just 3 indexes (faq, discussion, user). Indexing takes about an hour for the full discussion index, so I'm using delayed deltas. However, this means that the index task needs to do an UPDATE on the discussion table. Which means I can't run it off a replicated (readonly) slave - and so my main db (write) server gets taken down when indexing because of the relative power of the sphinx box and the overloaded state of the master db. Possible solutions: - add sql rate limiting to sphinx. Makes the index take four hours instead. - there seems to be such a thing as index merging. maybe use this instead of reindexing? - disable delta indexing and use the read-slave to index. Discussions only get reindexed fully every hour or so, no delta. - set up mysqlproxy and automatically send reads and writes to the correct place. Requires that I learn Lua. Not entirely viable. - patch Sphinx to allow different db connections. - ??? How do other people solve this issue? However, we are running on an old version of Sphinx. What if we upgrade to the latest with MVA and realtime indexes - we won't need the deltas any more, right? -c3 -- You received this message because you are subscribed to the Google Groups "Thinking Sphinx" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/thinking-sphinx?hl=en.
