Try the ramdisk as suggested, it is a relatively easy thing to implement and it may shed some light into the problem.
Pablo On Mon, May 11, 2009 at 5:53 AM, Thibault Jouannic <tee...@gmail.com> wrote: > > Thank you for your replies, > > So I've got a few techs to tests : > > - doctrine searchable behavior > - xapian > - sphinx search > - java lucene > > I guess I'll find somthing userfull in there :) > > Regards. > Thibault. > > On 11 mai, 11:44, "David Ashwood" <da...@inspiredthinking.co.uk> > wrote: >> It's not just about the number of objects involved but things like index >> location, definition, file system used, locking methods, concurrency, >> read/write ratio, etc that all affect overall performance. >> Have you tried using a ramdisk and copying the index to it to see if helps? >> It would eliminate the disk IO side and some of the file based concurrency >> issues that might be affecting you. >> PHP is noisy with the file system and it might be causing problems. If you >> don't have access to a ramdisk - try moving the index to another disk from >> your PHP files (using the same approach as using a separate disk for DB log >> files to improve performance). >> >> Generally this is why I prefer DB based storage - it's an optimised engine >> for dealing with data and keeps the search close to the data you're >> searching. >> With the Doctrine approach it scales with your DB, it's as simple as >> attaching a behaviour, you can use existing tools to manage & tweak the >> indexes and it's easily extendable. >> >> -----Original Message----- >> From: symfony-users@googlegroups.com [mailto:symfony-us...@googlegroups.com] >> >> On Behalf Of Thibault Jouannic >> Sent: 11 May 2009 11:01 >> To: symfony users >> Subject: [symfony-users] Re: Zend Search scalability >> >> Hello, >> >> Thank you for your answer. I've tried to tweak a few parameters, >> optimized the index, but didn't notice any difference. >> >> I've done some searches in the zend forum, and some zend developpers >> pretend that zend search performances are equivalent to java lucene, >> while some users report performance problems as I do. >> >> I'm considering using some alternative, like sphinx search. However, >> I'm puzzled about this scalability problem, since 60000 objects sounds >> reasonable to me. I can't believe I'm the first who tried to setup >> zend search with so many objects. >> >> I would realy appreciate any feedback. >> >> Regards. >> Thibault. >> >> On 10 mai, 14:00, "David Ashwood" <da...@inspiredthinking.co.uk> >> wrote: >> > Take a look here for optimising the index that may >> help:http://framework.zend.com/manual/en/zend.search.lucene.best-practice... >> . >> > nd.search.lucene.best-practice.indexing-performance >> >> > I started using Zend Lucene but switched over to using the Doctrine >> > Behaviour that scales better in the test's I've run. You can find some >> > summary info about it >> here:http://www.doctrine-project.org/documentation/manual/1_1/en/behaviors.. >> . >> > ehaviors:searchable and some details >> here:http://www.doctrine-project.org/documentation/manual/1_1/en/searching >> >> > -----Original Message----- >> > From: symfony-users@googlegroups.com >> [mailto:symfony-us...@googlegroups.com] >> >> > On Behalf Of Thibault Jouannic >> > Sent: 10 May 2009 13:47 >> > To: symfony users >> > Subject: [symfony-users] Zend Search scalability >> >> > Hello sf users, >> >> > I've got a performance problem with zend search. >> >> > I followed the jobeet tutorial to integrate it, and at the beginning, >> > eveything worked like a charm. Today, I've got 60000 documents in db >> > (doesn't seems huge to me), and only a few fields are indexed (title, >> > tags). >> >> > Now, if a do a search with a single term, the server takes a few >> > seconds to respond. If I use more than 4-5 terms, the server run out >> > of memory. >> >> > Is there a configuration problem with my app, or a scalability problem >> > with zend search engine ? How could I tweak it to run faster ? And if >> > I can't, wich alternative would you recommend ? >> >> > Thank You. >> > Thibault. > > > --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "symfony users" group. To post to this group, send email to symfony-users@googlegroups.com To unsubscribe from this group, send email to symfony-users+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/symfony-users?hl=en -~----------~----~----~----~------~----~------~--~---
