On Fri, Dec 4, 2009 at 11:46 AM, a.maza <andr.m...@gmail.com> wrote: > regarding compass: > > what about creating a task, which fetches a number of entities in > batch mode and (re-)indexes them?
I implemented a completely manual indexing using task queues (and many other ides), and in theory that's really cool. However I had three problems: 1. Task queues do not work, because tasks might get executed in parallel what almost for sure messes up your index (http://forum.compass-project.org/message.jspa?messageID=299109#299109) 2. Compass uses a huge amount of CPU 3. Frequently, the Index gets corrupted and your have to reindex everything => quite a pain (random, strange errors) 4. The search is not really fast Summing up: Compass is really cool, but it (and lucene) is not made for GAE. And imho it does not work well. However, you can implement FTS using a lucene stemmer and List properties yourself. And using that approach you are using all advantages of GAE and it's underlaying datastructures... Raphael > > > > > On 4 Dez., 11:28, Raphael André Bauer <raphael.andre.ba...@gmail.com> > wrote: >> On Thu, Dec 3, 2009 at 7:25 PM, Jess Evans <laphroai...@gmail.com> wrote: >> > The compass solution is probably sufficient for pet projects. If I >> > correctly recall, there are still serious scalability issues due to the way >> > indexes are currently stored and restrictions on app store blob size. The >> > main issue is initial timeouts due to the GAE design flaw wrt startup / >> > initial request -> timeout. Initializing compass, lucene, jdo, and serving >> > even a simple request cuts very close to the deadline. >> >> I can confirm this. If you have a really small project you can use >> Compass (both for JPA and JDO). If you have more than about 100MB to >> index it will not work due to many many reasons (tested that 3 weeks >> ago). >> >> So you have to come up with your own solution to this... >> >> ra! > > -- > > You received this message because you are subscribed to the Google Groups > "Google App Engine for Java" group. > To post to this group, send email to google-appengine-j...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine-java+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine-java?hl=en. > > > -- You received this message because you are subscribed to the Google Groups "Google App Engine for Java" group. To post to this group, send email to google-appengine-j...@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
