[google-appengine] Ideas on implementing fulltext
I know there's no official API for fulltext search, so I know I have to roll my own. I was wondering if anyone has ideas or pointers on doing it, especially in GAE. Reference URLs, etc. will be appreciated. Kind Regards Chris -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Ideas on implementing fulltext
Thanks Tristan - might go with the 2nd one for now :-) Chris On May 30, 5:19 am, Tristan wrote: > I've implemented this on app engine: > > http://www.miislita.com/term-vector/term-vector-3.html > > limitations: > - need to store your own indexes, > - need to use task queue to work around 1MB put limit when creating / > updating indexes > - search is done in memory v. via queries > - might run out of time on extremely large searches (hasn't happened > yet) > > benefits: > - you can use entire paragraphs as search queries > - automatic matching of *like* terms as a consequence of using this > approach > > Another (simpler) way is described here: > > http://googleappengine.blogspot.com/2010/04/making-your-app-searchabl... > > limitations: > - Number of search terms is limited (to roughly 5). > - You have to make sure you are searching in a subset of the data with > less than ~200 results. > > benefits: > - fast and easy to implement > > On May 29, 12:30 pm, Khookie wrote: > > > I know there's no official API for fulltext search, so I know I have > > to roll my own. > > > I was wondering if anyone has ideas or pointers on doing it, > > especially in GAE. Reference URLs, etc. will be appreciated. > > > Kind Regards > > > Chris -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Is datastore still slow?
I'm working on an app at the moment, and it sometimes drops HTTP requests, especially ones that make calls to the datastore. There are periods during the day where the app is absolutely unusable because most AJAX calls just stalls and timeouts. At other times, the same queries work like an absolute champion - super fast. Are datastore issues still ongoing? Chris -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Is datastore still slow?
I doubt you're the culprit - I'm sure Google's infrastructure can handle much much more than that! Just to clarify, it timeouts on all sorts of datastore operations, including gets & puts (my app rarely needs to delete anything). And it's been happening since the App Engine team announced their datastore issues. Then again, I started doing some usability testing with clients (which I've had to stop) on their production servers not too long before that. So I'm not 100% sure whether it's my app, or whether it's the datastore. Chris On Jul 1, 1:54 am, Nate Bauernfeind wrote: > So far in my experience (over the past two days and then on the 26th) the > data store has been slow for bulk inserts and deletes. I think that the bulk > stuff is still iterating over each element and making single calls to the > datastore. > > I don't know how possible it is to affect other users with my app's > behavior... but I am in the process of trying to delete 1.5M entries. I have > about 500k left, but my task has stopped deleting things due to timeouts. I > don't know if it's because my primary indexes are behind or if the entire > datastore is currently troubled. > > And I apologize if I am the culprit of issues (though from what I understand > there are plenty of real-production-like apps implying that my behavior > shouldn't affect anyone). I'm really not sure why there isn't a > deleteEverythingBetweenKeys(startKey, endKey) functionality in the > datastore. It sounds like BigTable should easily be able to support that. It > is a serious deficiency of the datastore to not be able to bulk delete > efficiently. > > > > On Wed, Jun 30, 2010 at 10:10 AM, Khookie wrote: > > I'm working on an app at the moment, and it sometimes drops HTTP > > requests, especially ones that make calls to the datastore. There are > > periods during the day where the app is absolutely unusable because > > most AJAX calls just stalls and timeouts. > > > At other times, the same queries work like an absolute champion - > > super fast. > > > Are datastore issues still ongoing? > > > Chris > > > -- > > You received this message because you are subscribed to the Google Groups > > "Google App Engine" group. > > To post to this group, send email to google-appeng...@googlegroups.com. > > To unsubscribe from this group, send email to > > google-appengine+unsubscr...@googlegroups.com > e...@googlegroups.com> > > . > > For more options, visit this group at > >http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Setting parent entity through bulkloader
Hi I'm importing some data through the bulkloader into the datastore, and I'd like to import the entities into existing entity group/s (i.e. setting the parent). Is it possible? Chris -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
