2 minutes to pull 2000 rows is crazy slow. That doesn't sound right. I would expect a few seconds.
One thing you should consider is putting all the elements under a common 'schematic' parent and fetching them with an ancestor query. This should be faster than walking a regular index. Jeff On Mon, Nov 21, 2011 at 3:58 PM, Kyle Anderson <kyleanderso...@gmail.com>wrote: > I run an application which manages large grid schematics. A schematic > has about 2000 grid elements (transformers, power lines, voltage > regulators, etc). There are about 40 different types of grid > elements, which are mostly set in stone. Each grid element has about > 40 attribute (voltage rating, install date, etc). The attributes are > not necessarily fixed (attributes could be added semi-frequently). > > Here is are some example rows for a single schematic (schematicId=1) > which contains a Transformer, a PowerLine, and a Regulator > > ElementId, SchematicId, ElementType, ElementAttributes > > Example rows: > 1, 1, Transformer, <voltage>5</voltage><install_date>5/1/2011</ > install_date> > 2, 1, PowerLine, <voltage>5</voltage><install_date>5/1/2011</ > install_date> > 3, 1, Regulator, <rating>5KW</rating><install_date>5/1/2011</ > install_date> > > > When the user wants to a load a schematic, I simply query this table > for all entries with the associated schematicId (this returns about > 2000 rows). The problem is that this process takes about 2 minutes. > (even though the data is only about 10MB). > > Suggestions for improvement? > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > -- I am the 20% -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.