Hi Patrick, An overhead factor of 12 (as observed below) is high, but not outrageous. With long model names and property names, this could happen with relatively few indexed properties - on the order of magnitude of tens, at most.
-Nick Johnson On Mon, Mar 22, 2010 at 8:07 PM, Patrick Twohig <patr...@namazustudios.com>wrote: > Hey Nick, > > Just out of curiosity, how many properties would it take to get that amount > of wasted space in overhead? Are we talking about entities in the orders of > magnitudes of tens/thousands/hundreds? > > > > On Mon, Mar 22, 2010 at 9:07 AM, homunq <jameson.qu...@gmail.com> wrote: > >> OK, I guess I'm guilty on all counts. >> >> Clearly, I can fix that moving forward, though it will cost me a lot >> of CPU to fix the data I've already entered. But as a short-term >> stopgap, is there any way to delete entire default indexes for a given >> property? (I mean, anything besides setting indexed=False and then >> touching each entity one-by-one). You can vacuum custom indexes - can >> you do it with indexes created by default? >> >> Thanks, >> Jameson >> >> On 22 mar, 03:42, "Nick Johnson (Google)" <nick.john...@google.com> >> wrote: >> > Hi, >> > >> > The discrepancy between datastore stats volume and stored data is >> generally >> > due to indexing overhead, which is not included in the datastore stats. >> This >> > can be very high for entities with many properties, or with long entity >> and >> > property names or entity keys. Do you have reason to suppose that's not >> the >> > case in your situation? >> > >> > -Nick Johnson >> > >> > >> > >> > >> > >> > On Sun, Mar 21, 2010 at 3:39 AM, homunq <jameson.qu...@gmail.com> >> wrote: >> > > Something is wrong. My app is showing with 7.42GB of total stored >> > > data, but only 615 MB of datastore. There is only one version string >> > > uploaded, which is almost 150MB, and nothing in the blobstore. This >> > > discrepancy has been getting worse - several hours ago (longer than >> > > the period since datastore statistics were updated, if you're >> > > wondering), there were the same 615 MB in the datastore, and only >> > > 3.09GB of "total stored data". (at that time, my theory was that it >> > > was old uploads of tweaks to the same "version" - but the numbers have >> > > gone far, far beyond that explanation now.) It's not some exploding >> > > index; the only non-default index I have is on an entity type with >> > > just 33 entities. >> > >> > > Here's the line from my dashboard: >> > > Total Stored Data $0.005/GByte-day 82% 7.42 >> of >> > > 9.00 GBytes >> > > $0.04 / $0.04 >> > >> > > And here is the word from my datastore statistics: >> > > Last updated Total number of entities Size of all entities >> > > 1:32:13 ago 232,867 615 MBytes >> > > (metadata 11%, if that matters) >> > >> > > Please, can someone help me figure out this issue? I'd be happy to >> > > share any info or code which would help track this down. My app id is >> > > vulahealth. >> > >> > > -- >> > > You received this message because you are subscribed to the Google >> Groups >> > > "Google App Engine" group. >> > > To post to this group, send email to >> google-appeng...@googlegroups.com. >> > > To unsubscribe from this group, send email to >> > > google-appengine+unsubscr...@googlegroups.com<google-appengine%2bunsubscr...@googlegroups.com><google-appengine%2Bunsubscrib >> e...@googlegroups.com> >> > > . >> > > For more options, visit this group at >> > >http://groups.google.com/group/google-appengine?hl=en. >> > >> > -- >> > Nick Johnson, Developer Programs Engineer, App Engine >> > Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration >> Number: >> > 368047 >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To post to this group, send email to google-appeng...@googlegroups.com. >> To unsubscribe from this group, send email to >> google-appengine+unsubscr...@googlegroups.com<google-appengine%2bunsubscr...@googlegroups.com> >> . >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> >> > > > -- > Patrick H. Twohig. > > Namazu Studios > P.O. Box 34161 > San Diego, CA 92163-4161 > > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appeng...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com<google-appengine%2bunsubscr...@googlegroups.com> > . > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
