Hey Nick, Just out of curiosity, how many properties would it take to get that amount of wasted space in overhead? Are we talking about entities in the orders of magnitudes of tens/thousands/hundreds?
On Mon, Mar 22, 2010 at 9:07 AM, homunq <jameson.qu...@gmail.com> wrote: > OK, I guess I'm guilty on all counts. > > Clearly, I can fix that moving forward, though it will cost me a lot > of CPU to fix the data I've already entered. But as a short-term > stopgap, is there any way to delete entire default indexes for a given > property? (I mean, anything besides setting indexed=False and then > touching each entity one-by-one). You can vacuum custom indexes - can > you do it with indexes created by default? > > Thanks, > Jameson > > On 22 mar, 03:42, "Nick Johnson (Google)" <nick.john...@google.com> > wrote: > > Hi, > > > > The discrepancy between datastore stats volume and stored data is > generally > > due to indexing overhead, which is not included in the datastore stats. > This > > can be very high for entities with many properties, or with long entity > and > > property names or entity keys. Do you have reason to suppose that's not > the > > case in your situation? > > > > -Nick Johnson > > > > > > > > > > > > On Sun, Mar 21, 2010 at 3:39 AM, homunq <jameson.qu...@gmail.com> wrote: > > > Something is wrong. My app is showing with 7.42GB of total stored > > > data, but only 615 MB of datastore. There is only one version string > > > uploaded, which is almost 150MB, and nothing in the blobstore. This > > > discrepancy has been getting worse - several hours ago (longer than > > > the period since datastore statistics were updated, if you're > > > wondering), there were the same 615 MB in the datastore, and only > > > 3.09GB of "total stored data". (at that time, my theory was that it > > > was old uploads of tweaks to the same "version" - but the numbers have > > > gone far, far beyond that explanation now.) It's not some exploding > > > index; the only non-default index I have is on an entity type with > > > just 33 entities. > > > > > Here's the line from my dashboard: > > > Total Stored Data $0.005/GByte-day 82% 7.42 > of > > > 9.00 GBytes > > > $0.04 / $0.04 > > > > > And here is the word from my datastore statistics: > > > Last updated Total number of entities Size of all entities > > > 1:32:13 ago 232,867 615 MBytes > > > (metadata 11%, if that matters) > > > > > Please, can someone help me figure out this issue? I'd be happy to > > > share any info or code which would help track this down. My app id is > > > vulahealth. > > > > > -- > > > You received this message because you are subscribed to the Google > Groups > > > "Google App Engine" group. > > > To post to this group, send email to google-appengine@googlegroups.com > . > > > To unsubscribe from this group, send email to > > > google-appengine+unsubscr...@googlegroups.com<google-appengine%2bunsubscr...@googlegroups.com><google-appengine%2Bunsubscrib > e...@googlegroups.com> > > > . > > > For more options, visit this group at > > >http://groups.google.com/group/google-appengine?hl=en. > > > > -- > > Nick Johnson, Developer Programs Engineer, App Engine > > Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration > Number: > > 368047 > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appeng...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com<google-appengine%2bunsubscr...@googlegroups.com> > . > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > -- Patrick H. Twohig. Namazu Studios P.O. Box 34161 San Diego, CA 92163-4161 -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
