Re: [google-appengine] HELP! 7 GB of ghost data - billable but not in datastore, blobs, or versions.

[Eli Jones]

Also, you can star this issue requesting that Google add Index Stats
somewhere so that people can tell how much storage their indexes are using.

http://code.google.com/p/googleappengine/issues/detail?id=2740


On Sun, Mar 21, 2010 at 9:06 PM, Eli Jones  wrote:

> Depending on how your Models are defined (how many properties and what the
> property types are there) and depending on custom indexes, 10 to 1 is
> reasonable.
>
> For my app, I aggressively set most properties to Indexed=false and I have
> no custom indexes.  I'm still at 2 to 1 for Datastore usage versus Size of
> All Entities.
>
> To fully explore what is going on, you'd need to post what your Model
> definitions are.. and then post what custom indexes are defined on any of
> the properties.
>
> If you've been creating and then later on deleting custom indexes or
> changing your Models around.. running vacuum indexes might help (but that's
> just a shot in the dark).
>
>
> On Sun, Mar 21, 2010 at 7:19 PM, homunq  wrote:
>
>> My app is showing only 739 MB of datastore data, only 1 version
>> (<150MB), no blobs, a tiny amount of index and memcache use (<2K in
>> each case) - and yet 7.7GB of billable data! What the heck is going
>> on? How can I fix it?
>>
>> Last updatedTotal number of entitiesSize of all entities
>> 3:27:42 ago 279,689 739 MBytes
>>
>> Total Stored Data$0.005/GByte-day86% 7.70 of
>> 9.00 GBytes
>> $0.04 / $0.04
>>
>> This situation has persisted for well over 24 hours now, it's not just
>> a figment of the update period. Also, there's negligible non-default
>> indexes, and probably a total of around 2 GB if you count all my
>> uploaded code versions ever (but since they all had the same version
>> string, they should have overwritten). I probably have a fair amount
>> of data in the logs - I have a number of cron jobs, collectively they
>> run just under twice a minute - but supposedly logs are not billable
>> data.
>>
>> This is an app I'm developing for a client. Until this issue is fixed,
>> I'm certainly not going to bill for my work, which is otherwise done.
>> So I'm anxious to fix this ASAP. If there's somewhere else I should/
>> could be taking this question (aside from IRC, where I've brought it
>> up twice), I'd be happy to learn it. If there's any further info which
>> could help resolve this, I'd be happy to share it, too. (My app id is
>> vulahealth)
>>
>> Thanks,
>> Jameson
>>
>> (Second post, I think the first post was moderated into oblivion - it
>> was my first post on this list.)
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Google App Engine" group.
>> To post to this group, send email to google-appeng...@googlegroups.com.
>> To unsubscribe from this group, send email to
>> google-appengine+unsubscr...@googlegroups.com
>> .
>> For more options, visit this group at
>> http://groups.google.com/group/google-appengine?hl=en.
>>
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] HELP! 7 GB of ghost data - billable but not in datastore, blobs, or versions.

[Eli Jones]

Depending on how your Models are defined (how many properties and what the
property types are there) and depending on custom indexes, 10 to 1 is
reasonable.

For my app, I aggressively set most properties to Indexed=false and I have
no custom indexes.  I'm still at 2 to 1 for Datastore usage versus Size of
All Entities.

To fully explore what is going on, you'd need to post what your Model
definitions are.. and then post what custom indexes are defined on any of
the properties.

If you've been creating and then later on deleting custom indexes or
changing your Models around.. running vacuum indexes might help (but that's
just a shot in the dark).

On Sun, Mar 21, 2010 at 7:19 PM, homunq  wrote:

> My app is showing only 739 MB of datastore data, only 1 version
> (<150MB), no blobs, a tiny amount of index and memcache use (<2K in
> each case) - and yet 7.7GB of billable data! What the heck is going
> on? How can I fix it?
>
> Last updatedTotal number of entitiesSize of all entities
> 3:27:42 ago 279,689 739 MBytes
>
> Total Stored Data$0.005/GByte-day86% 7.70 of
> 9.00 GBytes
> $0.04 / $0.04
>
> This situation has persisted for well over 24 hours now, it's not just
> a figment of the update period. Also, there's negligible non-default
> indexes, and probably a total of around 2 GB if you count all my
> uploaded code versions ever (but since they all had the same version
> string, they should have overwritten). I probably have a fair amount
> of data in the logs - I have a number of cron jobs, collectively they
> run just under twice a minute - but supposedly logs are not billable
> data.
>
> This is an app I'm developing for a client. Until this issue is fixed,
> I'm certainly not going to bill for my work, which is otherwise done.
> So I'm anxious to fix this ASAP. If there's somewhere else I should/
> could be taking this question (aside from IRC, where I've brought it
> up twice), I'd be happy to learn it. If there's any further info which
> could help resolve this, I'd be happy to share it, too. (My app id is
> vulahealth)
>
> Thanks,
> Jameson
>
> (Second post, I think the first post was moderated into oblivion - it
> was my first post on this list.)
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appeng...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.