Re: [google-appengine] ~7 GB of ghost data???

2010-03-22 Thread Brett Shelley
Are you storing anything in the Blob Store?  If so, well, deleting Blobs
from the AppSpot console does not work.  Perhaps the problem is systemic.
 But, if it helps revenue, then why fix it?

-Brett

On Mon, Mar 22, 2010 at 5:26 AM, Robert Kluin robert.kl...@gmail.comwrote:

 I do not think they charge separately for backups and replicas.  I am
 pretty sure they have stated before that the cost of those services is
  already included in the storage charge.

 I can not find the post that referenced this though.





 On Mon, Mar 22, 2010 at 12:21 PM, Tom Wu service.g2...@gmail.com wrote:
  GAE is cluster which include master  slaver, backup system... etc..
  So the quota is much bigger than your local file.
 
 
 
  2010/3/22 杨浩 skzr@gmail.com
 
  I have the same about thaTt!
  my entities:167MB but total's 1G,It's over quota!
  the other 833MB it's meta datas!
  It's very confused!
 
  2010/3/21 homunq jameson.qu...@gmail.com
 
  Something is wrong. My app is showing with 7.42GB of total stored
  data, but only 615 MB of datastore. There is only one version string
  uploaded, which is almost 150MB, and nothing in the blobstore. This
  discrepancy has been getting worse - several hours ago (longer than
  the period since datastore statistics were updated, if you're
  wondering), there were the same 615 MB in the datastore, and only
  3.09GB of total stored data. (at that time, my theory was that it
  was old uploads of tweaks to the same version - but the numbers have
  gone far, far beyond that explanation now.) It's not some exploding
  index; the only non-default index I have is on an entity type with
  just 33 entities.
 
  Here's the line from my dashboard:
  Total Stored Data$0.005/GByte-day82% 7.42
 of
  9.00 GBytes
  $0.04 / $0.04
 
  And here is the word from my datastore statistics:
  Last updatedTotal number of entitiesSize of all entities
  1:32:13 ago 232,867 615 MBytes
  (metadata 11%, if that matters)
 
  Please, can someone help me figure out this issue? I'd be happy to
  share any info or code which would help track this down. My app id is
  vulahealth.
 
  --
  You received this message because you are subscribed to the Google
 Groups
  Google App Engine group.
  To post to this group, send email to google-appeng...@googlegroups.com.
  To unsubscribe from this group, send email to
  google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
 .
  For more options, visit this group at
  http://groups.google.com/group/google-appengine?hl=en.
 
  --
  You received this message because you are subscribed to the Google Groups
  Google App Engine group.
  To post to this group, send email to google-appeng...@googlegroups.com.
  To unsubscribe from this group, send email to
  google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
 .
  For more options, visit this group at
  http://groups.google.com/group/google-appengine?hl=en.
 

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appeng...@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
 .
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] ~7 GB of ghost data???

2010-03-22 Thread Nick Johnson (Google)
Hi,

The discrepancy between datastore stats volume and stored data is generally
due to indexing overhead, which is not included in the datastore stats. This
can be very high for entities with many properties, or with long entity and
property names or entity keys. Do you have reason to suppose that's not the
case in your situation?

-Nick Johnson

On Sun, Mar 21, 2010 at 3:39 AM, homunq jameson.qu...@gmail.com wrote:

 Something is wrong. My app is showing with 7.42GB of total stored
 data, but only 615 MB of datastore. There is only one version string
 uploaded, which is almost 150MB, and nothing in the blobstore. This
 discrepancy has been getting worse - several hours ago (longer than
 the period since datastore statistics were updated, if you're
 wondering), there were the same 615 MB in the datastore, and only
 3.09GB of total stored data. (at that time, my theory was that it
 was old uploads of tweaks to the same version - but the numbers have
 gone far, far beyond that explanation now.) It's not some exploding
 index; the only non-default index I have is on an entity type with
 just 33 entities.

 Here's the line from my dashboard:
 Total Stored Data$0.005/GByte-day82% 7.42 of
 9.00 GBytes
 $0.04 / $0.04

 And here is the word from my datastore statistics:
 Last updatedTotal number of entitiesSize of all entities
 1:32:13 ago 232,867 615 MBytes
 (metadata 11%, if that matters)

 Please, can someone help me figure out this issue? I'd be happy to
 share any info or code which would help track this down. My app id is
 vulahealth.

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appeng...@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
 .
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.




-- 
Nick Johnson, Developer Programs Engineer, App Engine
Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number:
368047

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] ~7 GB of ghost data???

2010-03-21 Thread homunq
Something is wrong. My app is showing with 7.42GB of total stored
data, but only 615 MB of datastore. There is only one version string
uploaded, which is almost 150MB, and nothing in the blobstore. This
discrepancy has been getting worse - several hours ago (longer than
the period since datastore statistics were updated, if you're
wondering), there were the same 615 MB in the datastore, and only
3.09GB of total stored data. (at that time, my theory was that it
was old uploads of tweaks to the same version - but the numbers have
gone far, far beyond that explanation now.) It's not some exploding
index; the only non-default index I have is on an entity type with
just 33 entities.

Here's the line from my dashboard:
Total Stored Data$0.005/GByte-day82% 7.42 of 9.00 
GBytes
$0.04 / $0.04

And here is the word from my datastore statistics:
Last updatedTotal number of entitiesSize of all entities
1:32:13 ago 232,867 615 MBytes
(metadata 11%, if that matters)

Please, can someone help me figure out this issue? I'd be happy to
share any info or code which would help track this down. My app id is
vulahealth.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] ~7 GB of ghost data???

2010-03-21 Thread 杨浩
I have the same about that!
my entities:167MB but total's 1G,It's over quota!
the other 833MB it's meta datas!
*It's very confused!*

2010/3/21 homunq jameson.qu...@gmail.com

 Something is wrong. My app is showing with 7.42GB of total stored
 data, but only 615 MB of datastore. There is only one version string
 uploaded, which is almost 150MB, and nothing in the blobstore. This
 discrepancy has been getting worse - several hours ago (longer than
 the period since datastore statistics were updated, if you're
 wondering), there were the same 615 MB in the datastore, and only
 3.09GB of total stored data. (at that time, my theory was that it
 was old uploads of tweaks to the same version - but the numbers have
 gone far, far beyond that explanation now.) It's not some exploding
 index; the only non-default index I have is on an entity type with
 just 33 entities.

 Here's the line from my dashboard:
 Total Stored Data$0.005/GByte-day82% 7.42 of
 9.00 GBytes
 $0.04 / $0.04

 And here is the word from my datastore statistics:
 Last updatedTotal number of entitiesSize of all entities
 1:32:13 ago 232,867 615 MBytes
 (metadata 11%, if that matters)

 Please, can someone help me figure out this issue? I'd be happy to
 share any info or code which would help track this down. My app id is
 vulahealth.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] ~7 GB of ghost data???

2010-03-21 Thread Tom Wu
GAE is cluster which include master  slaver, backup system... etc..
So the quota is much bigger than your local file.



2010/3/22 杨浩 skzr@gmail.com

 I have the same about thaTt!
 my entities:167MB but total's 1G,It's over quota!
 the other 833MB it's meta datas!
 *It's very confused!*

 2010/3/21 homunq jameson.qu...@gmail.com

 Something is wrong. My app is showing with 7.42GB of total stored
 data, but only 615 MB of datastore. There is only one version string
 uploaded, which is almost 150MB, and nothing in the blobstore. This
 discrepancy has been getting worse - several hours ago (longer than
 the period since datastore statistics were updated, if you're
 wondering), there were the same 615 MB in the datastore, and only
 3.09GB of total stored data. (at that time, my theory was that it
 was old uploads of tweaks to the same version - but the numbers have
 gone far, far beyond that explanation now.) It's not some exploding
 index; the only non-default index I have is on an entity type with
 just 33 entities.

 Here's the line from my dashboard:
 Total Stored Data$0.005/GByte-day82% 7.42 of
 9.00 GBytes
 $0.04 / $0.04

 And here is the word from my datastore statistics:
 Last updatedTotal number of entitiesSize of all entities
 1:32:13 ago 232,867 615 MBytes
 (metadata 11%, if that matters)

 Please, can someone help me figure out this issue? I'd be happy to
 share any info or code which would help track this down. My app id is
 vulahealth.

  --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appeng...@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com
 .
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] ~7 GB of ghost data???

2010-03-21 Thread Robert Kluin
I do not think they charge separately for backups and replicas.  I am
pretty sure they have stated before that the cost of those services is
 already included in the storage charge.

I can not find the post that referenced this though.





On Mon, Mar 22, 2010 at 12:21 PM, Tom Wu service.g2...@gmail.com wrote:
 GAE is cluster which include master  slaver, backup system... etc..
 So the quota is much bigger than your local file.



 2010/3/22 杨浩 skzr@gmail.com

 I have the same about thaTt!
 my entities:167MB but total's 1G,It's over quota!
 the other 833MB it's meta datas!
 It's very confused!

 2010/3/21 homunq jameson.qu...@gmail.com

 Something is wrong. My app is showing with 7.42GB of total stored
 data, but only 615 MB of datastore. There is only one version string
 uploaded, which is almost 150MB, and nothing in the blobstore. This
 discrepancy has been getting worse - several hours ago (longer than
 the period since datastore statistics were updated, if you're
 wondering), there were the same 615 MB in the datastore, and only
 3.09GB of total stored data. (at that time, my theory was that it
 was old uploads of tweaks to the same version - but the numbers have
 gone far, far beyond that explanation now.) It's not some exploding
 index; the only non-default index I have is on an entity type with
 just 33 entities.

 Here's the line from my dashboard:
 Total Stored Data        $0.005/GByte-day                82%     7.42 of
 9.00 GBytes
 $0.04 / $0.04

 And here is the word from my datastore statistics:
 Last updated    Total number of entities        Size of all entities
 1:32:13 ago     232,867 615 MBytes
 (metadata 11%, if that matters)

 Please, can someone help me figure out this issue? I'd be happy to
 share any info or code which would help track this down. My app id is
 vulahealth.

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appeng...@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To post to this group, send email to google-appeng...@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine+unsubscr...@googlegroups.com.
 For more options, visit this group at
 http://groups.google.com/group/google-appengine?hl=en.


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.