Re: [google-appengine] Re: Stored data voiume is totally different on Datastore Statistics and Dashboard
No, I don't store any info in sessions, except logged in user id via Google Users API. On Mon, Feb 8, 2010 at 8:48 PM, Ikai L (Google) ika...@google.com wrote: Are you storing information in sessions? Session information can also take up space. On Mon, Feb 8, 2010 at 5:32 AM, Pavel Kaplin pavel.kap...@gmail.comwrote: Here's the detailed description of mentioned indexes: 1) address (string, 100 bytes), tradePoint(String, 100 bytes), user (Key, generated by GAE), timestamp 2) tradePoint, user, timestamp 3) user, timestamp Entities count is about 15k. I don't understand how it might happened. On Feb 8, 3:25 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Pavel, That depends on the nature of your indexes, and the entities being indexed. It's certainly possible for indexes to reach this magnitude - particularly if you're indexing list properties. -Nick Johnson On Mon, Feb 8, 2010 at 1:12 PM, Pavel Kaplin pavel.kap...@gmail.com wrote: It's hard to believe that 3 indexes (for 2, 3 and 4 fields) could eat 9x more space than data itself. On Feb 8, 2:45 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Pavel, The datastore stats include only the raw size of the entities. The total space consumed is the space consumed by the entities, plus the space consumed by all your indexes. -Nick Johnson On Mon, Feb 8, 2010 at 12:35 PM, Pavel Kaplin pavel.kap...@gmail.com wrote: Hi there! My datastore stats says me Size of all entities = 51 MBytes, but dashboard shows 0.54 Gb as Total Stored Data. As you can see, these values differ from each other for more than ten times. Why? Application id is bayadera-tracker -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Ikai Lan Developer Programs Engineer, Google App Engine http://googleappengine.blogspot.com | http://twitter.com/app_engine -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Павел Каплин -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Stored data voiume is totally different on Datastore Statistics and Dashboard
I like this suggestion too. Moreover, I'd prefer detailed description of the number called Used Space on Dashboard/Quota Details pages. E.g. indexes = 250 Mb , Entities = 500 Mb, sessions = 50 Mb and so on, plus detailed info about indexes and sessions. What do you think? On Mon, Feb 8, 2010 at 9:57 PM, Robert Kluin robert.kl...@gmail.com wrote: I like Philip's suggestion a lot. It will help us all identify space intensive indexes, and _hopefully_ reduce the number of posts about this. I submitted a feature request for this issue: http://code.google.com/p/googleappengine/issues/detail?id=2740 Robert On Mon, Feb 8, 2010 at 2:27 PM, WeatherPhilip philip-goo...@gladstonefamily.net wrote: This issue comes up about once per week. Google -- you need to address this. The simplest way of addressing it would be to put the size of *every* index on the statistics page, and show that the total corresponds (roughly) to the quota number. This would enable people to see which index (or indexes) was consuming a lot of space, and take steps to optimize -- maybe by not indexing that field. Philip On Feb 8, 1:48 pm, Ikai L (Google) ika...@google.com wrote: Are you storing information in sessions? Session information can also take up space. On Mon, Feb 8, 2010 at 5:32 AM, Pavel Kaplin pavel.kap...@gmail.com wrote: Here's the detailed description of mentioned indexes: 1) address (string, 100 bytes), tradePoint(String, 100 bytes), user (Key, generated by GAE), timestamp 2) tradePoint, user, timestamp 3) user, timestamp Entities count is about 15k. I don't understand how it might happened. On Feb 8, 3:25 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Pavel, That depends on the nature of your indexes, and the entities being indexed. It's certainly possible for indexes to reach this magnitude - particularly if you're indexing list properties. -Nick Johnson On Mon, Feb 8, 2010 at 1:12 PM, Pavel Kaplin pavel.kap...@gmail.com wrote: It's hard to believe that 3 indexes (for 2, 3 and 4 fields) could eat 9x more space than data itself. On Feb 8, 2:45 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Pavel, The datastore stats include only the raw size of the entities. The total space consumed is the space consumed by the entities, plus the space consumed by all your indexes. -Nick Johnson On Mon, Feb 8, 2010 at 12:35 PM, Pavel Kaplin pavel.kap...@gmail.com wrote: Hi there! My datastore stats says me Size of all entities = 51 MBytes, but dashboard shows 0.54 Gb as Total Stored Data. As you can see, these values differ from each other for more than ten times. Why? Application id is bayadera-tracker -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Ikai Lan Developer Programs Engineer, Google
Re: [google-appengine] Re: Stored data voiume is totally different on Datastore Statistics and Dashboard
I think it is a great ide. Would certainly help us better understand how we are using space. Robert On Tue, Feb 9, 2010 at 4:12 AM, Pavel Kaplin pavel.kap...@gmail.com wrote: I like this suggestion too. Moreover, I'd prefer detailed description of the number called Used Space on Dashboard/Quota Details pages. E.g. indexes = 250 Mb , Entities = 500 Mb, sessions = 50 Mb and so on, plus detailed info about indexes and sessions. What do you think? On Mon, Feb 8, 2010 at 9:57 PM, Robert Kluin robert.kl...@gmail.com wrote: I like Philip's suggestion a lot. It will help us all identify space intensive indexes, and _hopefully_ reduce the number of posts about this. I submitted a feature request for this issue: http://code.google.com/p/googleappengine/issues/detail?id=2740 Robert On Mon, Feb 8, 2010 at 2:27 PM, WeatherPhilip philip-goo...@gladstonefamily.net wrote: This issue comes up about once per week. Google -- you need to address this. The simplest way of addressing it would be to put the size of *every* index on the statistics page, and show that the total corresponds (roughly) to the quota number. This would enable people to see which index (or indexes) was consuming a lot of space, and take steps to optimize -- maybe by not indexing that field. Philip On Feb 8, 1:48 pm, Ikai L (Google) ika...@google.com wrote: Are you storing information in sessions? Session information can also take up space. On Mon, Feb 8, 2010 at 5:32 AM, Pavel Kaplin pavel.kap...@gmail.com wrote: Here's the detailed description of mentioned indexes: 1) address (string, 100 bytes), tradePoint(String, 100 bytes), user (Key, generated by GAE), timestamp 2) tradePoint, user, timestamp 3) user, timestamp Entities count is about 15k. I don't understand how it might happened. On Feb 8, 3:25 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Pavel, That depends on the nature of your indexes, and the entities being indexed. It's certainly possible for indexes to reach this magnitude - particularly if you're indexing list properties. -Nick Johnson On Mon, Feb 8, 2010 at 1:12 PM, Pavel Kaplin pavel.kap...@gmail.com wrote: It's hard to believe that 3 indexes (for 2, 3 and 4 fields) could eat 9x more space than data itself. On Feb 8, 2:45 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Pavel, The datastore stats include only the raw size of the entities. The total space consumed is the space consumed by the entities, plus the space consumed by all your indexes. -Nick Johnson On Mon, Feb 8, 2010 at 12:35 PM, Pavel Kaplin pavel.kap...@gmail.com wrote: Hi there! My datastore stats says me Size of all entities = 51 MBytes, but dashboard shows 0.54 Gb as Total Stored Data. As you can see, these values differ from each other for more than ten times. Why? Application id is bayadera-tracker -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more
[google-appengine] Re: Stored data voiume is totally different on Datastore Statistics and Dashboard
It's hard to believe that 3 indexes (for 2, 3 and 4 fields) could eat 9x more space than data itself. On Feb 8, 2:45 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Pavel, The datastore stats include only the raw size of the entities. The total space consumed is the space consumed by the entities, plus the space consumed by all your indexes. -Nick Johnson On Mon, Feb 8, 2010 at 12:35 PM, Pavel Kaplin pavel.kap...@gmail.comwrote: Hi there! My datastore stats says me Size of all entities = 51 MBytes, but dashboard shows 0.54 Gb as Total Stored Data. As you can see, these values differ from each other for more than ten times. Why? Application id is bayadera-tracker -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Stored data voiume is totally different on Datastore Statistics and Dashboard
Here's the detailed description of mentioned indexes: 1) address (string, 100 bytes), tradePoint(String, 100 bytes), user (Key, generated by GAE), timestamp 2) tradePoint, user, timestamp 3) user, timestamp Entities count is about 15k. I don't understand how it might happened. On Feb 8, 3:25 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Pavel, That depends on the nature of your indexes, and the entities being indexed. It's certainly possible for indexes to reach this magnitude - particularly if you're indexing list properties. -Nick Johnson On Mon, Feb 8, 2010 at 1:12 PM, Pavel Kaplin pavel.kap...@gmail.com wrote: It's hard to believe that 3 indexes (for 2, 3 and 4 fields) could eat 9x more space than data itself. On Feb 8, 2:45 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Pavel, The datastore stats include only the raw size of the entities. The total space consumed is the space consumed by the entities, plus the space consumed by all your indexes. -Nick Johnson On Mon, Feb 8, 2010 at 12:35 PM, Pavel Kaplin pavel.kap...@gmail.com wrote: Hi there! My datastore stats says me Size of all entities = 51 MBytes, but dashboard shows 0.54 Gb as Total Stored Data. As you can see, these values differ from each other for more than ten times. Why? Application id is bayadera-tracker -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Stored data voiume is totally different on Datastore Statistics and Dashboard
Are you storing information in sessions? Session information can also take up space. On Mon, Feb 8, 2010 at 5:32 AM, Pavel Kaplin pavel.kap...@gmail.com wrote: Here's the detailed description of mentioned indexes: 1) address (string, 100 bytes), tradePoint(String, 100 bytes), user (Key, generated by GAE), timestamp 2) tradePoint, user, timestamp 3) user, timestamp Entities count is about 15k. I don't understand how it might happened. On Feb 8, 3:25 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Pavel, That depends on the nature of your indexes, and the entities being indexed. It's certainly possible for indexes to reach this magnitude - particularly if you're indexing list properties. -Nick Johnson On Mon, Feb 8, 2010 at 1:12 PM, Pavel Kaplin pavel.kap...@gmail.com wrote: It's hard to believe that 3 indexes (for 2, 3 and 4 fields) could eat 9x more space than data itself. On Feb 8, 2:45 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Pavel, The datastore stats include only the raw size of the entities. The total space consumed is the space consumed by the entities, plus the space consumed by all your indexes. -Nick Johnson On Mon, Feb 8, 2010 at 12:35 PM, Pavel Kaplin pavel.kap...@gmail.com wrote: Hi there! My datastore stats says me Size of all entities = 51 MBytes, but dashboard shows 0.54 Gb as Total Stored Data. As you can see, these values differ from each other for more than ten times. Why? Application id is bayadera-tracker -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Ikai Lan Developer Programs Engineer, Google App Engine http://googleappengine.blogspot.com | http://twitter.com/app_engine -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Stored data voiume is totally different on Datastore Statistics and Dashboard
This issue comes up about once per week. Google -- you need to address this. The simplest way of addressing it would be to put the size of *every* index on the statistics page, and show that the total corresponds (roughly) to the quota number. This would enable people to see which index (or indexes) was consuming a lot of space, and take steps to optimize -- maybe by not indexing that field. Philip On Feb 8, 1:48 pm, Ikai L (Google) ika...@google.com wrote: Are you storing information in sessions? Session information can also take up space. On Mon, Feb 8, 2010 at 5:32 AM, Pavel Kaplin pavel.kap...@gmail.com wrote: Here's the detailed description of mentioned indexes: 1) address (string, 100 bytes), tradePoint(String, 100 bytes), user (Key, generated by GAE), timestamp 2) tradePoint, user, timestamp 3) user, timestamp Entities count is about 15k. I don't understand how it might happened. On Feb 8, 3:25 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Pavel, That depends on the nature of your indexes, and the entities being indexed. It's certainly possible for indexes to reach this magnitude - particularly if you're indexing list properties. -Nick Johnson On Mon, Feb 8, 2010 at 1:12 PM, Pavel Kaplin pavel.kap...@gmail.com wrote: It's hard to believe that 3 indexes (for 2, 3 and 4 fields) could eat 9x more space than data itself. On Feb 8, 2:45 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Pavel, The datastore stats include only the raw size of the entities. The total space consumed is the space consumed by the entities, plus the space consumed by all your indexes. -Nick Johnson On Mon, Feb 8, 2010 at 12:35 PM, Pavel Kaplin pavel.kap...@gmail.com wrote: Hi there! My datastore stats says me Size of all entities = 51 MBytes, but dashboard shows 0.54 Gb as Total Stored Data. As you can see, these values differ from each other for more than ten times. Why? Application id is bayadera-tracker -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Ikai Lan Developer Programs Engineer, Google App Enginehttp://googleappengine.blogspot.com|http://twitter.com/app_engine -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Stored data voiume is totally different on Datastore Statistics and Dashboard
I like Philip's suggestion a lot. It will help us all identify space intensive indexes, and _hopefully_ reduce the number of posts about this. I submitted a feature request for this issue: http://code.google.com/p/googleappengine/issues/detail?id=2740 Robert On Mon, Feb 8, 2010 at 2:27 PM, WeatherPhilip philip-goo...@gladstonefamily.net wrote: This issue comes up about once per week. Google -- you need to address this. The simplest way of addressing it would be to put the size of *every* index on the statistics page, and show that the total corresponds (roughly) to the quota number. This would enable people to see which index (or indexes) was consuming a lot of space, and take steps to optimize -- maybe by not indexing that field. Philip On Feb 8, 1:48 pm, Ikai L (Google) ika...@google.com wrote: Are you storing information in sessions? Session information can also take up space. On Mon, Feb 8, 2010 at 5:32 AM, Pavel Kaplin pavel.kap...@gmail.com wrote: Here's the detailed description of mentioned indexes: 1) address (string, 100 bytes), tradePoint(String, 100 bytes), user (Key, generated by GAE), timestamp 2) tradePoint, user, timestamp 3) user, timestamp Entities count is about 15k. I don't understand how it might happened. On Feb 8, 3:25 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Pavel, That depends on the nature of your indexes, and the entities being indexed. It's certainly possible for indexes to reach this magnitude - particularly if you're indexing list properties. -Nick Johnson On Mon, Feb 8, 2010 at 1:12 PM, Pavel Kaplin pavel.kap...@gmail.com wrote: It's hard to believe that 3 indexes (for 2, 3 and 4 fields) could eat 9x more space than data itself. On Feb 8, 2:45 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Pavel, The datastore stats include only the raw size of the entities. The total space consumed is the space consumed by the entities, plus the space consumed by all your indexes. -Nick Johnson On Mon, Feb 8, 2010 at 12:35 PM, Pavel Kaplin pavel.kap...@gmail.com wrote: Hi there! My datastore stats says me Size of all entities = 51 MBytes, but dashboard shows 0.54 Gb as Total Stored Data. As you can see, these values differ from each other for more than ten times. Why? Application id is bayadera-tracker -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Nick Johnson, Developer Programs Engineer, App Engine Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number: 368047 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Ikai Lan Developer Programs Engineer, Google App Enginehttp://googleappengine.blogspot.com|http://twitter.com/app_engine -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to
