Re: [google-appengine] Re: How I can predict or calculate overhead in Datastorage. For me now it looks like 900% or real stored data. Or its simple multiplayed by 10?
Another thanks. Your advice is very helpful. Now I have next numbers: In statistic - 113 MBytes, i.e. 11,3%. In Dashboard - 13%. 14 января 2010 г. 12:34 пользователь Петр Воронов chemo...@gmail.com написал: Many thanks. I will try. 2010/1/13 dburns drrnb...@gmail.com: Every single one of those properties is indexed by default. Do you really need to be able to search or sort by every property? If not, add indexed=False to the parameter list for each property where an index isn't required. That will affect new entries, but won't affect the existing data. To update the existing data (to reduce space), you would have to traverse over all the entities and simply get and put them. On Jan 13, 6:09 am, Петр Воронов chemo...@gmail.com wrote: Hi Google and all. It's my third post about difference datastore size in Datastore Statistics and Total Stored Data in Dashboard (so and in Quota or Billing). Now I have in Statistic: Size of all entities 29 MBytes In Total Stored Data 29% - 0.29 of 1.00 GBytes So I have overhead - 900%. I don't use any own created index. I have only two type of Kind class MarketStats(db.Model): typeID = db.IntegerProperty(required=True) regionID = db.IntegerProperty() solarSystemID = db.IntegerProperty(required=True) updated = db.DateTimeProperty() ordersSell = db.IntegerProperty(default=0) minSellPrice = db.IntegerProperty(default=0) maxSellPrice = db.IntegerProperty(default=0) averageSellPrice = db.IntegerProperty(default=0) medianSellPrice = db.IntegerProperty(default=0) volSellRemaining = db.IntegerProperty(default=0) volSellEntered = db.IntegerProperty(default=0) newestSellOrder = db.DateProperty(default=None) oldestSellOrder = db.DateProperty(default=None) ordersBuy = db.IntegerProperty(default=0) minBuyPrice = db.IntegerProperty(default=0) maxBuyPrice = db.IntegerProperty(default=0) averageBuyPrice = db.IntegerProperty(default=0) medianBuyPrice = db.IntegerProperty(default=0) volBuyRemaining = db.IntegerProperty(default=0) volBuyEntered = db.IntegerProperty(default=0) newestBuyOrder = db.DateProperty(default=None) oldestBuyOrder = db.DateProperty(default=None) class MarketHistory(MarketStats): date = db.DateProperty(required=True) All items of MarketStats work as Parents for some amount of MarketHistory items. All of this has keys name build by %06d%09d % (typeID,solarSystemID) for MarketStats date.isoformat()+%06d%09d % (typeID,solarSystemID) for MarketHistory Please help how I can decrease datastore usage in Dashboard? Which tips and tricks I can use? Or it's simple multiply data from Statistic by 10 ? Best regards, Chem. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: How I can predict or calculate overhead in Datastorage. For me now it looks like 900% or real stored data. Or its simple multiplayed by 10?
Many thanks. I will try. 2010/1/13 dburns drrnb...@gmail.com: Every single one of those properties is indexed by default. Do you really need to be able to search or sort by every property? If not, add indexed=False to the parameter list for each property where an index isn't required. That will affect new entries, but won't affect the existing data. To update the existing data (to reduce space), you would have to traverse over all the entities and simply get and put them. On Jan 13, 6:09 am, Петр Воронов chemo...@gmail.com wrote: Hi Google and all. It's my third post about difference datastore size in Datastore Statistics and Total Stored Data in Dashboard (so and in Quota or Billing). Now I have in Statistic: Size of all entities 29 MBytes In Total Stored Data 29% - 0.29 of 1.00 GBytes So I have overhead - 900%. I don't use any own created index. I have only two type of Kind class MarketStats(db.Model): typeID = db.IntegerProperty(required=True) regionID = db.IntegerProperty() solarSystemID = db.IntegerProperty(required=True) updated = db.DateTimeProperty() ordersSell = db.IntegerProperty(default=0) minSellPrice = db.IntegerProperty(default=0) maxSellPrice = db.IntegerProperty(default=0) averageSellPrice = db.IntegerProperty(default=0) medianSellPrice = db.IntegerProperty(default=0) volSellRemaining = db.IntegerProperty(default=0) volSellEntered = db.IntegerProperty(default=0) newestSellOrder = db.DateProperty(default=None) oldestSellOrder = db.DateProperty(default=None) ordersBuy = db.IntegerProperty(default=0) minBuyPrice = db.IntegerProperty(default=0) maxBuyPrice = db.IntegerProperty(default=0) averageBuyPrice = db.IntegerProperty(default=0) medianBuyPrice = db.IntegerProperty(default=0) volBuyRemaining = db.IntegerProperty(default=0) volBuyEntered = db.IntegerProperty(default=0) newestBuyOrder = db.DateProperty(default=None) oldestBuyOrder = db.DateProperty(default=None) class MarketHistory(MarketStats): date = db.DateProperty(required=True) All items of MarketStats work as Parents for some amount of MarketHistory items. All of this has keys name build by %06d%09d % (typeID,solarSystemID) for MarketStats date.isoformat()+%06d%09d % (typeID,solarSystemID) for MarketHistory Please help how I can decrease datastore usage in Dashboard? Which tips and tricks I can use? Or it's simple multiply data from Statistic by 10 ? Best regards, Chem. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: How I can predict or calculate overhead in Datastorage. For me now it looks like 900% or real stored data. Or its simple multiplayed by 10?
Every single one of those properties is indexed by default. Do you really need to be able to search or sort by every property? If not, add indexed=False to the parameter list for each property where an index isn't required. That will affect new entries, but won't affect the existing data. To update the existing data (to reduce space), you would have to traverse over all the entities and simply get and put them. On Jan 13, 6:09 am, Петр Воронов chemo...@gmail.com wrote: Hi Google and all. It's my third post about difference datastore size in Datastore Statistics and Total Stored Data in Dashboard (so and in Quota or Billing). Now I have in Statistic: Size of all entities 29 MBytes In Total Stored Data 29% - 0.29 of 1.00 GBytes So I have overhead - 900%. I don't use any own created index. I have only two type of Kind class MarketStats(db.Model): typeID = db.IntegerProperty(required=True) regionID = db.IntegerProperty() solarSystemID = db.IntegerProperty(required=True) updated = db.DateTimeProperty() ordersSell = db.IntegerProperty(default=0) minSellPrice = db.IntegerProperty(default=0) maxSellPrice = db.IntegerProperty(default=0) averageSellPrice = db.IntegerProperty(default=0) medianSellPrice = db.IntegerProperty(default=0) volSellRemaining = db.IntegerProperty(default=0) volSellEntered = db.IntegerProperty(default=0) newestSellOrder = db.DateProperty(default=None) oldestSellOrder = db.DateProperty(default=None) ordersBuy = db.IntegerProperty(default=0) minBuyPrice = db.IntegerProperty(default=0) maxBuyPrice = db.IntegerProperty(default=0) averageBuyPrice = db.IntegerProperty(default=0) medianBuyPrice = db.IntegerProperty(default=0) volBuyRemaining = db.IntegerProperty(default=0) volBuyEntered = db.IntegerProperty(default=0) newestBuyOrder = db.DateProperty(default=None) oldestBuyOrder = db.DateProperty(default=None) class MarketHistory(MarketStats): date = db.DateProperty(required=True) All items of MarketStats work as Parents for some amount of MarketHistory items. All of this has keys name build by %06d%09d % (typeID,solarSystemID) for MarketStats date.isoformat()+%06d%09d % (typeID,solarSystemID) for MarketHistory Please help how I can decrease datastore usage in Dashboard? Which tips and tricks I can use? Or it's simple multiply data from Statistic by 10 ? Best regards, Chem. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
