[google-appengine] Re: Complete list of limits and quotas?
Yes. 2009/4/11 T.J. Crowder > > Hi all, > > Thrilled about the AppEngine Java support and reading up on the > platform, etc. Very exciting stuff. > > Information about the various limits imposed by the system seems to be > a bit spread all over, is there anywhere one can go for a quick > rundown of *all* the various limits? > > Naturally there's the quotas page[1], but then there are further > significant limits for the datastore[2], and neither of those pages > mentions that there is apparently a limit on the number of datastore > indices[3] -- a very important piece of information. It also appears > that each static file in your app can be no more than 10MB[4]. > There's some disagreement amongst pages as well; the overview page[5] > says the free accounts get 500MB of storage, but the quotas page > (presumably the more canonical of the two) says 1GB. Apparently > requests must be satisfied within 30 seconds[4][5]. A user seemed to > say[6] in the group that there is a 1,000 file limit, but I haven't > found that one (yet!) from Google. And it's not clear to me whether > it's 1GB of storage, total, or 1GB of datastore storage *plus* the > storage of your application files. > > For clarity, this is not criticism disguised as a question. I'm > really asking the question. :-) Is this all pulled together somewhere > I've missed so far? Apologies if I've overlooked the obvious, which > wouldn't surprise me. > > [1] http://code.google.com/appengine/docs/quotas.html > [2] > http://code.google.com/appengine/docs/java/datastore/overview.html#Quotas_and_Limits > [3] > http://groups.google.com/group/google-appengine/browse_thread/thread/4f98d2c04fac0fb9 > [4] > http://googleappengine.blogspot.com/2009/02/skys-almost-limit-high-cpu-is-no-more.html > [5] http://code.google.com/appengine/docs/whatisgoogleappengine.html > [6] > http://groups.google.com/group/google-appengine/browse_thread/thread/2c8275f82a11ca12/e38a73671724c264?#e38a73671724c264 > > Thanks in advance, > -- > T.J. Crowder > tj / crowder software / com > Independent Software Engineer, consulting services available > > > > --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Complete list of limits and quotas?
Hi all, Only-slightly-abashedly bumping this, having foolishly posted it during the holiday weekend. Apparently (continuing the list) there's a "Workflow Backend Index Task Count"[1] as well. Anyone (at Google or otherwise) have a link to an official comprehensive list, and if so, would you post it? If not, perhaps we should try to bring together links for the disparate parts. [1] http://groups.google.com/group/google-appengine/browse_thread/thread/733e8830bdb4b843 Thanks in advance, -- T.J. Crowder tj / crowder software / com Independent Software Engineer, consulting services available On Apr 11, 9:55 am, "T.J. Crowder" wrote: > Hi all, > > Thrilled about the AppEngine Java support and reading up on the > platform, etc. Very exciting stuff. > > Information about the various limits imposed by the system seems to be > a bit spread all over, is there anywhere one can go for a quick > rundown of *all* the various limits? > > Naturally there's the quotas page[1], but then there are further > significant limits for the datastore[2], and neither of those pages > mentions that there is apparently a limit on the number of datastore > indices[3] -- a very important piece of information. It also appears > that each static file in your app can be no more than 10MB[4]. > There's some disagreement amongst pages as well; the overview page[5] > says the free accounts get 500MB of storage, but the quotas page > (presumably the more canonical of the two) says 1GB. Apparently > requests must be satisfied within 30 seconds[4][5]. A user seemed to > say[6] in the group that there is a 1,000 file limit, but I haven't > found that one (yet!) from Google. And it's not clear to me whether > it's 1GB of storage, total, or 1GB of datastore storage *plus* the > storage of your application files. > > For clarity, this is not criticism disguised as a question. I'm > really asking the question. :-) Is this all pulled together somewhere > I've missed so far? Apologies if I've overlooked the obvious, which > wouldn't surprise me. > > [1]http://code.google.com/appengine/docs/quotas.html > [2]http://code.google.com/appengine/docs/java/datastore/overview.html#Qu... > [3]http://groups.google.com/group/google-appengine/browse_thread/thread/... > [4]http://googleappengine.blogspot.com/2009/02/skys-almost-limit-high-cp... > [5]http://code.google.com/appengine/docs/whatisgoogleappengine.html > [6]http://groups.google.com/group/google-appengine/browse_thread/thread/... > > Thanks in advance, > -- > T.J. Crowder > tj / crowder software / com > Independent Software Engineer, consulting services available --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Complete list of limits and quotas?
Hi T.J., I'm glad you've raised this issue. The documentation on quotas has most of this information: http://code.google.com/appengine/docs/quotas.html For additional limitations, most overview sections on the APIs and services have specific details for that service. For example, see: http://code.google.com/appengine/docs/java/datastore/overview.html#Quotas_and_Limits http://code.google.com/appengine/docs/python/images/overview.html#Quotas_and_Limits http://code.google.com/appengine/docs/java/mail/overview.html#Quotas_and_Limits The limit on 100 custom composite indicies per app is not currently documented to my knowledge, part of the reason is that I think it would be best to design your app without that constraint in mind. So far, very few apps have hit this limit and if you need more than 100 indicies, I'd be happy to talk it over and see what we can work out. Recent reports of hitting this limit have been the result of an issue which caused the number of indicies to be overreported for a small subset of apps. Thank you, Jeff On Tue, Apr 14, 2009 at 1:51 PM, T.J. Crowder wrote: > > Hi all, > > Only-slightly-abashedly bumping this, having foolishly posted it > during the holiday weekend. Apparently (continuing the list) there's > a "Workflow Backend Index Task Count"[1] as well. > > Anyone (at Google or otherwise) have a link to an official > comprehensive list, and if so, would you post it? If not, perhaps we > should try to bring together links for the disparate parts. > > [1] > http://groups.google.com/group/google-appengine/browse_thread/thread/733e8830bdb4b843 > > Thanks in advance, > -- > T.J. Crowder > tj / crowder software / com > Independent Software Engineer, consulting services available > > On Apr 11, 9:55 am, "T.J. Crowder" wrote: > > Hi all, > > > > Thrilled about the AppEngine Java support and reading up on the > > platform, etc. Very exciting stuff. > > > > Information about the various limits imposed by the system seems to be > > a bit spread all over, is there anywhere one can go for a quick > > rundown of *all* the various limits? > > > > Naturally there's the quotas page[1], but then there are further > > significant limits for the datastore[2], and neither of those pages > > mentions that there is apparently a limit on the number of datastore > > indices[3] -- a very important piece of information. It also appears > > that each static file in your app can be no more than 10MB[4]. > > There's some disagreement amongst pages as well; the overview page[5] > > says the free accounts get 500MB of storage, but the quotas page > > (presumably the more canonical of the two) says 1GB. Apparently > > requests must be satisfied within 30 seconds[4][5]. A user seemed to > > say[6] in the group that there is a 1,000 file limit, but I haven't > > found that one (yet!) from Google. And it's not clear to me whether > > it's 1GB of storage, total, or 1GB of datastore storage *plus* the > > storage of your application files. > > > > For clarity, this is not criticism disguised as a question. I'm > > really asking the question. :-) Is this all pulled together somewhere > > I've missed so far? Apologies if I've overlooked the obvious, which > > wouldn't surprise me. > > > > [1]http://code.google.com/appengine/docs/quotas.html > > [2] > http://code.google.com/appengine/docs/java/datastore/overview.html#Qu... > > [3] > http://groups.google.com/group/google-appengine/browse_thread/thread/... > > [4] > http://googleappengine.blogspot.com/2009/02/skys-almost-limit-high-cp... > > [5]http://code.google.com/appengine/docs/whatisgoogleappengine.html > > [6] > http://groups.google.com/group/google-appengine/browse_thread/thread/... > > > > Thanks in advance, > > -- > > T.J. Crowder > > tj / crowder software / com > > Independent Software Engineer, consulting services available > > > --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Complete list of limits and quotas?
Hi Jeff, Thanks for that. And thanks for all the help you provide to folks in this group, I see you answering questions all over. > The limit on 100 custom composite indicies per app is not currently > documented to my knowledge, part of the reason is that I think it would be > best to design your app without that constraint in mind. IMHO, it's really, really important to document *all* of the limits and quotas, and in one canonical place -- an index, if you will, of quotas and limitations, with links to detail in the various pages you and I have linked earlier. In relatively little reading in this group, I've run into the list I provided earlier and apparently there's something called the "App Config Service Config App Call Count" quota[1]; what else is there, lurking, waiting to trip up the unwary developer? [1] http://groups.google.com/group/google-appengine/browse_thread/thread/891ce78da54b3659 It's hard for me to envision seriously considering using AppEngine for anything but a toy project when significant limitations (100 indexes is significant) are not clearly documented. If you can work with people on some of them, indicate that on the list; it's not a reason not to document the limitation. I see in other threads, and greatly appreciate, that Google is happy to work with people when they run into quotas and have a good reason for needing more than the quota currently allows, but that's not at all the same thing. There is, clearly, a full list somewhere -- the admin console isn't just making these quotas up. :-) Can I strongly suggest providing this index of quotas, if only to demonstrate to people that concerns like mine are unwarranted? Thanks again, -- T.J. Crowder tj / crowder software / com Independent Software Engineer, consulting services available On Apr 15, 7:22 pm, "Jeff S (Google)" wrote: > Hi T.J., > > I'm glad you've raised this issue. The documentation on quotas has most of > this information: > > http://code.google.com/appengine/docs/quotas.html > > For additional limitations, most overview sections on the APIs and services > have specific details for that service. For example, see: > > http://code.google.com/appengine/docs/java/datastore/overview.html#Qu...http://code.google.com/appengine/docs/python/images/overview.html#Quo...http://code.google.com/appengine/docs/java/mail/overview.html#Quotas_... > > The limit on 100 custom composite indicies per app is not currently > documented to my knowledge, part of the reason is that I think it would be > best to design your app without that constraint in mind. So far, very few > apps have hit this limit and if you need more than 100 indicies, I'd be > happy to talk it over and see what we can work out. Recent reports of > hitting this limit have been the result of an issue which caused the number > of indicies to be overreported for a small subset of apps. > > Thank you, > > Jeff > > On Tue, Apr 14, 2009 at 1:51 PM, T.J. Crowder wrote: > > > > > Hi all, > > > Only-slightly-abashedly bumping this, having foolishly posted it > > during the holiday weekend. Apparently (continuing the list) there's > > a "Workflow Backend Index Task Count"[1] as well. > > > Anyone (at Google or otherwise) have a link to an official > > comprehensive list, and if so, would you post it? If not, perhaps we > > should try to bring together links for the disparate parts. > > > [1] > >http://groups.google.com/group/google-appengine/browse_thread/thread/... > > > Thanks in advance, > > -- > > T.J. Crowder > > tj / crowder software / com > > Independent Software Engineer, consulting services available > > > On Apr 11, 9:55 am, "T.J. Crowder" wrote: > > > Hi all, > > > > Thrilled about the AppEngine Java support and reading up on the > > > platform, etc. Very exciting stuff. > > > > Information about the various limits imposed by the system seems to be > > > a bit spread all over, is there anywhere one can go for a quick > > > rundown of *all* the various limits? > > > > Naturally there's the quotas page[1], but then there are further > > > significant limits for the datastore[2], and neither of those pages > > > mentions that there is apparently a limit on the number of datastore > > > indices[3] -- a very important piece of information. It also appears > > > that each static file in your app can be no more than 10MB[4]. > > > There's some disagreement amongst pages as well; the overview page[5] > > > says the free accounts get 500MB of storage, but the quotas page > > > (presumably the more canonical of the two) says 1GB. Apparently > > > requests must be satisfied within 30 seconds[4][5]. A user seemed to > > > say[6] in the group that there is a 1,000 file limit, but I haven't > > > found that one (yet!) from Google. And it's not clear to me whether > > > it's 1GB of storage, total, or 1GB of datastore storage *plus* the > > > storage of your application files. > > > > For clarity, this is not criticism disguised as a question. I'm > > > rea
[google-appengine] Re: Complete list of limits and quotas?
Hi all, FYI, I've opened Issue 1474 for this: http://code.google.com/p/googleappengine/issues/detail?id=1474 -- T.J. Crowder tj / crowder software / com Independent Software Engineer, consulting services available On Apr 24, 10:48 am, "T.J. Crowder" wrote: > Hi Jeff, > > Thanks for that. And thanks for all the help you provide to folks in > this group, I see you answering questions all over. > > > The limit on 100 custom composite indicies per app is not currently > > documented to my knowledge, part of the reason is that I think it would be > > best to design your app without that constraint in mind. > > IMHO, it's really, really important to document *all* of the limits > and quotas, and in one canonical place -- an index, if you will, of > quotas and limitations, with links to detail in the various pages you > and I have linked earlier. In relatively little reading in this > group, I've run into the list I provided earlier and apparently > there's something called the "App Config Service Config App Call > Count" quota[1]; what else is there, lurking, waiting to trip up the > unwary developer? > > [1]http://groups.google.com/group/google-appengine/browse_thread/thread/... > > It's hard for me to envision seriously considering using AppEngine for > anything but a toy project when significant limitations (100 indexes > is significant) are not clearly documented. If you can work with > people on some of them, indicate that on the list; it's not a reason > not to document the limitation. I see in other threads, and greatly > appreciate, that Google is happy to work with people when they run > into quotas and have a good reason for needing more than the quota > currently allows, but that's not at all the same thing. > > There is, clearly, a full list somewhere -- the admin console isn't > just making these quotas up. :-) Can I strongly suggest providing > this index of quotas, if only to demonstrate to people that concerns > like mine are unwarranted? > > Thanks again, > -- > T.J. Crowder > tj / crowder software / com > Independent Software Engineer, consulting services available > > On Apr 15, 7:22 pm, "Jeff S (Google)" wrote: > > > Hi T.J., > > > I'm glad you've raised this issue. The documentation on quotas has most of > > this information: > > >http://code.google.com/appengine/docs/quotas.html > > > For additional limitations, most overview sections on the APIs and services > > have specific details for that service. For example, see: > > >http://code.google.com/appengine/docs/java/datastore/overview.html#Qu.. > > > The limit on 100 custom composite indicies per app is not currently > > documented to my knowledge, part of the reason is that I think it would be > > best to design your app without that constraint in mind. So far, very few > > apps have hit this limit and if you need more than 100 indicies, I'd be > > happy to talk it over and see what we can work out. Recent reports of > > hitting this limit have been the result of an issue which caused the number > > of indicies to be overreported for a small subset of apps. > > > Thank you, > > > Jeff > > > On Tue, Apr 14, 2009 at 1:51 PM, T.J. Crowder > > wrote: > > > > Hi all, > > > > Only-slightly-abashedly bumping this, having foolishly posted it > > > during the holiday weekend. Apparently (continuing the list) there's > > > a "Workflow Backend Index Task Count"[1] as well. > > > > Anyone (at Google or otherwise) have a link to an official > > > comprehensive list, and if so, would you post it? If not, perhaps we > > > should try to bring together links for the disparate parts. > > > > [1] > > >http://groups.google.com/group/google-appengine/browse_thread/thread/... > > > > Thanks in advance, > > > -- > > > T.J. Crowder > > > tj / crowder software / com > > > Independent Software Engineer, consulting services available > > > > On Apr 11, 9:55 am, "T.J. Crowder" wrote: > > > > Hi all, > > > > > Thrilled about the AppEngine Java support and reading up on the > > > > platform, etc. Very exciting stuff. > > > > > Information about the various limits imposed by the system seems to be > > > > a bit spread all over, is there anywhere one can go for a quick > > > > rundown of *all* the various limits? > > > > > Naturally there's the quotas page[1], but then there are further > > > > significant limits for the datastore[2], and neither of those pages > > > > mentions that there is apparently a limit on the number of datastore > > > > indices[3] -- a very important piece of information. It also appears > > > > that each static file in your app can be no more than 10MB[4]. > > > > There's some disagreement amongst pages as well; the overview page[5] > > > > says the free accounts get 500MB of storage, but the quotas page > > > > (presumably the more canonical of the two) says 1GB. Apparently > > > > requests must be satisfied within 30 seconds[4][5]. A user seemed to > > > > say[6] in the group that there is a 1,000 file limit, but I have
