[google-appengine] Re: URLFetch Quota Is Stupid
Hi Brandon, I agree it may make sense to special case intra-App URLFetches. Please file a bug on the issue tracker. thanks, Peter On Friday, August 31, 2012 4:29:35 AM UTC+10, Brandon Wirtz wrote: > > Ok, so I get that you don’t want me to build a DDoS platform with GAE. > > > > But why the frak is there a limit on how many times a Backend can hit its > own front end? (and Vice Versa) > > > > Yes I hit these limits. Yes it makes me sad. Yes it limits my App. > > > > We also tried and failed to make ProtoRPC replace URLFetch thinking this > might mitigate the issue. That Failed. > > We considered Google EndPoints. Doesn’t solve the issues that URLFetch is > a limitation in the App. > > We considered Channels, thinking we could move data via Messages, that > doesn’t work servers can’t talk to each other. > > > > This may be a deal breaker for us. > > > > > > > > > > > > > > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/EsrWRzLOWDQJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
RE: [google-appengine] Re: URLFetch Quota Is Stupid
Will do. Can you take the quota off of me in the mean time J From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Peter McKenzie Sent: Thursday, August 30, 2012 4:50 PM To: google-appengine@googlegroups.com Subject: [google-appengine] Re: URLFetch Quota Is Stupid Hi Brandon, I agree it may make sense to special case intra-App URLFetches. Please file a bug on the issue tracker. thanks, Peter On Friday, August 31, 2012 4:29:35 AM UTC+10, Brandon Wirtz wrote: Ok, so I get that you don't want me to build a DDoS platform with GAE. But why the frak is there a limit on how many times a Backend can hit its own front end? (and Vice Versa) Yes I hit these limits. Yes it makes me sad. Yes it limits my App. We also tried and failed to make ProtoRPC replace URLFetch thinking this might mitigate the issue. That Failed. We considered Google EndPoints. Doesn't solve the issues that URLFetch is a limitation in the App. We considered Channels, thinking we could move data via Messages, that doesn't work servers can't talk to each other. This may be a deal breaker for us. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/EsrWRzLOWDQJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: URLFetch Quota Is Stupid
Hi Brandon, Can we discuss this off-list? Please tell me your desired QPS, a purpose of your application, and your usage pattern of the service, etc. -- Takashi -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
RE: [google-appengine] Re: URLFetch Quota Is Stupid
Sure. But I have filed a billing support request via the Quota increase form every other day for 10 days, and gotten no response. I really like the platform, but it often feels the only way to get support is to call people stupid in the public forum and hope that someone is looking who cares. Off list message to follow. From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Takashi Matsuo Sent: Thursday, August 30, 2012 9:58 PM To: google-appengine@googlegroups.com Subject: Re: [google-appengine] Re: URLFetch Quota Is Stupid Hi Brandon, Can we discuss this off-list? Please tell me your desired QPS, a purpose of your application, and your usage pattern of the service, etc. -- Takashi -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: URLFetch Quota Is Stupid
On Fri, Aug 31, 2012 at 4:13 PM, Drake wrote: > Sure. But I have filed a billing support request via the Quota increase > form every other day for 10 days, and gotten no response. > Sorry it didn't work for you. I'm going to improve this process. > > > ** ** > > I really like the platform, but it often feels the only way to get support > is to call people stupid in the public forum and hope that someone is > looking who cares. > Well, so, I'd appreciate it if you could stop calling someone stupid. We'll respond to you not because you say stupid, but just because you're in trouble :) -- Takashi > > > ** ** > > Off list message to follow. > > ** ** > > ** ** > > *From:* google-appengine@googlegroups.com [mailto: > google-appengine@googlegroups.com] *On Behalf Of *Takashi Matsuo > *Sent:* Thursday, August 30, 2012 9:58 PM > *To:* google-appengine@googlegroups.com > *Subject:* Re: [google-appengine] Re: URLFetch Quota Is Stupid > > ** ** > > ** ** > > Hi Brandon, > > ** ** > > Can we discuss this off-list? Please tell me your desired QPS, a purpose > of your application, and your usage pattern of the service, etc. > > ** ** > > -- Takashi > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- Takashi Matsuo | Developers Advocate | tmat...@google.com -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
RE: [google-appengine] Re: URLFetch Quota Is Stupid
> Well, so, I'd appreciate it if you could stop calling someone stupid. We'll respond to you not because you say stupid, but just because you're in trouble :) But it doesn't work. Check this list for when I posted about this the first time, on 8/24 which was after I had made the Request via the form, because I don't like giving out the AppID in public. I love AppEngine, but the support stinks. I even tried to pay for better support. That combined with constantly running in to things where Quotas bite me unexpectedly, Or change from what they were the week before. Nothing sucks worse than waking up and finding your app is broken because something that you can't see in the dashboard, and can't find a documented number for. From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Takashi Matsuo Sent: Friday, August 31, 2012 12:33 AM To: google-appengine@googlegroups.com Subject: Re: [google-appengine] Re: URLFetch Quota Is Stupid On Fri, Aug 31, 2012 at 4:13 PM, Drake wrote: Sure. But I have filed a billing support request via the Quota increase form every other day for 10 days, and gotten no response. Sorry it didn't work for you. I'm going to improve this process. I really like the platform, but it often feels the only way to get support is to call people stupid in the public forum and hope that someone is looking who cares. Well, so, I'd appreciate it if you could stop calling someone stupid. We'll respond to you not because you say stupid, but just because you're in trouble :) -- Takashi Off list message to follow. From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Takashi Matsuo Sent: Thursday, August 30, 2012 9:58 PM To: google-appengine@googlegroups.com Subject: Re: [google-appengine] Re: URLFetch Quota Is Stupid Hi Brandon, Can we discuss this off-list? Please tell me your desired QPS, a purpose of your application, and your usage pattern of the service, etc. -- Takashi -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com <mailto:google-appengine%2bunsubscr...@googlegroups.com> . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Takashi Matsuo | Developers Advocate | tmat...@google.com -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: URLFetch Quota Is Stupid
I think that a couple of the newer Google people on this list have helped greatly, though. Takashi does make an effort to respond and to send issues to the dev team, whereas at one point it was almost like they were intentionally ignoring us. So yeah, support does leave me feeling a little wary and there's a lot of "hope" when running on GAE, but I think it's definitely improved. I wish I could pay e.g. $100 for a support query, though. $6000 per year insurance just seems a bit high, unless you're already pretty profitable. On Friday, August 31, 2012 10:04:00 AM UTC+2, Brandon Wirtz wrote: > > > Well, so, I'd appreciate it if you could stop calling someone stupid. > We'll respond to you not because you say stupid, but just because you're in > trouble :) > > > > But it doesn’t work. > > > > Check this list for when I posted about this the first time, on 8/24 which > was after I had made the Request via the form, because I don’t like giving > out the AppID in public. > > > > I love AppEngine, but the support stinks. I even tried to pay for better > support. > > > > That combined with constantly running in to things where Quotas bite me > unexpectedly, Or change from what they were the week before. Nothing sucks > worse than waking up and finding your app is broken because something that > you can’t see in the dashboard, and can’t find a documented number for. > > > > > > > *From:* google-a...@googlegroups.com [mailto: > google-a...@googlegroups.com ] *On Behalf Of *Takashi Matsuo > *Sent:* Friday, August 31, 2012 12:33 AM > *To:* google-a...@googlegroups.com > *Subject:* Re: [google-appengine] Re: URLFetch Quota Is Stupid > > > > On Fri, Aug 31, 2012 at 4:13 PM, Drake > > wrote: > > Sure. But I have filed a billing support request via the Quota increase > form every other day for 10 days, and gotten no response. > > > > Sorry it didn't work for you. I'm going to improve this process. > > > > > > I really like the platform, but it often feels the only way to get support > is to call people stupid in the public forum and hope that someone is > looking who cares. > > > > Well, so, I'd appreciate it if you could stop calling someone stupid. > We'll respond to you not because you say stupid, but just because you're in > trouble :) > > > > -- Takashi > > > > > > Off list message to follow. > > > > > > *From:* google-a...@googlegroups.com [mailto: > google-a...@googlegroups.com ] *On Behalf Of *Takashi Matsuo > *Sent:* Thursday, August 30, 2012 9:58 PM > *To:* google-a...@googlegroups.com > *Subject:* Re: [google-appengine] Re: URLFetch Quota Is Stupid > > > > > > Hi Brandon, > > > > Can we discuss this off-list? Please tell me your desired QPS, a purpose > of your application, and your usage pattern of the service, etc. > > > > -- Takashi > > -- > > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-a...@googlegroups.com > . > To unsubscribe from this group, send email to > google-appengi...@googlegroups.com . > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-a...@googlegroups.com > . > To unsubscribe from this group, send email to > google-appengi...@googlegroups.com . > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > > > > > -- > Takashi Matsuo | Developers Advocate | tma...@google.com > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-a...@googlegroups.com > . > To unsubscribe from this group, send email to > google-appengi...@googlegroups.com . > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/F57OJN_JtA8J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
RE: [google-appengine] Re: URLFetch Quota Is Stupid
> I wish I could pay e.g. $100 for a support query, though. $6000 per year insurance just seems a bit high, unless you're already pretty profitable. $6k is worth it if you got Architecture support. But it is really more billing support. The biggest reason to pay the $500 is to be able to unify your billing and get invoiced monthly. I have $2M burning a hole in my pocket. I don't worry about the $6k, I worry about having the app over quota error message show up where my site once was. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: URLFetch Quota Is Stupid
[It seems this thread has gone sideways - again.] I would really, really love to see no urlfetch quota limitations between apps. Perhaps though you would need to enable this to prevent App Engine apps from maliciously hammering each other? If so, this technique seems fine to me: remoteapi_CUSTOM_ENVIRONMENT_AUTHENTICATION = ('HTTP_X_APPENGINE_INBOUND_APPID', ['source appid here']) It doesn't look like anyone has create a feature request for this, so I created one. Please star it. http://code.google.com/p/googleappengine/issues/detail?id=8051 j On Friday, 31 August 2012 02:25:26 UTC-6, Brandon Wirtz wrote: > > > I wish I could pay e.g. $100 for a support query, though. $6000 per > year insurance just seems a bit high, unless you're already pretty > profitable. > > $6k is worth it if you got Architecture support. But it is really more > billing support. > > > > The biggest reason to pay the $500 is to be able to unify your billing and > get invoiced monthly. > > > > I have $2M burning a hole in my pocket. I don’t worry about the $6k, I > worry about having the app over quota error message show up where my site > once was. > > > > > > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/O8ZtfkdA7ksJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
RE: [google-appengine] Re: URLFetch Quota Is Stupid
Thanks for creating the feature request. We had a meet up yesterday, and So I haven't had time to do so. I might even be ok with Between App limits, but Between Front End and Backend is really stupid. I can't imagine a scenario where limiting the calls Intra-app makes sense. From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Jason Collins Sent: Friday, August 31, 2012 9:41 AM To: google-appengine@googlegroups.com Subject: Re: [google-appengine] Re: URLFetch Quota Is Stupid [It seems this thread has gone sideways - again.] I would really, really love to see no urlfetch quota limitations between apps. Perhaps though you would need to enable this to prevent App Engine apps from maliciously hammering each other? If so, this technique seems fine to me: remoteapi_CUSTOM_ENVIRONMENT_AUTHENTICATION = ('HTTP_X_APPENGINE_INBOUND_APPID', ['source appid here']) It doesn't look like anyone has create a feature request for this, so I created one. Please star it. http://code.google.com/p/googleappengine/issues/detail?id=8051 j On Friday, 31 August 2012 02:25:26 UTC-6, Brandon Wirtz wrote: > I wish I could pay e.g. $100 for a support query, though. $6000 per year insurance just seems a bit high, unless you're already pretty profitable. $6k is worth it if you got Architecture support. But it is really more billing support. The biggest reason to pay the $500 is to be able to unify your billing and get invoiced monthly. I have $2M burning a hole in my pocket. I don't worry about the $6k, I worry about having the app over quota error message show up where my site once was. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/O8ZtfkdA7ksJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
RE: [google-appengine] Re: URLFetch Quota Is Stupid
http://code.google.com/p/googleappengine/issues/detail?id=8052 Is specific to Intra-App Limitations From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Drake Sent: Friday, August 31, 2012 9:45 AM To: google-appengine@googlegroups.com Subject: RE: [google-appengine] Re: URLFetch Quota Is Stupid Thanks for creating the feature request. We had a meet up yesterday, and So I haven't had time to do so. I might even be ok with Between App limits, but Between Front End and Backend is really stupid. I can't imagine a scenario where limiting the calls Intra-app makes sense. From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Jason Collins Sent: Friday, August 31, 2012 9:41 AM To: google-appengine@googlegroups.com Subject: Re: [google-appengine] Re: URLFetch Quota Is Stupid [It seems this thread has gone sideways - again.] I would really, really love to see no urlfetch quota limitations between apps. Perhaps though you would need to enable this to prevent App Engine apps from maliciously hammering each other? If so, this technique seems fine to me: remoteapi_CUSTOM_ENVIRONMENT_AUTHENTICATION = ('HTTP_X_APPENGINE_INBOUND_APPID', ['source appid here']) It doesn't look like anyone has create a feature request for this, so I created one. Please star it. http://code.google.com/p/googleappengine/issues/detail?id=8051 j On Friday, 31 August 2012 02:25:26 UTC-6, Brandon Wirtz wrote: > I wish I could pay e.g. $100 for a support query, though. $6000 per year insurance just seems a bit high, unless you're already pretty profitable. $6k is worth it if you got Architecture support. But it is really more billing support. The biggest reason to pay the $500 is to be able to unify your billing and get invoiced monthly. I have $2M burning a hole in my pocket. I don't worry about the $6k, I worry about having the app over quota error message show up where my site once was. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/O8ZtfkdA7ksJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.