[google-appengine] Re: AppEngie OUTAGE
Thanks, thats useful. Yes I see a few of these A problem was encountered with the process that handled this request, causing it to exit. This is likely to cause a new process to be used for the next request to your application. (Error code 121) during warmup calls but just can't get enough started. Just had 15mins without an error and now they are back again. Sigh. On Tuesday, October 8, 2019 at 10:17:42 AM UTC+1, Paolo Conte wrote: > > My settings are below. By looking at the logs of /_ah/warmup to me it > seems that some instances start and some don't, so you need some luck to > get a good amount of working instances > > > F1 > > > > 35 > 35 > > 3 > 5 > 500ms > 5 > 0.9 > 0.8 > > > > On Tuesday, October 8, 2019 at 11:05:13 AM UTC+2, mark negus wrote: >> >> This app version won't even start at all. What else did you do? >> java8, F4 >> >> automatic_scaling: >> min_idle_instances: 3 >> max_idle_instances: automatic >> min_pending_latency: automatic >> max_pending_latency: automatic >> max_instances: 4 >> >> On Tuesday, October 8, 2019 at 9:30:26 AM UTC+1, Paolo Conte wrote: >>> >>> Manual scaling seems to also have trouble starting instances. For now I >>> kept autoscaling with a high minimum instances number and the error rate is >>> almost zero at the moment >>> >>> On Tuesday, October 8, 2019 at 10:16:57 AM UTC+2, mark negus wrote: >>>> >>>> Hi Paolo, >>>> Let me know how you get on. We were manual scaling for ages as we had >>>> terrible issues with auto-scaling a while back. Once it randomly launched >>>> 40 instances and burnt through our daily budget in a few hours. Its been >>>> ok >>>> though this last year. >>>> >>>> On Tuesday, October 8, 2019 at 9:10:06 AM UTC+1, Paolo Conte wrote: >>>>> >>>>> Thanks Mark. I'm trying to use manual scaling to see if it improves >>>>> >>>>> On Tuesday, October 8, 2019 at 10:02:41 AM UTC+2, mark negus wrote: >>>>>> >>>>>> https://status.cloud.google.com/?_ga=2.187839338.-379351283.1560761695 >>>>>> >>>>>> On Tuesday, October 8, 2019 at 8:57:06 AM UTC+1, mark negus wrote: >>>>>>> >>>>>>> Yes, we are having problems for the last hour in europe-west. Mainly >>>>>>> 500s. Looks like the auto-scaling is having issues. >>>>>>> >>>>>>> On Tuesday, October 8, 2019 at 8:48:59 AM UTC+1, Paolo Conte wrote: >>>>>>>> >>>>>>>> Hello, >>>>>>>> suddently most requests return error 500, log shows "The request >>>>>>>> failed because the instance could not start successfully" >>>>>>>> Project is in europe-west >>>>>>>> >>>>>>>> Anyone else? >>>>>>>> >>>>>>> -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/498d0a17-d57c-4039-8878-06db8d5a3d8f%40googlegroups.com.
[google-appengine] Re: AppEngie OUTAGE
This app version won't even start at all. What else did you do? java8, F4 automatic_scaling: min_idle_instances: 3 max_idle_instances: automatic min_pending_latency: automatic max_pending_latency: automatic max_instances: 4 On Tuesday, October 8, 2019 at 9:30:26 AM UTC+1, Paolo Conte wrote: > > Manual scaling seems to also have trouble starting instances. For now I > kept autoscaling with a high minimum instances number and the error rate is > almost zero at the moment > > On Tuesday, October 8, 2019 at 10:16:57 AM UTC+2, mark negus wrote: >> >> Hi Paolo, >> Let me know how you get on. We were manual scaling for ages as we had >> terrible issues with auto-scaling a while back. Once it randomly launched >> 40 instances and burnt through our daily budget in a few hours. Its been ok >> though this last year. >> >> On Tuesday, October 8, 2019 at 9:10:06 AM UTC+1, Paolo Conte wrote: >>> >>> Thanks Mark. I'm trying to use manual scaling to see if it improves >>> >>> On Tuesday, October 8, 2019 at 10:02:41 AM UTC+2, mark negus wrote: >>>> >>>> https://status.cloud.google.com/?_ga=2.187839338.-379351283.1560761695 >>>> >>>> On Tuesday, October 8, 2019 at 8:57:06 AM UTC+1, mark negus wrote: >>>>> >>>>> Yes, we are having problems for the last hour in europe-west. Mainly >>>>> 500s. Looks like the auto-scaling is having issues. >>>>> >>>>> On Tuesday, October 8, 2019 at 8:48:59 AM UTC+1, Paolo Conte wrote: >>>>>> >>>>>> Hello, >>>>>> suddently most requests return error 500, log shows "The request >>>>>> failed because the instance could not start successfully" >>>>>> Project is in europe-west >>>>>> >>>>>> Anyone else? >>>>>> >>>>> -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/5cb15032-82b0-4037-9e9a-1e4388920185%40googlegroups.com.
[google-appengine] Re: AppEngie OUTAGE
Hi Paolo, Let me know how you get on. We were manual scaling for ages as we had terrible issues with auto-scaling a while back. Once it randomly launched 40 instances and burnt through our daily budget in a few hours. Its been ok though this last year. On Tuesday, October 8, 2019 at 9:10:06 AM UTC+1, Paolo Conte wrote: > > Thanks Mark. I'm trying to use manual scaling to see if it improves > > On Tuesday, October 8, 2019 at 10:02:41 AM UTC+2, mark negus wrote: >> >> https://status.cloud.google.com/?_ga=2.187839338.-379351283.1560761695 >> >> On Tuesday, October 8, 2019 at 8:57:06 AM UTC+1, mark negus wrote: >>> >>> Yes, we are having problems for the last hour in europe-west. Mainly >>> 500s. Looks like the auto-scaling is having issues. >>> >>> On Tuesday, October 8, 2019 at 8:48:59 AM UTC+1, Paolo Conte wrote: >>>> >>>> Hello, >>>> suddently most requests return error 500, log shows "The request failed >>>> because the instance could not start successfully" >>>> Project is in europe-west >>>> >>>> Anyone else? >>>> >>> -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/c92f0dc6-9bed-43bb-9a83-4312bc281819%40googlegroups.com.
[google-appengine] Re: AppEngie OUTAGE
https://status.cloud.google.com/?_ga=2.187839338.-379351283.1560761695 On Tuesday, October 8, 2019 at 8:57:06 AM UTC+1, mark negus wrote: > > Yes, we are having problems for the last hour in europe-west. Mainly 500s. > Looks like the auto-scaling is having issues. > > On Tuesday, October 8, 2019 at 8:48:59 AM UTC+1, Paolo Conte wrote: >> >> Hello, >> suddently most requests return error 500, log shows "The request failed >> because the instance could not start successfully" >> Project is in europe-west >> >> Anyone else? >> > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/e5a2e743-10da-4910-bfd3-dd39a7d03fdf%40googlegroups.com.
[google-appengine] Re: AppEngie OUTAGE
Yes, we are having problems for the last hour in europe-west. Mainly 500s. Looks like the auto-scaling is having issues. On Tuesday, October 8, 2019 at 8:48:59 AM UTC+1, Paolo Conte wrote: > > Hello, > suddently most requests return error 500, log shows "The request failed > because the instance could not start successfully" > Project is in europe-west > > Anyone else? > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/a64df96f-f5cb-4c82-b925-878cf26019c9%40googlegroups.com.
[google-appengine] GAE in the EU appears to be down
Hi there, Our EU customers are locked out - we appear to be getting datanucleus exceptions suddenly org.datanucleus.sco.backed.Set cannot be cast to java.util.List Everything was fine up until 4.11pm UK time. Customers in the US datacentres are unaffected. What is going on? Anyone else seeing this? Cheers, Mark BikeRentalManager.com -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/794d75f4-b7e5-42d6-a97a-15022de69d8c%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
