Hey bFlood, The link to the Cloud Status Dashboard posted earlier indicates:
The issue with App Engine applications accessing Google APIs should have > been resolved for all affected customers as of 13:15 US/Pacific. We will > conduct an internal investigation of this issue and make appropriate > improvements to our systems to prevent or minimize future recurrence. *We > will provide a more detailed analysis of this incident once we have > completed our internal investigation.* (emphasis added) So, it seems that the analysis will be forthcoming, once the internal investigation on the issue has completed. On Thursday, December 10, 2015 at 12:39:33 PM UTC-5, bFlood wrote: > > well its sorted out now but it was down for 8+ hours, that's pretty bad. > is there a post mortem on the issue yet? > > On Thursday, December 10, 2015 at 12:34:50 PM UTC-5, Nick (Cloud Platform > Support) wrote: >> >> @Miguel, good to hear things are sorted out. >> >> If any further issues are noticed by anybody, feel free to post them to >> the relevant Public Issue Tracker forum, such as google-appengine [1], >> googlecloudsql [2], google-cloud-sdk [3], or google-cloud-platform [4], >> depending what's affected, with the last one being a safe catch-all. >> >> [1] https://code.google.com/p/google-appengine/issues/list >> [2] https://code.google.com/p/googlecloudsql/issues/list >> [3] https://code.google.com/p/google-cloud-sdk/issues/list >> [4] https://code.google.com/p/google-cloud-platform/issues/list >> >> On Wednesday, December 9, 2015 at 5:58:11 PM UTC-5, Miguel Vitorino wrote: >>> >>> Hi Nick, >>> >>> Yes, that's right, the issues were manifested as 401s across all APIs >>> and were solved once incident #15025 was fixed. >>> >>> Miguel >>> >>> Miguel Vitorino >>> >>> Director >>> Skype: miguel.vitorino >>> Support UK: +44 (20) 33 896 112 >>> Support US: +1 (646) 350-0511 >>> >>> >>> >>> On 9 December 2015 at 20:46, Nick (Cloud Platform Support) < >>> pay...@google.com> wrote: >>> >>>> Were these errors manifesting as 401 responses? There's very little >>>> description in this thread of what issues are actually being seen. Is >>>> this <https://status.cloud.google.com/incident/appengine/15025> >>>> possibly the issue you were affected by (linked to the Cloud Status >>>> Dashboard)? The appengine-downtime-notify mailing list also saw a >>>> posting <https://status.cloud.google.com/incident/appengine/15025> >>>> about this. >>>> >>>> >>>> On Tuesday, December 8, 2015 at 4:02:57 PM UTC-5, Stefano Ciccarelli >>>> wrote: >>>>> >>>>> Same here, our app is partially unusable (because it cannot reach GCS) >>>>> but we have not been contacted. >>>>> >>>>> Il giorno mar 8 dic 2015 alle 20:58 bFlood < >>>>> bfl...@spatialdatalogic.com> ha scritto: >>>>> >>>>>> same here, we have not been contacted but our app is affected as well >>>>>> >>>>>> >>>>>> On Tuesday, December 8, 2015 at 2:53:18 PM UTC-5, Miguel Vitorino >>>>>> wrote: >>>>>>> >>>>>>> >>>>>>> Hi, >>>>>>> >>>>>>> Google Cloud Platform mailing list has just posted this announcement: >>>>>>> >>>>>>> "We’re investigating elevated error rates for some Google Cloud >>>>>>> Platform users. We believe these errors are affecting between 2-5 >>>>>>> percent >>>>>>> of Google App Engine (GAE) applications. We are working directly with >>>>>>> the >>>>>>> customers who are affected to restore full operation in their >>>>>>> application >>>>>>> as quickly as possible, and apologize for any inconvenience." >>>>>>> >>>>>>> Anyone know what exactly Google is doing directly with the affected >>>>>>> customers. Our app is severely affected and we have received no contact >>>>>>> or >>>>>>> instructions regarding this. >>>>>>> >>>>>>> Miguel >>>>>>> >>>>>> -- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "Google App Engine" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to google-appengi...@googlegroups.com. >>>>>> To post to this group, send email to google-a...@googlegroups.com. >>>>>> Visit this group at http://groups.google.com/group/google-appengine. >>>>>> To view this discussion on the web visit >>>>>> https://groups.google.com/d/msgid/google-appengine/dbc0fe86-abe3-40fe-a112-b3d73974e90a%40googlegroups.com >>>>>> >>>>>> <https://groups.google.com/d/msgid/google-appengine/dbc0fe86-abe3-40fe-a112-b3d73974e90a%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>> . >>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>> >>>>> -- >>>>> *Stefano Ciccarelli* >>>>> GAE Application Division >>>>> / Director >>>>> stefano.c...@mmbsoftware.it >>>>> >>>>> *M.M.B. s.r.l.* >>>>> via Granarolo, 177/7 - 48018 Faenza (RA) - Italy >>>>> tel. +39.0546.637711 - fax +39.0546.46077 >>>>> www.mmbsoftware.it - in...@mmbsoftware.it >>>>> >>>>> Le informazioni contenute in questa comunicazione sono riservate e >>>>> destinate esclusivamente alla/e persona/e o all'ente sopra indicati. E' >>>>> vietato ai soggetti diversi dai destinatari qualsiasi uso, copia, >>>>> diffusione di quanto in esso contenuto sia ai sensi dell'art. 616 c.p., >>>>> sia >>>>> ai sensi del DL n. 196/03. Se questa comunicazione Vi e' pervenuta per >>>>> errore, Vi preghiamo di rispondere a questa e-mail e successivamente >>>>> cancellarla dal Vostro sistema. >>>>> >>>> -- >>>> You received this message because you are subscribed to a topic in the >>>> Google Groups "Google App Engine" group. >>>> To unsubscribe from this topic, visit >>>> https://groups.google.com/d/topic/google-appengine/4TgH5hCOF3o/unsubscribe >>>> . >>>> To unsubscribe from this group and all its topics, send an email to >>>> google-appengi...@googlegroups.com. >>>> To post to this group, send email to google-a...@googlegroups.com. >>>> Visit this group at http://groups.google.com/group/google-appengine. >>>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/google-appengine/a0ae75b9-e756-49db-be43-6fcc9e4d0bd5%40googlegroups.com >>>> >>>> <https://groups.google.com/d/msgid/google-appengine/a0ae75b9-e756-49db-be43-6fcc9e4d0bd5%40googlegroups.com?utm_medium=email&utm_source=footer> >>>> . >>>> >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/e0d8d137-bb3d-4d33-ad29-c1be7e37a6bd%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
