Hi Jonathan, A full postmortem has been posted here:
http://groups.google.com/group/google-appengine/browse_thread/thread/e9237fc7b0aa7df5# The issues initially manifested as timeouts and API errors but we switched into read-only mode (capability disabled exceptions) as we prepared to switch over to other datacenters. Thanks again for your patience during this outage and apologies as I know this has been a serious problem for many. Thank you, Jeff On Jul 2, 4:43 pm, jonathan <jricket...@gmail.com> wrote: > I wasn't actually getting CapabilityDisabledExceptions during this > period: instead I got a lot of datastore errors and timeouts. > > My timeline: > at 02/Jul/2009:08:40:59 -0700: my memcache calls starting failing > at 02/Jul/2009:09:24:49 -0700: I started receiving > google.appengine.api.datastore_errors.Timeout > at 02/Jul/2009:10:38:54 -0700: I started receiving > google.appengine.runtime.apiproxy_errors.Error > at 02/Jul/2009:11:30:36 -0700: I stopped receiving these errors > at 02/Jul/2009:11:56:08 -0700: I started getting > CapabilityDisabledExceptions > at 02/Jul/2009:12:07:23 -0700: Operations resumed normally > > This doesn't seem to match what was expected by Google. Can anyone > tell me what was going on? > > Jonathan > > On Jul 3, 8:58 am, "Jeff S (Google)" <j...@google.com> wrote: > > > Thank you for the feedback Jerason. I hear you and we are working to prevent > > situations like this from arising again. We plan to publish a postmortem to > > explain the issue in the near future. > > > Cheers, > > > Jeff > > > On Thu, Jul 2, 2009 at 11:46 AM, Jerason Banes <jba...@gmail.com> wrote: > > > > As of 1:38PM Central Daylight Time, my website (http:// > > >www.dsicade.com) is completely unavailable. And that's after > > > experiencing memcache failures today (which disabled chat) and turning > > > away record new scores for some of the games on the site due to > > > datastore issues. > > > > These issues appear to be occurring with increasing frequency. I > > > absolutely love the Google AppEngine service and was expecting to > > > begin paying for service soon with the explosive growth of my site. > > > But this extensive downtime is becoming an increasingly serious issue. > > > If this continues, new features (e.g. multiplayer games) will not be > > > feasible and I will need to change my hosting plans. > > > > If I may humbly request, please find a solution to these issues as > > > soon as possible. I love what you're doing here and I want to remain > > > your customer! > > > > Thanks, > > > Jerason Banes > > > >http://www.dsicade.com > > > > On Jul 2, 12:38 pm, "Jeff S (Google)" <j...@google.com> wrote: > > > > Hi all, > > > > > As many of you have noticed, App Engine has been experiencing elevated > > > > datastore latency and error rates and we switched into an unplanned > > > > maintenance mode. The notice was originally posted to the downtime > > > > notify group, please follow this thread for details and suggestions on > > > > handling the capability disabled exceptions: > > > > >http://groups.google.com/group/google-appengine-downtime-notify/brows... > > > > > Apologies all, I know this is frustrating for all of you and for us. > > > > We normally post these notices just to the downtime notify group, but > > > > in this case I've seen several threads on the topic. > > > > > Thank you, > > > > > Jeff > > --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~----------~----~----~----~------~----~------~--~---
