Hey Wenzhe, We have no incidents reported on the Cloud Status Dashboard <https://status.cloud.google.com/> for Datastore as of this moment. Sometimes performance may degrade for a short period of time dependent on Data-Center conditions. You should check out SLA on Datastore <https://cloud.google.com/datastore/sla> and consider implementing some exponential back-off logic in your code to handle the possibility of deadline exceeded errors. We have a document on this topic titled "Dealing with DeadlineExceededErrors <https://cloud.google.com/appengine/articles/deadlineexceedederrors>".
I'll check to see if I can find any other explanation and will report back to this thread. Cheers, Nick Cloud Platform Community Support On Thursday, September 29, 2016 at 8:27:28 PM UTC-4, Wenzhe Gao wrote: > > Hi, > > Our app has been running fine with low latency for months now. Latency > started spiking up dramatically at around 6:50am this morning. No real > changes on our side. I see quite a few datastore RPC deadline exceeded > errors in the logs. Ex: > > ... > rpc = datastore_rpc.MultiRpc.wait_any(self.rpcs) DeadlineExceededError: > The overall deadline for responding to the HTTP request was exceeded. > > See latency graph attached for reference. Any ideas what's going on? > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at https://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/da6620fb-81b8-4472-92de-6f2496c8a7e1%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.