[google-appengine] Latency spikes and aborted requests in the last 24 hours

2010-09-23 Thread Ikai Lan (Google)
Hey guys, We've been tracking latency spikes and intermittent batches of aborted requests over the last 24 hour period. There were at least 3 periods of spikes yesterday: ~1100 Pacific (moderate, brief period of high) ~1300 Pacific (small) ~1530 Pacific (small) Community reports seem to indicate

Re: [google-appengine] Latency spikes and aborted requests in the last 24 hours

2010-09-23 Thread Fredrik Bonander
Hi, I've been experiencing "DeadlineExceededError" that doesn't match these reports: 21/9: 04.15 -> 04.45 (9 different requests of 80 total during 21/9) 20/9: 05.27 17/9: 03.06 All request times after ~30 sec. I use Appengine 1.3.7, Python and Django 1.1. The application id is martinadlerphot

Re: [google-appengine] Latency spikes and aborted requests in the last 24 hours

2010-09-23 Thread Ikai Lan (Google)
Fredrik, are these loading requests? If so, how long does a standard loading request take to load? -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_engine On Thu, Sep

Re: [google-appengine] Latency spikes and aborted requests in the last 24 hours

2010-09-23 Thread Eli Jones
My app is in Python. The only thing it does between 6:30 AM PST and 1:00 PM PST is run a single chained task. The task just runs once every 5 minutes. (There are no other backend processes or users). Yesterday at 11:00 AM PST and 11:02 AM PST, the task experienced the 10 second, 500 error (with

Re: [google-appengine] Latency spikes and aborted requests in the last 24 hours

2010-09-23 Thread Fredrik Bonander
Yes, normal get-request. A standard request is about 300-500ms. But just view the logs and it's have been 3-4 spikes today taking 800-1100 ms. On a side note. On a normal request (loads data from memcache) should i really take 300-500 ms? The app it self is a real basic html site thats populated

Re: [google-appengine] Latency spikes and aborted requests in the last 24 hours

2010-09-23 Thread Eli Jones
Also, a cold start for this task can take as little as 960 ms (where it shows the log detail: "This request caused a new process to be started for your application..."). And, the task is doing a URLFetch, so.. I'm sure that is taking up a chunk of the running time. One of my imports is pytz (no d

Re: [google-appengine] Latency spikes and aborted requests in the last 24 hours

2010-09-23 Thread Ikai Lan (Google)
It sounds like these are impacting Python developers - I haven't heard any Java app developers chime in yet. What's the ballpark of the QPS you guys are doing? <1qps, 10qps, 100qps, etc? -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit

Re: [google-appengine] Latency spikes and aborted requests in the last 24 hours

2010-09-23 Thread Fredrik Bonander
Sorry, what's QPS? ..fredrik Sent from my iPad On 23 sep 2010, at 18:20, "Ikai Lan (Google)" wrote: > It sounds like these are impacting Python developers - I haven't heard any > Java app developers chime in yet. > > What's the ballpark of the QPS you guys are doing? <1qps, 10qps, 100qps, et

Re: [google-appengine] Latency spikes and aborted requests in the last 24 hours

2010-09-23 Thread Fredrik Bonander
Oh, queries per second? Very low. At it's highest it's about 0,6. Only have about 50-60 visitors a day. Sent from my iPad On 23 sep 2010, at 18:26, Fredrik Bonander wrote: > Sorry, what's QPS? > > ..fredrik > > Sent from my iPad > > On 23 sep 2010, at 18:20, "Ikai Lan (Google)" > wrote:

Re: [google-appengine] Latency spikes and aborted requests in the last 24 hours

2010-09-23 Thread Carlos Ble
Same here 2010/9/23 Fredrik Bonander > Oh, queries per second? > > Very low. At it's highest it's about 0,6. Only have about 50-60 visitors a > day. > > Sent from my iPad > > On 23 sep 2010, at 18:26, Fredrik Bonander < > carl.fredrik.bonan...@gmail.com> wrote: > > Sorry, what's QPS? > > ..fredr

Re: [google-appengine] Latency spikes and aborted requests in the last 24 hours

2010-09-23 Thread Eli Jones
My app is extremely lightweight. The average CPU usage for a cold start falls in these ranges: CPU_MS:1030 - 1230 API_CPU_MS: 408 The rough outline of the code that runs is: 1. Pull credentials form memcache and decrypt. 2. Connect to gdata service, and get some data. 3. Create 4 new en