Waleed, I'm going to have to ask one of the other infrastructure engineers about the log lines. The value you have circled (18386ms) is not always greater than the cpu_ms. I'm not sure what this value indicates.
Nick Verne On Wed, Jun 22, 2011 at 6:27 AM, Waleed Abdulla <wal...@ninua.com> wrote: > Nicholas, > I implemented the change you suggested (making task_t0) a global > variable, but that didn't change the calculations. I'm attaching another > screen shot. There is a big difference between the actual processing time > and the time reported in the logs. It doesn't happen in all tasks, but it's > often enough that it's slowing down my application considerably and causing > a lot of user complaints. > I also calculated the total time to load the module (including time for > imports). It doesn't seem to take much time (sub 1 second), and it happens > only once right after I deploy a new version. So that is not an issue. > I've set the processing rate, bucket size, and max concurrency on the > task queue to high numbers (much higher than I need). > Any explanation for why this is happening? > Waleed > > > > On Mon, Jun 20, 2011 at 6:54 PM, Brandon Wirtz <drak...@digerat.com> wrote: >> >> Use a fetch from one thread to another. >> >> Echo Time >> Fetch >> Echo Time >> Do something >> Echo Time >> Echo Fetch >> >> Now you have a timeline of everything except the latency from User to >> Appengine. >> >> >> -----Original Message----- >> From: google-appengine@googlegroups.com >> [mailto:google-appengine@googlegroups.com] On Behalf Of Nicholas Verne >> Sent: Monday, June 20, 2011 6:03 PM >> To: google-appengine@googlegroups.com >> Subject: Re: [google-appengine] Why a big difference between execution >> time >> and response time? >> >> Yes, that's true. If you try this: >> >> task_t0 = None >> >> ... >> >> >> def main(argv): >> global task_t0 >> task_t0 = time.time() >> >> You'll get a measurement per request as early as we can make it. For >> warming >> requests, it might still be worth measuring the import time >> >> import time >> import_start = time.time() >> ... other imports >> import_duration = time.time() - import_start >> >> The import_duration global should persist and tell you how long this >> instance's imports took to process. Subsequent requests on that instance >> don't do the imports. >> >> Nick Verne >> >> On Tue, Jun 21, 2011 at 10:49 AM, Waleed Abdulla <wal...@ninua.com> wrote: >> >> A more useful measurement might be to set task_t0 as a global >> >> variable at the top of your file, with only the import of "time" >> >> preceding it >> > >> > Wouldn't that cause the 2nd, 3rd, ...nth requests to the same handler >> > to show wrong values? I see why setting task_t0 at the top of the file >> > would apply if it was the first request that causes the handler to be >> > loaded. But this is happening on an ongoing basis for all requests, >> > not only the first for that handler. >> > >> > -- >> > You received this message because you are subscribed to the Google >> > Groups "Google App Engine" group. >> > To post to this group, send email to google-appengine@googlegroups.com. >> > To unsubscribe from this group, send email to >> > google-appengine+unsubscr...@googlegroups.com. >> > For more options, visit this group at >> > http://groups.google.com/group/google-appengine?hl=en. >> > >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To post to this group, send email to google-appengine@googlegroups.com. >> To unsubscribe from this group, send email to >> google-appengine+unsubscr...@googlegroups.com. >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To post to this group, send email to google-appengine@googlegroups.com. >> To unsubscribe from this group, send email to >> google-appengine+unsubscr...@googlegroups.com. >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
