[google-appengine] Re: Performance of site seems much slower after maintenance - startup is measuarably slower.
As the community grows, I think we need to start thinking about a BENCHMARK AUTHORITY. I was impacted also because, while doing a demo yesterday, my app was taking considerable more time to respond. Snags will happen. What I suggest is that we as a whole (users and provider - Google) work towards building a standard (benchmark), that allows us to diagnose whether our perceptions (real or not) are valid. Like stock indexes, we could form representative index of applications, that together establish an authoritative benchmark. Call it Google AppIndex. We users of Google, by looking of how the Google AppIndex is behaving could infer whether the problem was from Google or from our application. We are in this together :-) Thanks! --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Performance of site seems much slower after maintenance - startup is measuarably slower.
I am definately still seeing a marked slowdown on instance startup since maintenance. 09-06 05:14PM 46.006 /about/ 200 17836ms 3196cpu_ms 46api_cpu_ms I typically would see 4 -12s startup (I accept there will be some variability) For instance one month ago 08-06 04:21PM 16.021 /otherproducts 301 5146ms 3055cpu_ms 21api_cpu_ms Both of these requests are doing about the same amount of work. And you can see similiar amounts of api and cpu times but the full duration of the request is over 3 times as long Both of these requests are instance startups - I have logging in the various stages of instance startup so I know how long each phase of startup is taking. Is anyone else seeing this. T On Sep 4, 7:14 pm, Tim Hoffman zutes...@gmail.com wrote: And then it was fine. I seemed to hit a momentary blip, as the site is now very fine, however the dashboard logviewer was actually broken for a bit and then fine. Things seem to be all over the shop at the moment. T On Sep 4, 7:09 pm, Tim Hoffman zutes...@gmail.com wrote: I was going to say everything was fine, but I went ahnd checked and now its gone to hell in a hand basket, startup time is taking longer than 30 seconds and google is reporting Error 500. Very nasty T On Sep 3, 10:01 am, bvelasquez bvelasq...@gmail.com wrote: Hello, My application (ID: jacob-6) seems to be performing worse after the maintenance of yesterday. I have not made any significant changes that would affect performance to this degree, but I definitely see a change since yesterday. Requests are taking much longer and is unpredictable. For example, look at the following two requests. Both for the exact same information, doing the exact same processing. The times are very close since I ran the request manually. The first took much longer to process. 09-02 06:56PM 13.604 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 329ms 385cpu_ms 151api_cpu_ms 09-02 06:55PM 51.014 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 1508ms 1240cpu_ms 151api_cpu_ms This behavior is happening across all my requests. I'll try it from a different network connection when I go home tonight. Maybe this has something to do with it. Any ideas? My app went from pretty snappy to pretty slow overnight. Barry --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Performance of site seems much slower after maintenance.
I am seeing the same issue. Requests the used to take hundreds of milliseconds are now in the thousands. Any idea what is going on? Later, MF On Sep 2, 9:01 pm, bvelasquez bvelasq...@gmail.com wrote: Hello, My application (ID: jacob-6) seems to be performing worse after the maintenance of yesterday. I have not made any significant changes that would affect performance to this degree, but I definitely see a change since yesterday. Requests are taking much longer and is unpredictable. For example, look at the following two requests. Both for the exact same information, doing the exact same processing. The times are very close since I ran the request manually. The first took much longer to process. 09-02 06:56PM 13.604 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 329ms 385cpu_ms 151api_cpu_ms 09-02 06:55PM 51.014 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 1508ms 1240cpu_ms 151api_cpu_ms This behavior is happening across all my requests. I'll try it from a different network connection when I go home tonight. Maybe this has something to do with it. Any ideas? My app went from pretty snappy to pretty slow overnight. Barry --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Performance of site seems much slower after maintenance.
I was going to say everything was fine, but I went ahnd checked and now its gone to hell in a hand basket, startup time is taking longer than 30 seconds and google is reporting Error 500. Very nasty T On Sep 3, 10:01 am, bvelasquez bvelasq...@gmail.com wrote: Hello, My application (ID: jacob-6) seems to be performing worse after the maintenance of yesterday. I have not made any significant changes that would affect performance to this degree, but I definitely see a change since yesterday. Requests are taking much longer and is unpredictable. For example, look at the following two requests. Both for the exact same information, doing the exact same processing. The times are very close since I ran the request manually. The first took much longer to process. 09-02 06:56PM 13.604 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 329ms 385cpu_ms 151api_cpu_ms 09-02 06:55PM 51.014 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 1508ms 1240cpu_ms 151api_cpu_ms This behavior is happening across all my requests. I'll try it from a different network connection when I go home tonight. Maybe this has something to do with it. Any ideas? My app went from pretty snappy to pretty slow overnight. Barry --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Performance of site seems much slower after maintenance.
And then it was fine. I seemed to hit a momentary blip, as the site is now very fine, however the dashboard logviewer was actually broken for a bit and then fine. Things seem to be all over the shop at the moment. T On Sep 4, 7:09 pm, Tim Hoffman zutes...@gmail.com wrote: I was going to say everything was fine, but I went ahnd checked and now its gone to hell in a hand basket, startup time is taking longer than 30 seconds and google is reporting Error 500. Very nasty T On Sep 3, 10:01 am, bvelasquez bvelasq...@gmail.com wrote: Hello, My application (ID: jacob-6) seems to be performing worse after the maintenance of yesterday. I have not made any significant changes that would affect performance to this degree, but I definitely see a change since yesterday. Requests are taking much longer and is unpredictable. For example, look at the following two requests. Both for the exact same information, doing the exact same processing. The times are very close since I ran the request manually. The first took much longer to process. 09-02 06:56PM 13.604 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 329ms 385cpu_ms 151api_cpu_ms 09-02 06:55PM 51.014 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 1508ms 1240cpu_ms 151api_cpu_ms This behavior is happening across all my requests. I'll try it from a different network connection when I go home tonight. Maybe this has something to do with it. Any ideas? My app went from pretty snappy to pretty slow overnight. Barry --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Performance of site seems much slower after maintenance.
For my part, all seem faster... On Sep 3, 4:01 am, bvelasquez bvelasq...@gmail.com wrote: Hello, My application (ID: jacob-6) seems to be performing worse after the maintenance of yesterday. I have not made any significant changes that would affect performance to this degree, but I definitely see a change since yesterday. Requests are taking much longer and is unpredictable. For example, look at the following two requests. Both for the exact same information, doing the exact same processing. The times are very close since I ran the request manually. The first took much longer to process. 09-02 06:56PM 13.604 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 329ms 385cpu_ms 151api_cpu_ms 09-02 06:55PM 51.014 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 1508ms 1240cpu_ms 151api_cpu_ms This behavior is happening across all my requests. I'll try it from a different network connection when I go home tonight. Maybe this has something to do with it. Any ideas? My app went from pretty snappy to pretty slow overnight. Barry --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Performance of site seems much slower after maintenance.
http://speed-test.appspot.com/ If you want to rule out your network connection this is a good way to do that... Even if it won't test super fast connections with perfect accuracy, your connection should always score about the same. I have found that I get some drastically different results on my home 20 meg Comcast connection at different times of the day compared to testing from my colo's rack, where as Speak easy always tests the same (I suspect that Comcast has figured out that giving priority to speed tests is good for blaming other people for their problems... -Brandon Wirtz -Original Message- From: google-appengine@googlegroups.com [mailto:google-appeng...@googlegroups.com] On Behalf Of Sylvain Sent: Thursday, September 03, 2009 12:03 AM To: Google App Engine Subject: [google-appengine] Re: Performance of site seems much slower after maintenance. For my part, all seem faster... On Sep 3, 4:01 am, bvelasquez bvelasq...@gmail.com wrote: Hello, My application (ID: jacob-6) seems to be performing worse after the maintenance of yesterday. I have not made any significant changes that would affect performance to this degree, but I definitely see a change since yesterday. Requests are taking much longer and is unpredictable. For example, look at the following two requests. Both for the exact same information, doing the exact same processing. The times are very close since I ran the request manually. The first took much longer to process. 09-02 06:56PM 13.604 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 329ms 385cpu_ms 151api_cpu_ms 09-02 06:55PM 51.014 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 1508ms 1240cpu_ms 151api_cpu_ms This behavior is happening across all my requests. I'll try it from a different network connection when I go home tonight. Maybe this has something to do with it. Any ideas? My app went from pretty snappy to pretty slow overnight. Barry --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Performance of site seems much slower after maintenance.
I tried the tests from two locations now. Same results on the poor performance. I profiled the app. but found nothing obvious. Is there a way to download all the profile data? Some of my requests are now taking 11000ms. However, the same request a second time might take only 400ms. I'm at a loss. I'm only fetching 25 from the first page. action_gql = Action.gql(WHERE project = :1 and state = :2 and archived = :3 and milestone = :4 ORDER BY state DESC, due ASC, priority DESC, summary ASC, project_key, 0, False, db.Key(milestone)) This is an example query. Possibly the ORDER BY? Barry P.S. Sorry if this is a double post, my session seemed to have expired right after I hit send, so I don't know if the original made it. On Sep 3, 12:12 am, Brandon N. Wirtz drak...@digerat.com wrote: http://speed-test.appspot.com/ If you want to rule out your network connection this is a good way to do that... Even if it won't test super fast connections with perfect accuracy, your connection should always score about the same. I have found that I get some drastically different results on my home 20 meg Comcast connection at different times of the day compared to testing from my colo's rack, where as Speak easy always tests the same (I suspect that Comcast has figured out that giving priority to speed tests is good for blaming other people for their problems... -Brandon Wirtz -Original Message- From: google-appengine@googlegroups.com [mailto:google-appeng...@googlegroups.com] On Behalf Of Sylvain Sent: Thursday, September 03, 2009 12:03 AM To: Google App Engine Subject: [google-appengine] Re: Performance of site seems much slower after maintenance. For my part, all seem faster... On Sep 3, 4:01 am, bvelasquez bvelasq...@gmail.com wrote: Hello, My application (ID: jacob-6) seems to be performing worse after the maintenance of yesterday. I have not made any significant changes that would affect performance to this degree, but I definitely see a change since yesterday. Requests are taking much longer and is unpredictable. For example, look at the following two requests. Both for the exact same information, doing the exact same processing. The times are very close since I ran the request manually. The first took much longer to process. 09-02 06:56PM 13.604 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 329ms 385cpu_ms 151api_cpu_ms 09-02 06:55PM 51.014 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 1508ms 1240cpu_ms 151api_cpu_ms This behavior is happening across all my requests. I'll try it from a different network connection when I go home tonight. Maybe this has something to do with it. Any ideas? My app went from pretty snappy to pretty slow overnight. Barry --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Performance of site seems much slower after maintenance.
I tried the tests from two locations now. Same results on the poor performance. I profiled the app. but found nothing obvious. Is there a way to download all the profile data? Some of my requests are now taking 11000ms. However, the same request a second time might take only 400ms. I'm at a loss. I'm only fetching 25 from the first page. action_gql = Action.gql(WHERE project = :1 and state = :2 and archived = :3 and milestone = :4 ORDER BY state DESC, due ASC, priority DESC, summary ASC, project_key, 0, False, db.Key(milestone)) This is an example query. Possibly the ORDER BY? Barry On Sep 3, 12:12 am, Brandon N. Wirtz drak...@digerat.com wrote: http://speed-test.appspot.com/ If you want to rule out your network connection this is a good way to do that... Even if it won't test super fast connections with perfect accuracy, your connection should always score about the same. I have found that I get some drastically different results on my home 20 meg Comcast connection at different times of the day compared to testing from my colo's rack, where as Speak easy always tests the same (I suspect that Comcast has figured out that giving priority to speed tests is good for blaming other people for their problems... -Brandon Wirtz -Original Message- From: google-appengine@googlegroups.com [mailto:google-appeng...@googlegroups.com] On Behalf Of Sylvain Sent: Thursday, September 03, 2009 12:03 AM To: Google App Engine Subject: [google-appengine] Re: Performance of site seems much slower after maintenance. For my part, all seem faster... On Sep 3, 4:01 am, bvelasquez bvelasq...@gmail.com wrote: Hello, My application (ID: jacob-6) seems to be performing worse after the maintenance of yesterday. I have not made any significant changes that would affect performance to this degree, but I definitely see a change since yesterday. Requests are taking much longer and is unpredictable. For example, look at the following two requests. Both for the exact same information, doing the exact same processing. The times are very close since I ran the request manually. The first took much longer to process. 09-02 06:56PM 13.604 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 329ms 385cpu_ms 151api_cpu_ms 09-02 06:55PM 51.014 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 1508ms 1240cpu_ms 151api_cpu_ms This behavior is happening across all my requests. I'll try it from a different network connection when I go home tonight. Maybe this has something to do with it. Any ideas? My app went from pretty snappy to pretty slow overnight. Barry --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Performance of site seems much slower after maintenance.
i'm getting a similar response: 16 sec the first time, then sub-second after that. wonder if it has anything to do with the gmail maintenance and subsequence downtime that occurred a a few days ago... On Sep 3, 11:23 pm, bvelasquez bvelasq...@gmail.com wrote: I tried the tests from two locations now. Same results on the poor performance. I profiled the app. but found nothing obvious. Is there a way to download all the profile data? Some of my requests are now taking 11000ms. However, the same request a second time might take only 400ms. I'm at a loss. I'm only fetching 25 from the first page. action_gql = Action.gql(WHERE project = :1 and state = :2 and archived = :3 and milestone = :4 ORDER BY state DESC, due ASC, priority DESC, summary ASC, project_key, 0, False, db.Key(milestone)) This is an example query. Possibly the ORDER BY? Barry On Sep 3, 12:12 am, Brandon N. Wirtz drak...@digerat.com wrote: http://speed-test.appspot.com/ If you want to rule out your network connection this is a good way to do that... Even if it won't test super fast connections with perfect accuracy, your connection should always score about the same. I have found that I get some drastically different results on my home 20 meg Comcast connection at different times of the day compared to testing from my colo's rack, where as Speak easy always tests the same (I suspect that Comcast has figured out that giving priority to speed tests is good for blaming other people for their problems... -Brandon Wirtz -Original Message- From: google-appengine@googlegroups.com [mailto:google-appeng...@googlegroups.com] On Behalf Of Sylvain Sent: Thursday, September 03, 2009 12:03 AM To: Google App Engine Subject: [google-appengine] Re: Performance of site seems much slower after maintenance. For my part, all seem faster... On Sep 3, 4:01 am, bvelasquez bvelasq...@gmail.com wrote: Hello, My application (ID: jacob-6) seems to be performing worse after the maintenance of yesterday. I have not made any significant changes that would affect performance to this degree, but I definitely see a change since yesterday. Requests are taking much longer and is unpredictable. For example, look at the following two requests. Both for the exact same information, doing the exact same processing. The times are very close since I ran the request manually. The first took much longer to process. 09-02 06:56PM 13.604 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 329ms 385cpu_ms 151api_cpu_ms 09-02 06:55PM 51.014 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 1508ms 1240cpu_ms 151api_cpu_ms This behavior is happening across all my requests. I'll try it from a different network connection when I go home tonight. Maybe this has something to do with it. Any ideas? My app went from pretty snappy to pretty slow overnight. Barry- Hide quoted text - - Show quoted text - --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---