[google-appengine] This request used a high amount of CPU and may soon exceed its quota - 2010/2011
Hi, I am using google app engine from beginning. From the time when there was high cpu quota tickets. I understand difference between request time, cpu and api time. In one of my request I am putting two objects in one batch operation to datastore (from same entity group in transaction, although this is irrelevant for this discussion). I noticed in log these request/cpu/api times: 12-16 02:03AM 35.944 200 198ms 1847cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.813 200 128ms 1828cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.712 200 107ms 1829cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.586 200 145ms 1865cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.524 200 182ms 1810cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.387 200 203ms 1938cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.438 200 151ms 1791cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.298 200 171ms 1829cpu_ms 1700api_cpu_ms I would probably ignore there lines if they are not in red color with triangle sign to warn me about 'high amount of cpu usage'. Reason for this 'high' api usage is index creation. Cost for first object is around 1200 api_cpu_ms and for second 500 api_cpu_ms (some changes and appstat revealed data). First object has 8 indexes where first attribute is list of strings (from 5 to 11 members, this usage is for 11 members). This 8 indexes are for ability to sort on 4 columns (ascending and descending). If I leave this list empty, api_cpu_ms is around 330 ms for first object. Of course I must not leave list empty if I want this user interface feature. I understand everything about this 'issue' and I am fine with 'high' cpu usage, because my request time is around 160 ms, top 200 ms. Question: Is Google App Engine fine with my 'high' cpu usage ? Will I be penalized in any way (new instances, throtle, ...) because of this 'high abount of CPU' ? If GAE is fine and I will not be penalized why don't you change this 'coloring' schema to use only request time or maybe request time with (cpu time - api time) ?! This red color will make me crazy ;) -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] This request used a high amount of CPU and may soon exceed its quota - 2010/2011
It seems every request that used more than 1000 cpu ms will be consider as high amount of cpu usage. -- keakon My blog(Chinese): www.keakon.net Blog source code: https://bitbucket.org/keakon/doodle/ On Thu, Dec 16, 2010 at 6:38 PM, Matija matija.jerko...@gmail.com wrote: Hi, I am using google app engine from beginning. From the time when there was high cpu quota tickets. I understand difference between request time, cpu and api time. In one of my request I am putting two objects in one batch operation to datastore (from same entity group in transaction, although this is irrelevant for this discussion). I noticed in log these request/cpu/api times: 12-16 02:03AM 35.944 200 198ms 1847cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.813 200 128ms 1828cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.712 200 107ms 1829cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.586 200 145ms 1865cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.524 200 182ms 1810cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.387 200 203ms 1938cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.438 200 151ms 1791cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.298 200 171ms 1829cpu_ms 1700api_cpu_ms I would probably ignore there lines if they are not in red color with triangle sign to warn me about 'high amount of cpu usage'. Reason for this 'high' api usage is index creation. Cost for first object is around 1200 api_cpu_ms and for second 500 api_cpu_ms (some changes and appstat revealed data). First object has 8 indexes where first attribute is list of strings (from 5 to 11 members, this usage is for 11 members). This 8 indexes are for ability to sort on 4 columns (ascending and descending). If I leave this list empty, api_cpu_ms is around 330 ms for first object. Of course I must not leave list empty if I want this user interface feature. I understand everything about this 'issue' and I am fine with 'high' cpu usage, because my request time is around 160 ms, top 200 ms. Question: Is Google App Engine fine with my 'high' cpu usage ? Will I be penalized in any way (new instances, throtle, ...) because of this 'high abount of CPU' ? If GAE is fine and I will not be penalized why don't you change this 'coloring' schema to use only request time or maybe request time with (cpu time - api time) ?! This red color will make me crazy ;) -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] This request used a high amount of CPU and may soon exceed its quota - 2010/2011
Submit an issue and post the issue number here. Having the high-cpu requests highlighted is nice, but I agree with you about high-latency requests being a bigger concern. Robert On Thu, Dec 16, 2010 at 05:38, Matija matija.jerko...@gmail.com wrote: Hi, I am using google app engine from beginning. From the time when there was high cpu quota tickets. I understand difference between request time, cpu and api time. In one of my request I am putting two objects in one batch operation to datastore (from same entity group in transaction, although this is irrelevant for this discussion). I noticed in log these request/cpu/api times: 12-16 02:03AM 35.944 200 198ms 1847cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.813 200 128ms 1828cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.712 200 107ms 1829cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.586 200 145ms 1865cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.524 200 182ms 1810cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.387 200 203ms 1938cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.438 200 151ms 1791cpu_ms 1700api_cpu_ms 12-16 02:03AM 35.298 200 171ms 1829cpu_ms 1700api_cpu_ms I would probably ignore there lines if they are not in red color with triangle sign to warn me about 'high amount of cpu usage'. Reason for this 'high' api usage is index creation. Cost for first object is around 1200 api_cpu_ms and for second 500 api_cpu_ms (some changes and appstat revealed data). First object has 8 indexes where first attribute is list of strings (from 5 to 11 members, this usage is for 11 members). This 8 indexes are for ability to sort on 4 columns (ascending and descending). If I leave this list empty, api_cpu_ms is around 330 ms for first object. Of course I must not leave list empty if I want this user interface feature. I understand everything about this 'issue' and I am fine with 'high' cpu usage, because my request time is around 160 ms, top 200 ms. Question: Is Google App Engine fine with my 'high' cpu usage ? Will I be penalized in any way (new instances, throtle, ...) because of this 'high abount of CPU' ? If GAE is fine and I will not be penalized why don't you change this 'coloring' schema to use only request time or maybe request time with (cpu time - api time) ?! This red color will make me crazy ;) -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
