[google-appengine] Re: My datastore stored data size jumps from 28G to 5214G in one day!
I can't speak to the problem from the month ago, but we're investigating a bug for today's billing with apps showing a datastore usage of 2x what it should be. We'll provide more information once we're fully aware of what is going on. On Aug 10, 9:19 pm, gks liu...@gmail.com wrote: The same issue happens to my app again. This time it doubles the size in day from 108G to 216G. Can anyone from Google provide explanation on why it keeps happening? On Wednesday, June 20, 2012 11:26:12 PM UTC-7, gks wrote: Today my datastore stored data size jumps from 28G (yesterday's bill) to 5214G! How can I troubleshoot this issue? My datastore statistic is from 2 days ago and reports 27G. Is it just a reporting issue or a real issue? There is zero change to my application during the past couple days. My appid is aos-prod-1. Please help! -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: LOTS of errors on db.get() suddenly
What is your app id? The admin console looks to have thrown higher error rates for a 5 minute window recently, this is unrelated to any datastore issues. On Apr 18, 2:05 pm, Jason Collins jason.a.coll...@gmail.com wrote: We are seeing this on data centre na3, but not on na6. j On Apr 18, 3:00 pm, Jason Collins jason.a.coll...@gmail.com wrote: Also, deployments are throwing errors. j On Apr 18, 2:55 pm, Jason Collins jason.a.coll...@gmail.com wrote: Seeing lots of errors on db.get() suddenly and from all parts of our code (no, we haven't pushed any new code). Also, our dashboard is throwing lots of errors. Anyone else seeing this? (I've opened an enterprise support case already, but wondering if anyone else is seeing same.) j -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: LOTS of errors on db.get() suddenly
Nevermind, I can look up the enterprise support case. On Apr 18, 2:07 pm, powera (App Engine Reliablity) pow...@google.com wrote: What is your app id? The admin console looks to have thrown higher error rates for a 5 minute window recently, this is unrelated to any datastore issues. On Apr 18, 2:05 pm, Jason Collins jason.a.coll...@gmail.com wrote: We are seeing this on data centre na3, but not on na6. j On Apr 18, 3:00 pm, Jason Collins jason.a.coll...@gmail.com wrote: Also, deployments are throwing errors. j On Apr 18, 2:55 pm, Jason Collins jason.a.coll...@gmail.com wrote: Seeing lots of errors on db.get() suddenly and from all parts of our code (no, we haven't pushed any new code). Also, our dashboard is throwing lots of errors. Anyone else seeing this? (I've opened an enterprise support case already, but wondering if anyone else is seeing same.) j -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Site stopped responding?!
Hi -- As part of a recent change, a very small number of apps that had not been deployed in the past 3 years would break without manual intervention on our part or a redeployment on your part. I thought they had all been fixed before the change was rolled out, but apparently your app was not. I've manually fixed this app and am going to double-check no other apps are in this state. On Apr 12, 10:00 am, Stirman stir...@gmail.com wrote: My app engine app, mobaganda.com, has been running for years and I literally haven't touched the code in a 3 or 4 years. Suddenly this week the site is rendering only a ! No idea why, no errors in the logs. I had renewed my domain name last week, so I figured it was related, but according to them... The IP address 64.233.179.121 (which is associated with the domain name through the A record) is not resolving. Please contact your service provider for further assistance. Any ideas? Many thanks! -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Tasks are not issued correctly, causing major malfunction in my ap
I've looked at the app, and it seems the problem is that the rate of task execution is very low right now and there is a large backlog of pending tasks. I'm testing a fix to pe-server5, if it works I will apply it to the other apps. On Apr 12, 10:37 am, Jeff Schnitzer j...@infohazard.org wrote: Please describe the problem in a lot more detail. You're speaking as if we understand what's going on. Nobody does. Fail silently? What does that mean? The tasks don't execute but stay in the queue? The tasks don't get added to the queue? If you want help, you have to do a lot more than say my app is broken. I enqueue transactional tasks all the time. I use this to string out a transactional operation across dozens of entity groups. It works fine. Jeff 2012/4/12 ZeroCool zero...@gmail.com: My apps use transactional tasks to defer transactions across entity groups. This behavior has been working for over a year. From yesterday, they started to fail silently. Many of my transactions can't complete due to this changed behavior. I know, we now can use cross group transactions. But shouldn't the previous version remain supported for 3 years? On 4月12日, 下午10时59分, Jeff Schnitzer j...@infohazard.org wrote: Your description of the problem is useless. Jeff On Thu, Apr 12, 2012 at 9:55 AM, ZeroCool zero...@gmail.com wrote: Someone please look into this issue. It's killing me. The problem is spreading. pe-server5 pe-server7 pe-server8 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Tasks are not issued correctly, causing major malfunction in my ap
Yes, that's the same problem. It seems to be affecting a very small number of apps right now. I've fixed your app as well as a few others that seem to be having this problem. For other people seeing a similar problem, updating that issue with your app id is probably the fastest way to get resolution if you see this issue. On Apr 12, 7:13 pm, nischalshetty nischalshett...@gmail.com wrote: We too are facing the slow task execution rate problem. Tasks are integral to our app. I've logged a production issue here - http://code.google.com/p/googleappengine/issues/detail?id=7337 Anyone else facing the issue please star and leave a comment on the above issue with your app ids. On Friday, April 13, 2012 1:07:21 AM UTC+5:30, powera (App Engine Reliablity) wrote: I've looked at the app, and it seems the problem is that the rate of task execution is very low right now and there is a large backlog of pending tasks. I'm testing a fix to pe-server5, if it works I will apply it to the other apps. On Apr 12, 10:37 am, Jeff Schnitzer j...@infohazard.org wrote: Please describe the problem in a lot more detail. You're speaking as if we understand what's going on. Nobody does. Fail silently? What does that mean? The tasks don't execute but stay in the queue? The tasks don't get added to the queue? If you want help, you have to do a lot more than say my app is broken. I enqueue transactional tasks all the time. I use this to string out a transactional operation across dozens of entity groups. It works fine. Jeff 2012/4/12 ZeroCool zero...@gmail.com: My apps use transactional tasks to defer transactions across entity groups. This behavior has been working for over a year. From yesterday, they started to fail silently. Many of my transactions can't complete due to this changed behavior. I know, we now can use cross group transactions. But shouldn't the previous version remain supported for 3 years? On 4月12日, 下午10时59分, Jeff Schnitzer j...@infohazard.org wrote: Your description of the problem is useless. Jeff On Thu, Apr 12, 2012 at 9:55 AM, ZeroCool zero...@gmail.com wrote: Someone please look into this issue. It's killing me. The problem is spreading. pe-server5 pe-server7 pe-server8 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp:// groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp:// groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Help! I'm hungery - My app for my wife's recipes fails to load
As part of a recent change, a very small number of apps that had not been deployed in the past 3 years would break without manual intervention on our part or a redeployment on your part. Our initial effort to fix all of these pre-emptively unfortunately missed some of those apps. We're rolling out a fix to these apps over the next few hours; since your app id is not in the message I can't fix your app manually now. On Apr 11, 5:32 am, thepopeofantelope markp...@gmail.com wrote: I wrote a recipe app for my wife several years ago. I have since lost the PC hard drive and project code. She has added may recipes and I would like to extract them or restore the app. Browsing to the app yields the following message: Error: Server Error The server encountered an error and could not complete your request. If the problem persists, please reporthttp://code.google.com/appengine/community.htmlyour problem and mention this error message and the query that caused it. I tried to download the data using appcfg.py and bulkloader.py using both /remote_api and /_ah/remote_api with no success. The following error is generated each time: Traceback (most recent call last) File /work/google_appengine/google/appengine/tools/bulkloader.py, line 3433, in Run self.request_manager.Authenticate() File /work/google_appengine/google/appengine/tools/bulkloader.py, line 1319, in Authenticate remote_api_stub.MaybeInvokeAuthentication() File /work/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py,line 676, in MaybeInvokeAuthentication File /work/google_appengine/google/appengine/tools/appengine_rpc.py,line 366, in Send f = self.opener.open(req) File /usr/lib/python2.6/urllib2.py, line 397, in open response = meth(req, response) File /usr/lib/python2.6/urllib2.py, line 510, in http_response 'http', request, response, code, msg, hdrs) File /usr/lib/python2.6/urllib2.py, line 435, in error return self._call_chain(*args) File /usr/lib/python2.6/urllib2.py, line 369, in _call_chain result = func(*args) File /usr/lib/python2.6/urllib2.py, line 518, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) HTTPError: HTTP Error 500: Internal Server Error [INFO ] Authentication Failed I am not prompted for a email and password when this error is generated, like I am when I try to download the app with appcfg.py. I added the following lines to appcfg.py and buklloader.py for force using an older library. It has no effect. os.environ['DJANGO_SETTINGS_MODULE'] = 'settings' from google.appengine.dist import use_library use_library('django', '0.96') This error is logged with every attempt. class 'django.template.InvalidTemplateLibrary': Template library templatefilters does not have a variable named 'register' Traceback (most recent call last): File /base/data/home/apps/delraemariesrecipes/2.2/tasks.py, line 41, in module template.register_template_library('templatefilters') File /base/python_runtime/python_lib/versions/1/google/appengine/ext/webapp/template.py, line 267, in register_template_library django.template.add_to_builtins(package_name) File /base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/__init__.py, line 915, in add_to_builtins builtins.append(get_library(module_name)) File /base/python_runtime/python_lib/versions/third_party/django-0.96/django/template/__init__.py, line 911, in get_library raise InvalidTemplateLibrary, Template library %s does not have a variable named 'register' % module_name -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Urgent: My appengine is app is completely down.
There was a temporary spike of errors on the admin console that has been fixed, it did not impact any other app's serving. word-play.appspot.com looks to be up to me from hitting that domain, can you explain what app/pages are giving you errors? On Feb 10, 2:14 pm, David s2kd...@gmail.com wrote: Both from the dashboard and from accessing it via web requests. The dashboard shows a Server Error in giant text saying to report it and to mention the error. In addition, accessing the app using the web is also down. Please fix this asap. Error: Server Error The server encountered an error and could not complete your request. If the problem persists, please report your problem and mention this error message and the query that caused it. Thanks, David word-play.appspot.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: PROBLEM: Deploying new version. Checking if new version is ready to serve. Checking if new version is ready to serve. Will check again in 60 seconds.
App deployments should be working again now. On Nov 21, 5:26 am, Dmitry dmitry.lukas...@gmail.com wrote: experience the same issues last 3 hours... On 21 ноя, 15:16, Web Feature Labs webf.l...@gmail.com wrote: does not works!!! ... ... ... ... ... Will check again in 60 seconds. Checking if new version is ready to serve. Closing update: new version is ready to start serving. Uploading index definitions. http://3.latest.MY_APP.appspot.com/ Error: Not Found The requested URL / was not found on this server. On Nov 21, 1:09 pm, Web Feature Labs webf.l...@gmail.com wrote: This bug is very dangerous! What is the problem? On Nov 21, 1:03 pm, Web Feature Labs webf.l...@gmail.com wrote: .after long time I see my new version does not work :-( http://2.latest.MY_APP.appspot.com/ Error: Not Found The requested URL / was not found on this server. On Nov 21, 12:45 pm, Web Feature Labs webf.l...@gmail.com wrote: Hi all, I can note deploy my new app version: Deploying new version. Checking if new version is ready to serve. Will check again in 1 seconds. Checking if new version is ready to serve. Will check again in 2 seconds. Checking if new version is ready to serve. Will check again in 4 seconds. Checking if new version is ready to serve. Will check again in 8 seconds. Checking if new version is ready to serve. Will check again in 16 seconds. Checking if new version is ready to serve. Will check again in 32 seconds. Checking if new version is ready to serve. Will check again in 60 seconds. Checking if new version is ready to serve. Will check again in 60 seconds. Checking if new version is ready to serve. Will check again in 60 seconds. ... ... ... -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Quota numbers seem wrong
This should be fixed. The problem was only with the display and not with the actual tracking/charging of quota usage. On Oct 19, 5:19 pm, Jeff Schwartz jefftschwa...@gmail.com wrote: I am testing a new app in production and it sent out 1 email but the admin screen showed that 20 emails had been sent out. I know it was only 1 email that was actually sent because it is done in a task and the task was only executed once. 1/20, that's not good :) Any ideas on why this number is so skewed? Thanks in advance, Jeff On Tue, Oct 19, 2010 at 4:14 PM, Eli Jones eli.jo...@gmail.com wrote: Hmm, that's neat. I see those exact numbers as well. (I haven't noticed since I only pay attention to my main dashboard quota.) Though, there is nothing noticeably wrong with my other quotas. On Tue, Oct 19, 2010 at 4:03 PM, Jamie H ja...@mhztech.com wrote: No, I can confirm that I have 3 apps which all seem to have the same stuck quota numbers, for both Datastore queries and DS CPU Time. These numbers never change. Datastore CPU Time 0% 2.49 of 2,487.70 CPU hours Okay Datastore Queries 0% 2,073,600 of 417,311,168 Okay App ID tickettrackit, and all apps on same account all have these same stuck numbers. It seems they have been like this ever since 9/13 ...? On Oct 19, 12:55 pm, Ikai Lan (Google) ikai.l+gro...@google.comikai.l%2bgro...@google.com wrote: I checked on all of these applications and they are reflecting numbers that look correct. Please let us know if this appears again. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger:http://googleappengine.blogspot.com Reddit:http://www.reddit.com/r/appengine Twitter:http://twitter.com/app_engine On Sun, Oct 17, 2010 at 9:28 AM, sodso sodhisoluti...@gmail.com wrote: appid - sodso-reminders, sodso-webs my both apps are now showing strange values for various quota numbers values seem to be stuck or changing only in 100 multiples something is seriously wrong with the quota details reporting system -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com google-appengine%2bunsubscr...@googlegroups.comgoogle-appengine%252Bunsub scr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Jeff -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Memcache capacity
Hi -- Memcache is limited, though there isn't a particular hard limit. In general, if you have more than 50MB of data in memcache you will start to see decreased LRU eviction times; 1 GB is about the limit a single app can store without adjustments regardless of usage. I've made an adjustment to your app's memcache config allowing it to store more data. Hopefully this will help. On Sep 30, 3:58 am, sahid sahid.ferdja...@gmail.com wrote: I store my users sessions in memcache (like jaikuengine) but when site traffic is the highest my users are disconnected, i suppose the probleme comes from memcache, because memcache removes old items if the max size is exceeded. Now i use about 900mega of memcache but at the night (i'm in france) i can use more... may be 1giga, i would know if memcache is limited? APPID: devel-inchallah Cordially, Sahid -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Memcache capacity
558 GB is the quota for how much data you can send for memcache in a day. Memcache will evict data that has not been read recently to stay within memory limits. The numbers I gave are more rules of thumb about how the LRU cache generally behaves, and when you will start to see decreased retention times as a result of the amount of data stored in memcache. On Oct 1, 10:30 am, Felippe Bueno felippe.bu...@gmail.com wrote: Sorry, but I don't understand. The limit are not 558.00 GB for stored data, and 1MB for each memcache record ? On Thu, Sep 30, 2010 at 5:45 PM, powera pow...@google.com wrote: Hi -- Memcache is limited, though there isn't a particular hard limit. In general, if you have more than 50MB of data in memcache you will start to see decreased LRU eviction times; 1 GB is about the limit a single app can store without adjustments regardless of usage. I've made an adjustment to your app's memcache config allowing it to store more data. Hopefully this will help. On Sep 30, 3:58 am, sahid sahid.ferdja...@gmail.com wrote: I store my users sessions in memcache (like jaikuengine) but when site traffic is the highest my users are disconnected, i suppose the probleme comes from memcache, because memcache removes old items if the max size is exceeded. Now i use about 900mega of memcache but at the night (i'm in france) i can use more... may be 1giga, i would know if memcache is limited? APPID: devel-inchallah Cordially, Sahid -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Critical bug in URL handling: dropping everything after a semicolon
On Apr 17, 2:58 pm, Alex Popescu the.mindstorm.mailingl...@gmail.com wrote: On Apr 17, 8:32 pm, 风笑雪 kea...@gmail.com wrote: ; is not a valid char in url, you need encode it. from urllib import quote quote(/090314/vm-memory-in-the-cloud-watch-what-kevin-has-to-say;b.html) '/090314/vm-memory-in-the-cloud-watch-what-kevin-has-to-say%3Bb.html' Even so, the App Engine drops it. And according to RFC3986 my understanding is that the semicolon can be part of the URL (I'll not reproduce the EBNF here as it is quite complex). ./alex http://docs.python.org/library/urlparse.html says that anything after a semicolon will be considered a parameter and located in request.params and not request.path . --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---