[google-appengine] Re: Again *major* server errors of app engine!
Davel63, are you also using appengine patch? On 8 Feb., 04:48, Devel63 danstic...@gmail.com wrote: We see the same thing, and just converted to Django. Sounds like it may be related to Django. On Feb 7, 11:09 am, johnP j...@thinkwave.com wrote: No solution - just gathering information. Looking more closely at the logs where the errors occur, the deadline exceeded pops up somewhere while loading and patching django. This started a couple days ago. Maybe it'll go away? Oh well - I'm gonna enjoy the rest of the weekend, and will come back to this on Monday. :) johnP On Feb 7, 10:59 am, conman constantin.christm...@googlemail.com wrote: Yea, I am using appengine patch too and in my logs are a lot deadline exceeded errors which result from request on very simple pages without any datastore operations. But what's the problem? I have the feeling app engine is lagging at this time of the day but that may be a oversimplification... What's your solution to that problem - or are you just igoring it? Constantin On 7 Feb., 19:37, johnP j...@thinkwave.com wrote: I saw similar issues (with a google-issued, non-customized 500 deadline exceeded error). I'm using appengine patch, and saw a large increase in zipimporter calls. It seemed like a large number of requests were reloading the entire Django environment (and maybe doing so more slowly than usual...) which resulted in periodic deadline exceeded errors on very simple pages. Sound possible? johnP On Feb 7, 9:29 am, conman constantin.christm...@googlemail.com wrote: It's happening again!! Our site is not accessible but instead showing a google 500 server error page!!! The whole day everything worked normal but in the early evening (Germany/Europe) or forenoon (PST) the serving of the site is broken again - and I definitively didn't change anything today! Yesterday at the same time of the day app engine had the exact same problem:http://groups.google.com/group/google-appengine/browse_thread/thread/... What's up with that and where can I report this error so someone at google will look into that? Regards, Constantin --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: prepopulate form fields according to http get parameters
On Feb 8, 6:56 pm, niklasr nikla...@gmail.com wrote: I'm looking for template tags or similar that according to http get request parameters set the corresponding html form fields. To achieve the selection of an html option and populate a textfield according to the http request parameters where http get with two parameters should prepopulate a textfield and the option selected in my html form /main? q=foow=2 should set the textfield to 'foo' and the select option 2 to state selected. I saw no template tag that directly tests or handles a http get parameter but there probably is, for a more direct and favorable way than passing the request parameters and testing option by option select ... {% ifequal w 2 %} option selected value=applesApples/option {% else %} option value=applesApples/option {% endifequal %} ... Thank you Niklas This is normally done using Django forms: http://docs.djangoproject.com/en/dev/topics/forms/ --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: does GAE have pycrypto?
But surely it should available to GAE users since it used by GAE itself, shouldn't it? --Jonas Galvez On Sat, Feb 7, 2009 at 11:04 PM, Alexander Kojevnikov alexan...@kojevnikov.com wrote: On Feb 8, 8:23 am, Anthony acca...@gmail.com wrote: Thanks, that's what I've been doing locally. So I suppose when I deploy to the GAE server, I should bundle all non-standard libraries with my application files? Yes, as long as they are pure-Python libraries. If a library uses C extensions, you cannot run it on App Engine: http://code.google.com/appengine/docs/python/runtime.html#Pure_Python --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: prepopulate form fields according to http get parameters
On Feb 8, 10:11 am, Alexander Kojevnikov alexan...@kojevnikov.com wrote: On Feb 8, 6:56 pm, niklasr nikla...@gmail.com wrote: I'm looking for template tags or similar that according to http get request parameters set the corresponding html form fields. To achieve the selection of an html option and populate a textfield according to the http request parameters where http get with two parameters should prepopulate a textfield and the option selected in my html form /main? q=foow=2 should set the textfield to 'foo' and the select option 2 to state selected. I saw no template tag that directly tests or handles a http get parameter but there probably is, for a more direct and favorable way than passing the request parameters and testing option by option select ... {% ifequal w 2 %} option selected value=applesApples/option {% else %} option value=applesApples/option {% endifequal %} ... Thank you Niklas This is normally done using Django forms:http://docs.djangoproject.com/en/dev/topics/forms/ Many thanks. I understand google.appengine.ext.db.djangoforms.ModelForm or django.forms.Form or just loop the options and set the selected, if only there was an optionFromQuery value: {% for currentOption in allOptions %} option value={currentOption} {% ifequal currentOption optionFromQuery %} selected{% endifequal %}{currentOption}/option{% endfor %} Best regards Niklas --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Inconsistency between dev_server and production server on sharded counter behaviour.
If you have different behavior on dev_appserver and the production server you should file a bug report in the issue list http://code.google.com/p/googleappengine/issues/list At least dev_appserver should report the transaction problem the same as production. dev_appserver has code to check for multiple entity groups but it might miss your situation. (if you find the bug yourself, don't mention the solution in the issue report, it won't be part of dev_appserver unless you sign an agreement, then we have to patch dev_appserver ourself each time there is a new version) 2009/2/7 Qian Qiao qian.q...@gmail.com: The code in my original email worked in dev_appserver, which I suppose is incorrect. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: urlfetch problem
Did you use urllib.urlencode() to construct the parameter part url = 'http://server/index.php' url_fields = { 'auth': authstring } url_fields = urllib.urlencode(url_fields) result = urlfetch.fetch(url+'?'+url_fields) --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Django 500's and Error Reporting
I ran into this when I ported from webapp to Django (1.0). I looked into the problem and found that adding DEBUG_PROPAGATE_EXCEPTIONS = True to settings.py solved the problem. Tony On Feb 7, 7:46 pm, Devel63 danstic...@gmail.com wrote: We wanted the i18n features (gettext, trans). On Feb 7, 2:43 pm, David Symonds dsymo...@gmail.com wrote: On Sun, Feb 8, 2009 at 4:06 AM, Devel63 danstic...@gmail.com wrote: I'll look into this, but I think one reason we went with 0.96 is that it's already included in GAE, so we don't have to upload any files, have them counted against our file count limit, etc. So why not just use the webapp framework as well, then? Is there something in particular that it doesn't do for you? Dave. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] QueryIterator Error
From 2 two days my applications fall in error in every pages. I don't have modified nothing from 1 week and three days ago my application works correctly.. this is the error log: # 02-08 07:24AM 44.966 / 500 194ms 139ms-cpu 0kb See details 79.50.168.248 - - [08/Feb/2009:07:24:45 -0800] GET / HTTP/1.1 500 104 - - E 02-08 07:24AM 45.081 'Query' object has no attribute '_Query__query_sets' Traceback (most recent call last): File /base/python_lib/versions/1/google/appengine/ext/webapp/ __init__.py, line 498, in __call__ handler.get(*groups) File /base/data/home/apps/sbook/1.331254528912766865/ main.py, line 89, in get tags=Cloud.tagCloud() File /base/data/home/apps/sbook/1.331254528912766865/ main.py, line 173, in tagCloud for q in q1: File /base/python_lib/versions/1/google/appengine/ext/db/ __init__.py, line 1336, in __iter__ return self.run() File /base/python_lib/versions/1/google/appengine/ext/db/ __init__.py, line 1328, in run return _QueryIterator(self._model_class, iter(self._get_query ().Run())) File /base/python_lib/versions/1/google/appengine/ext/db/ __init__.py, line 1547, in _get_query for query_set in self.__query_sets: AttributeError: 'Query' object has no attribute '_Query__query_sets' Thanks --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Again *major* server errors of app engine!
I think our app was running into this issue also. We are using our own django and parts of the appengine helper patch. I would see 500 errors, deadlineexceeded but the exception is thrown in the django, helper or pyamf (in our case we use pyamf to process the requests from a flex/flash client) code which was even before any datastore operations or much else ran. The question is. How do you set it up so that django/helper are cached imports? If you import things in main.py (where our main method is) does that keep things in memory? The docs seem to be pretty light on details about how to do this. -Mike On Feb 8, 3:19 am, conman constantin.christm...@googlemail.com wrote: Davel63, are you also using appengine patch? On 8 Feb., 04:48, Devel63 danstic...@gmail.com wrote: We see the same thing, and just converted to Django. Sounds like it may be related to Django. On Feb 7, 11:09 am, johnP j...@thinkwave.com wrote: No solution - just gathering information. Looking more closely at the logs where the errors occur, the deadline exceeded pops up somewhere while loading and patching django. This started a couple days ago. Maybe it'll go away? Oh well - I'm gonna enjoy the rest of the weekend, and will come back to this on Monday. :) johnP On Feb 7, 10:59 am, conman constantin.christm...@googlemail.com wrote: Yea, I am using appengine patch too and in my logs are a lot deadline exceeded errors which result from request on very simple pages without any datastore operations. But what's the problem? I have the feeling app engine is lagging at this time of the day but that may be a oversimplification... What's your solution to that problem - or are you just igoring it? Constantin On 7 Feb., 19:37, johnP j...@thinkwave.com wrote: I saw similar issues (with a google-issued, non-customized 500 deadline exceeded error). I'm using appengine patch, and saw a large increase in zipimporter calls. It seemed like a large number of requests were reloading the entire Django environment (and maybe doing so more slowly than usual...) which resulted in periodic deadline exceeded errors on very simple pages. Sound possible? johnP On Feb 7, 9:29 am, conman constantin.christm...@googlemail.com wrote: It's happening again!! Our site is not accessible but instead showing a google 500 server error page!!! The whole day everything worked normal but in the early evening (Germany/Europe) or forenoon (PST) the serving of the site is broken again - and I definitively didn't change anything today! Yesterday at the same time of the day app engine had the exact same problem:http://groups.google.com/group/google-appengine/browse_thread/thread/... What's up with that and where can I report this error so someone at google will look into that? Regards, Constantin --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Generating cryptographically strong random numbers
I filed a request for a well-documented cryptographically strong random number generator, or at least a quality entropy source: http://code.google.com/p/googleappengine/issues/detail?id=1055 --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Django 500's and Error Reporting
It didn't work for me, but gave me a clue. As part of experiment, I deleted the DEBUG=True line from settings.py, and the stack trace did start appearing in the Console window. True, it was complaining about not having an error template, but it also showed me the actual cause of the originating error. Progress! Back under the original, correct settings, I stepped through the process of raising an error, and at line 131 in debug.py the system raises an exception while raising an exception. That's why I get the silent 500 failure. On almost anything: missing variable, undefined member function, datastore put missing a required value, etc. In some circumstances it does, work though! Any ideas as to how to get stack traces to show up reliably in the browser, or even just print on the console? On Feb 8, 7:18 am, Tony Andrews crewn...@gmail.com wrote: I ran into this when I ported from webapp to Django (1.0). I looked into the problem and found that adding DEBUG_PROPAGATE_EXCEPTIONS = True to settings.py solved the problem. Tony On Feb 7, 7:46 pm, Devel63 danstic...@gmail.com wrote: We wanted the i18n features (gettext, trans). On Feb 7, 2:43 pm, David Symonds dsymo...@gmail.com wrote: On Sun, Feb 8, 2009 at 4:06 AM, Devel63 danstic...@gmail.com wrote: I'll look into this, but I think one reason we went with 0.96 is that it's already included in GAE, so we don't have to upload any files, have them counted against our file count limit, etc. So why not just use the webapp framework as well, then? Is there something in particular that it doesn't do for you? Dave. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: App engine problems
Again this morning. Here is an interesting log report, showing the Django loading issue (note that it times out without really taking much cpu resources) 1. 02-08 12:03PM 01.519 /hint/request 500 9025ms 672ms-cpu 1kb Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.6) Gecko/ 2009011913 Firefox/3.0.6,gzip(gfe) See details E 02-08 12:03PM 10.534 class 'google.appengine.runtime.DeadlineExceededError': Traceback (most recent call last): File /base/data/home/apps/judysapps/5.331236991686126139/ main.py, line 64, in module main() File /base/data/home/apps/judysapps/5.331236991686126139/ main.py, line 61, in main util.run_wsgi_app(application) File /base/python_lib/versions/1/google/appengine/ext/webapp/ util.py, line 76, in run_wsgi_app result = application(env, _start_response) File /base/python_lib/versions/1/django/core/handlers/ wsgi.py, line 189, in __call__ response = self.get_response(request) File /base/python_lib/versions/1/django/core/handlers/ base.py, line 110, in get_response from django.views import debug File /base/python_lib/versions/1/django/views/debug.py, line 3, in module from django.utils.html import escape File /base/python_lib/versions/1/django/utils/html.py, line 1, in module HTML utilities suitable for global use. On Feb 7, 1:58 am, conman constantin.christm...@googlemail.com wrote: The error report onhttp://code.google.com/status/appengine/detail/serving/2009/02/06#ae-... from yesterday 11:00 am talks about a memcache problem which 'didn't affect the perfomance or uptime of applications' I hope this problem was the reason for the heavy error rate of our application but then this statement is not quite true! But most importantly the problem seems to be solved and everything is back to normal :) Regards, Constantin --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Again *major* server errors of app engine!
And why occurres the error only at some time of the day? On 8 Feb., 18:21, Mike Wesner m...@konsole.net wrote: I think our app was running into this issue also. We are using our own django and parts of the appengine helper patch. I would see 500 errors, deadlineexceeded but the exception is thrown in the django, helper or pyamf (in our case we use pyamf to process the requests from a flex/flash client) code which was even before any datastore operations or much else ran. The question is. How do you set it up so that django/helper are cached imports? If you import things in main.py (where our main method is) does that keep things in memory? The docs seem to be pretty light on details about how to do this. -Mike On Feb 8, 3:19 am, conman constantin.christm...@googlemail.com wrote: Davel63, are you also using appengine patch? On 8 Feb., 04:48, Devel63 danstic...@gmail.com wrote: We see the same thing, and just converted to Django. Sounds like it may be related to Django. On Feb 7, 11:09 am, johnP j...@thinkwave.com wrote: No solution - just gathering information. Looking more closely at the logs where the errors occur, the deadline exceeded pops up somewhere while loading and patching django. This started a couple days ago. Maybe it'll go away? Oh well - I'm gonna enjoy the rest of the weekend, and will come back to this on Monday. :) johnP On Feb 7, 10:59 am, conman constantin.christm...@googlemail.com wrote: Yea, I am using appengine patch too and in my logs are a lot deadline exceeded errors which result from request on very simple pages without any datastore operations. But what's the problem? I have the feeling app engine is lagging at this time of the day but that may be a oversimplification... What's your solution to that problem - or are you just igoring it? Constantin On 7 Feb., 19:37, johnP j...@thinkwave.com wrote: I saw similar issues (with a google-issued, non-customized 500 deadline exceeded error). I'm using appengine patch, and saw a large increase in zipimporter calls. It seemed like a large number of requests were reloading the entire Django environment (and maybe doing so more slowly than usual...) which resulted in periodic deadline exceeded errors on very simple pages. Sound possible? johnP On Feb 7, 9:29 am, conman constantin.christm...@googlemail.com wrote: It's happening again!! Our site is not accessible but instead showing a google 500 server error page!!! The whole day everything worked normal but in the early evening (Germany/Europe) or forenoon (PST) the serving of the site is broken again - and I definitively didn't change anything today! Yesterday at the same time of the day app engine had the exact same problem:http://groups.google.com/group/google-appengine/browse_thread/thread/... What's up with that and where can I report this error so someone at google will look into that? Regards, Constantin --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Again *major* server errors of app engine!
I'm seeing this, too: large number of DeadlineExceededErrors and other errors at the same times of the day, for the past several days. I'm not sure it's related to Django or anything else. We are using Django and pyamf, and the errors will happen anywhere. I think it's just the Django and pyamf have a lot of initialize code to go through, so the errors that happen randomly often happen in there. Does that make sense? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Again *major* server errors of app engine!
We are using Django v0.96, which is included with GAE (so, not the Patch, but not webapp either). Nick Winter's comment could be right ... maybe it's not Django, but Django just has a lot of initialization code. That being said, here's an interesting and common log message that seems to show things hanging in Django initialization (maybe Google got a bad Django binary on some of its servers and they need to clear it out?). 1. 02-08 12:03PM 01.519 /hint/request 500 9025ms 672ms-cpu 1kb Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.6) Gecko/ 2009011913 Firefox/3.0.6,gzip(gfe) See details 2. E 02-08 12:03PM 10.534 class 'google.appengine.runtime.DeadlineExceededError': Traceback (most recent call last): File /base/data/home/apps/judysapps/5.331236991686126139/ main.py, line 64, in module main() File /base/data/home/apps/judysapps/5.331236991686126139/ main.py, line 61, in main util.run_wsgi_app(application) File /base/python_lib/versions/1/google/appengine/ext/webapp/ util.py, line 76, in run_wsgi_app result = application(env, _start_response) File /base/python_lib/versions/1/django/core/handlers/ wsgi.py, line 189, in __call__ response = self.get_response(request) File /base/python_lib/versions/1/django/core/handlers/ base.py, line 110, in get_response from django.views import debug File /base/python_lib/versions/1/django/views/debug.py, line 3, in module from django.utils.html import escape File /base/python_lib/versions/1/django/utils/html.py, line 1, in module HTML utilities suitable for global use. On Feb 8, 1:19 am, conman constantin.christm...@googlemail.com wrote: Davel63, are you also using appengine patch? On 8 Feb., 04:48, Devel63 danstic...@gmail.com wrote: We see the same thing, and just converted to Django. Sounds like it may be related to Django. On Feb 7, 11:09 am, johnP j...@thinkwave.com wrote: No solution - just gathering information. Looking more closely at the logs where the errors occur, the deadline exceeded pops up somewhere while loading and patching django. This started a couple days ago. Maybe it'll go away? Oh well - I'm gonna enjoy the rest of the weekend, and will come back to this on Monday. :) johnP On Feb 7, 10:59 am, conman constantin.christm...@googlemail.com wrote: Yea, I am using appengine patch too and in my logs are a lot deadline exceeded errors which result from request on very simple pages without any datastore operations. But what's the problem? I have the feeling app engine is lagging at this time of the day but that may be a oversimplification... What's your solution to that problem - or are you just igoring it? Constantin On 7 Feb., 19:37, johnP j...@thinkwave.com wrote: I saw similar issues (with a google-issued, non-customized 500 deadline exceeded error). I'm using appengine patch, and saw a large increase in zipimporter calls. It seemed like a large number of requests were reloading the entire Django environment (and maybe doing so more slowly than usual...) which resulted in periodic deadline exceeded errors on very simple pages. Sound possible? johnP On Feb 7, 9:29 am, conman constantin.christm...@googlemail.com wrote: It's happening again!! Our site is not accessible but instead showing a google 500 server error page!!! The whole day everything worked normal but in the early evening (Germany/Europe) or forenoon (PST) the serving of the site is broken again - and I definitively didn't change anything today! Yesterday at the same time of the day app engine had the exact same problem:http://groups.google.com/group/google-appengine/browse_thread/thread/... What's up with that and where can I report this error so someone at google will look into that? Regards, Constantin --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---