[google-appengine] Re: HTTPS pages with some unencrypted information
2009/3/6 OliWeiD oliver.weimar.dr...@googlemail.com: Hi, I have setup some pages in app.yaml with secure: always and some few are getting the following warn message in e.g. Firefox (IE7 is similar): You have requested an encrypted page that contains some unencrypted information. Information that you see or enter on this page could easily be read by a third party. Is there a plug in or something to identify, which elements are unencrypted? Firefox: right click the document background, choose View Page Info, and choose the Media tab. I think this shows everything except for scripts, which you can install Firebug (and enable the Net panel) in order to view. Or a list of hints to check? Thanks in advance Oliver W-D -- It is better to be wrong than to be vague. — Freeman Dyson --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: HTTPS pages with some unencrypted information
On Mar 6, 1:22 am, OliWeiD oliver.weimar.dr...@googlemail.com wrote: Hi, I have setup some pages in app.yaml with secure: always and some few are getting the following warn message in e.g. Firefox (IE7 is similar): You have requested an encrypted page that contains some unencrypted information. Information that you see or enter on this page could easily be read by a third party. Is there a plug in or something to identify, which elements are unencrypted? Or a list of hints to check? Tools-page info-media Look for anything not coming through https. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Windows 7 - can't run appengine sdk
Hi, Here is the full traceback: C:\Users\Chook\Documents\Eclipse\workspace\tvepisodes \serverdev_appserver.py ep ihourtesting2 dir: E:\google_appengine script: E:\google_appengine\google\appengine\tools name: __main__ scipt_name: dev_appserver_main.py script_path: E:\google_appengine\google\appengine\tools \dev_appserver_main.py {'version_tuple': (2, 5), 'SCRIPT_EXCEPTIONS': {'dev_appserver.py': 'dev_appserv er_main.py'}, '__builtins__': module '__builtin__' (built-in), '__file__': 'E: \\google_appengine\\dev_appserver.py', 'script_name': 'dev_appserver_main.py', ' DIR_PATH': 'E:\\google_appengine', 'sys': module 'sys' (built-in), 'SCRIPT_DIR ': 'E:\\google_appengine\\google\\appengine\\tools', 'EXTRA_PATHS': ['E:\\google _appengine', 'E:\\google_appengine\\lib\\django', 'E:\\google_appengine \\lib\\we bob', 'E:\\google_appengine\\lib\\yaml\\lib'], '__name__': '__main__', 'script_p ath': 'E:\\google_appengine\\google\\appengine\\tools\ \dev_appserver_main.py', ' os': module 'os' from 'C:\Python25\lib\os.pyc', '__doc__': 'Convenience wrappe r for starting an appengine tool.'} ['E:\\google_appengine\\dev_appserver.py', 'epihourtesting2'] Traceback (most recent call last): File E:\google_appengine\dev_appserver.py, line 59, in module execfile(script_path, globals()) File E:\google_appengine\google\appengine\tools \dev_appserver_main.py, line 358, in module sys.exit(main(sys.argv)) File E:\google_appengine\google\appengine\tools \dev_appserver_main.py, line 316, in main server = MakeRpcServer(option_dict) File E:\google_appengine\google\appengine\tools \dev_appserver_main.py, line 274, in MakeRpcServer server = appcfg.HttpRpcServer( AttributeError: 'module' object has no attribute 'HttpRpcServer' C:\Users\Chook\Documents\Eclipse\workspace\tvepisodes\server I will try Reinstalling... On Mar 6, 8:13 am, Sumit Bando sumit.ba...@gmail.com wrote: I have been using 1.1.8 on Windows 7 for a month, so your problem is likely something else. Good luck. Sumit On Mar 5, 3:28 pm, David Wilson d...@botanicus.net wrote: Hi Chen, Please post the full text of the traceback you received. Have you tried reinstalling the SDK? Do you by any chance have a module called appengine_rpc anywhere in your application, or sys.path? David. 2009/3/5 Chen Harel chook.ha...@gmail.com: AttributeError: 'module' object has no attribute 'HttpRpcServer' I'm getting this error message while trying dev_appserver.py on a project that is working in vista (Although in vista I used 1.1.7 and now in Windows 7 I use 1.19) Python is 2.5.4 x64 Please assist, what can cause this error -- It is better to be wrong than to be vague. — Freeman Dyson --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Filesize limit not raised from 1MB, with latest SDK
Appcfg.py hasn't upped its limit yet from 1MB (1048576 bytes) yet, on Linux and OS X. In both cases, I have the 1.19 SDK. These files are in a static directory, as defined in the app.yaml, and are all between 1MB-10MB. Is this a known issue, or was I mistaken that the filesize limit is already raised? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: a fundamental increase in App Engine transparency and locality is needed
Interesting. Our app has paying customers, so this week's latencies have been pretty stressful - but I don't agree with you. We have dedicated servers for our old apps, and use Appengine for new ones. When old customers call asking about problems, the world is on my shoulders - I have total responsibility for it, and have to work through the night to resolve the issue. When new customers call, I make sure Google is aware of the issue, and after that I can't do anything about it - Google's engineers work through night instead of me, and in my book that's worth quite a bit. What did I say when customers called this week? The truth, as far as I could tell. The hardware upgrade caused an instability in the datastore, and engineers were working on it. My customers didn't enquire any further, but if they had, I'd have explained that our app is hosted on Google's Appengine, and their engineers were hard at work to resolve the issue. I have a reasonably high regard for my sysadmin skills, but I think informed customers would prefer Google's finest to be working on the issue than little old me. Having said that, I DO have a beef with the lack of feedback during the recent issue, as you'll see from a previous post. Google appear to have taken that on board, saying they will improve this... time will tell. You are correct that we need to tell our customers what is going on, and Google need to give us that information regularly. Bottom line - if you really want to know where your machines are located and the name of the guy running them, talk to Rackspace or some other virtual hosting outfit - or for real control, go for your own machines in colo. I've done all of the above, and for new apps I have decided to cede control - and responsibility - to Google. I'm paying less and sleeping better, but whether this was a good decision depends on whether recent events become the norm... time will tell. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Query latency is not resolved
Don't take my word for it - that was just what I see happening. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Windows 7 - can't run appengine sdk
Reinstalling didn't help, Could this be caused by a Python issue? On Mar 6, 10:59 am, Chen Harel chook.ha...@gmail.com wrote: Hi, Here is the full traceback: C:\Users\Chook\Documents\Eclipse\workspace\tvepisodes \serverdev_appserver.py ep ihourtesting2 dir: E:\google_appengine script: E:\google_appengine\google\appengine\tools name: __main__ scipt_name: dev_appserver_main.py script_path: E:\google_appengine\google\appengine\tools \dev_appserver_main.py {'version_tuple': (2, 5), 'SCRIPT_EXCEPTIONS': {'dev_appserver.py': 'dev_appserv er_main.py'}, '__builtins__': module '__builtin__' (built-in), '__file__': 'E: \\google_appengine\\dev_appserver.py', 'script_name': 'dev_appserver_main.py', ' DIR_PATH': 'E:\\google_appengine', 'sys': module 'sys' (built-in), 'SCRIPT_DIR ': 'E:\\google_appengine\\google\\appengine\\tools', 'EXTRA_PATHS': ['E:\\google _appengine', 'E:\\google_appengine\\lib\\django', 'E:\\google_appengine \\lib\\we bob', 'E:\\google_appengine\\lib\\yaml\\lib'], '__name__': '__main__', 'script_p ath': 'E:\\google_appengine\\google\\appengine\\tools\ \dev_appserver_main.py', ' os': module 'os' from 'C:\Python25\lib\os.pyc', '__doc__': 'Convenience wrappe r for starting an appengine tool.'} ['E:\\google_appengine\\dev_appserver.py', 'epihourtesting2'] Traceback (most recent call last): File E:\google_appengine\dev_appserver.py, line 59, in module execfile(script_path, globals()) File E:\google_appengine\google\appengine\tools \dev_appserver_main.py, line 358, in module sys.exit(main(sys.argv)) File E:\google_appengine\google\appengine\tools \dev_appserver_main.py, line 316, in main server = MakeRpcServer(option_dict) File E:\google_appengine\google\appengine\tools \dev_appserver_main.py, line 274, in MakeRpcServer server = appcfg.HttpRpcServer( AttributeError: 'module' object has no attribute 'HttpRpcServer' C:\Users\Chook\Documents\Eclipse\workspace\tvepisodes\server I will try Reinstalling... On Mar 6, 8:13 am, Sumit Bando sumit.ba...@gmail.com wrote: I have been using 1.1.8 on Windows 7 for a month, so your problem is likely something else. Good luck. Sumit On Mar 5, 3:28 pm, David Wilson d...@botanicus.net wrote: Hi Chen, Please post the full text of the traceback you received. Have you tried reinstalling the SDK? Do you by any chance have a module called appengine_rpc anywhere in your application, or sys.path? David. 2009/3/5 Chen Harel chook.ha...@gmail.com: AttributeError: 'module' object has no attribute 'HttpRpcServer' I'm getting this error message while trying dev_appserver.py on a project that is working in vista (Although in vista I used 1.1.7 and now in Windows 7 I use 1.19) Python is 2.5.4 x64 Please assist, what can cause this error -- It is better to be wrong than to be vague. — Freeman Dyson --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Windows 7 - can't run appengine sdk
Ok, I've installed my old 1.1.7 on a different folder and it works. So this is a 1.1.9 issue. On Mar 6, 11:53 am, Chen Harel chook.ha...@gmail.com wrote: Reinstalling didn't help, Could this be caused by a Python issue? On Mar 6, 10:59 am, Chen Harel chook.ha...@gmail.com wrote: Hi, Here is the full traceback: C:\Users\Chook\Documents\Eclipse\workspace\tvepisodes \serverdev_appserver.py ep ihourtesting2 dir: E:\google_appengine script: E:\google_appengine\google\appengine\tools name: __main__ scipt_name: dev_appserver_main.py script_path: E:\google_appengine\google\appengine\tools \dev_appserver_main.py {'version_tuple': (2, 5), 'SCRIPT_EXCEPTIONS': {'dev_appserver.py': 'dev_appserv er_main.py'}, '__builtins__': module '__builtin__' (built-in), '__file__': 'E: \\google_appengine\\dev_appserver.py', 'script_name': 'dev_appserver_main.py', ' DIR_PATH': 'E:\\google_appengine', 'sys': module 'sys' (built-in), 'SCRIPT_DIR ': 'E:\\google_appengine\\google\\appengine\\tools', 'EXTRA_PATHS': ['E:\\google _appengine', 'E:\\google_appengine\\lib\\django', 'E:\\google_appengine \\lib\\we bob', 'E:\\google_appengine\\lib\\yaml\\lib'], '__name__': '__main__', 'script_p ath': 'E:\\google_appengine\\google\\appengine\\tools\ \dev_appserver_main.py', ' os': module 'os' from 'C:\Python25\lib\os.pyc', '__doc__': 'Convenience wrappe r for starting an appengine tool.'} ['E:\\google_appengine\\dev_appserver.py', 'epihourtesting2'] Traceback (most recent call last): File E:\google_appengine\dev_appserver.py, line 59, in module execfile(script_path, globals()) File E:\google_appengine\google\appengine\tools \dev_appserver_main.py, line 358, in module sys.exit(main(sys.argv)) File E:\google_appengine\google\appengine\tools \dev_appserver_main.py, line 316, in main server = MakeRpcServer(option_dict) File E:\google_appengine\google\appengine\tools \dev_appserver_main.py, line 274, in MakeRpcServer server = appcfg.HttpRpcServer( AttributeError: 'module' object has no attribute 'HttpRpcServer' C:\Users\Chook\Documents\Eclipse\workspace\tvepisodes\server I will try Reinstalling... On Mar 6, 8:13 am, Sumit Bando sumit.ba...@gmail.com wrote: I have been using 1.1.8 on Windows 7 for a month, so your problem is likely something else. Good luck. Sumit On Mar 5, 3:28 pm, David Wilson d...@botanicus.net wrote: Hi Chen, Please post the full text of the traceback you received. Have you tried reinstalling the SDK? Do you by any chance have a module called appengine_rpc anywhere in your application, or sys.path? David. 2009/3/5 Chen Harel chook.ha...@gmail.com: AttributeError: 'module' object has no attribute 'HttpRpcServer' I'm getting this error message while trying dev_appserver.py on a project that is working in vista (Although in vista I used 1.1.7 and now in Windows 7 I use 1.19) Python is 2.5.4 x64 Please assist, what can cause this error -- It is better to be wrong than to be vague. — Freeman Dyson --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] What's wrong with this??
Using django templates, I am creating a very simple web application. Everything goes well the only problem that I am facing is that the html page is rendered but with no css applied on it no formatting appears. The page appears as a very simple html with no formatting at all. When i double click on the respective html then it displayes with complete formatting and relevant styles. I have also added a url: /media static_dir: /templates/media the media folder contains all the arwork [css files, images] used in the template html files What is going wrong here? Thanks Arnie --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Converting model objects to JSON
Hi all, Quick question about converting model objects in JSON. Have done some reading and I can't find a way to use simplejson to serialize model objects because the data types don't support it. What is the best way to convert a model to json? Thanks. -- The secret impresses no-one, the trick you use it for is everything - Alfred Borden (The Prestiege) --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Converting model objects to JSON
check this http://deron.meranda.us/python/comparing_json_modules/ you will have to stuck with a pure python library On Fri, Mar 6, 2009 at 1:28 PM, Devraj Mukherjee dev...@gmail.com wrote: Hi all, Quick question about converting model objects in JSON. Have done some reading and I can't find a way to use simplejson to serialize model objects because the data types don't support it. What is the best way to convert a model to json? Thanks. -- The secret impresses no-one, the trick you use it for is everything - Alfred Borden (The Prestiege) --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: What's wrong with this??
I think setting Template directory to static is the issue here, static content will not be handled by Django. On Fri, Mar 6, 2009 at 12:48 PM, arnie parvez...@rediffmail.com wrote: Using django templates, I am creating a very simple web application. Everything goes well the only problem that I am facing is that the html page is rendered but with no css applied on it no formatting appears. The page appears as a very simple html with no formatting at all. When i double click on the respective html then it displayes with complete formatting and relevant styles. I have also added a url: /media static_dir: /templates/media the media folder contains all the arwork [css files, images] used in the template html files What is going wrong here? Thanks Arnie --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: cooperate with top Google Apps Engine developer
I'm offering my services ! paid of course :) On Thu, Mar 5, 2009 at 3:30 PM, dalenewman dalenew...@gmail.com wrote: Alex, You should use oDesk ( www.odesk.com ) for this. One catch though -- you'll have to pay the developers :-) Dale www.bookdope.com --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: cooperate with top Google Apps Engine developer
Im available through odesk for work such as this already, only catch is limited time for completion before I would no longer be available. Jeremy On Fri, 2009-03-06 at 14:07 +0200, Amr Ellafi wrote: I'm offering my services ! paid of course :) On Thu, Mar 5, 2009 at 3:30 PM, dalenewman dalenew...@gmail.com wrote: Alex, You should use oDesk ( www.odesk.com ) for this. One catch though -- you'll have to pay the developers :-) Dale www.bookdope.com --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine +unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~--- signature.asc Description: This is a digitally signed message part
[google-appengine] Get deployed app version at runtime?
Is there any possibility to get full application version at runtime (not only major version from app.yaml)? I'm thinking of making memcache keys versioned by something that changes on every deployment and the app version seems to be obvious choice... Cheers J. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: What's wrong with this??
I have moved the media folder [that contains all css, images etc] out of the templates directory still the same problem now my app.yaml is like this handlers: - url: /media static_dir: media --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Get deployed app version at runtime?
On Mar 6, 1:00 pm, Jarek Zgoda jarek.zg...@gmail.com wrote: Is there any possibility to get full application version at runtime (not only major version from app.yaml)? I'm thinking of making memcache keys versioned by something that changes on every deployment and the app version seems to be obvious choice... You can look at the current directory. See http://groups.google.com/group/google-appengine/browse_thread/thread/548debabf6285f9/245b47e68e860452#245b47e68e860452 --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: a fundamental increase in App Engine transparency and locality is needed
It's an interesting issue...I think we're all happy for things to behave pretty much like a black box when stuff is working as it's meant to, but are we so happy with that when things aren't working? Personally I don't need to know who specifically is responsible for the machines my apps run on, to be able to contact them directly etc. And I don't think that's really a viable option. However, I agree more feedback on causes and fix schedules when things go south would be good, along with frequent updates. I think 'naming and shaming' Google on infrastructure let downs, on your app, would be an option for you too, to lay the responsibility with Google. Significant issues, particularly on popular apps with decent visibility, are surely embarassing for Google given their reputation. Serving them a dose of that embarassment by telling your visitors 1) we're Google's infrastructure, 2) they're having problems right now, would probably give Google more incentive to avoid repetition of these issues.. :) If a number of popular apps were frequently reporting issues with Google, word about that would get around. From listening to talks from GAE folk though, I get the impression stability is of paramount importance..so I'm hopeful issues like those recently will be exceptions. On Mar 6, 2:24 am, dsw daniel.wilker...@gmail.com wrote: I have long wanted to build apps on Google App Engine and have learned a lot about it in preparation for doing so. However the one problem is if I have a customer and their app goes down for an hour and they call me and say what happened? and how can we prevent that in the future? my only response will be I don't know and we can't. These are unacceptable answers. If you want App Engine to cross the chasm and become really for real then at the very least what you need to do is provide the kind of depth of sight into your infrastructure that you the Google engineers have. Further you need some kind of locality in the cloud: it would help if there were some way of ensuring reliability by knowing that (1) I have bought space on some particular cluster of machines (2) which is now stable and more apps are not being added to it; I should know (3) who is maintaining that cluster and (4) be able to send them a trouble ticket and (5) have some idea of what is wrong and how long it is going to take them to fix it. This opaque cloud utility of compute stuff is a fantasy: some locality and transparency will be needed or App Engine will never be really for real. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Get deployed app version at runtime?
J You can retrieve it using the method on this page http://code.google.com/appengine/docs/python/runtime.html Near the bottom is the code needed HTH Steve -Original Message- From: google-appengine@googlegroups.com [mailto:google-appeng...@googlegroups.com] On Behalf Of Jarek Zgoda Sent: Friday, March 06, 2009 8:01 AM To: Google App Engine Subject: [google-appengine] Get deployed app version at runtime? Is there any possibility to get full application version at runtime (not only major version from app.yaml)? I'm thinking of making memcache keys versioned by something that changes on every deployment and the app version seems to be obvious choice... Cheers J. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: What's wrong with this??
I have moved the media folder [that contains all css, images etc] out of the templates directory still the same problem now my app.yaml is like this handlers: - url: /media static_dir: media --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Query latency is not resolved
I agree, the latency is higher than last week before the upgradre. One of my handler is still 1k ms-cpu higher. Regards On Mar 6, 10:45 am, GregF g.fawc...@gmail.com wrote: Don't take my word for it - that was just what I see happening. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: What's wrong with this??
How are you linking your css in you template? probably something messed up there.Did you checked the html source generated and verified the css link is working by directly accessing it? cheers gipsy On Fri, Mar 6, 2009 at 7:49 AM, arnie parvez...@rediffmail.com wrote: I have moved the media folder [that contains all css, images etc] out of the templates directory still the same problem now my app.yaml is like this handlers: - url: /media static_dir: media -- cheers Gipsy --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: What's wrong with this??
Most likely you are missing a '/' in front of the css link like '/media/yourcss.css' versus 'media/yourcss.css' On Fri, Mar 6, 2009 at 8:05 AM, Gipsy Gopinathan gipsy.ra...@gmail.comwrote: How are you linking your css in you template? probably something messed up there.Did you checked the html source generated and verified the css link is working by directly accessing it? cheers gipsy On Fri, Mar 6, 2009 at 7:49 AM, arnie parvez...@rediffmail.com wrote: I have moved the media folder [that contains all css, images etc] out of the templates directory still the same problem now my app.yaml is like this handlers: - url: /media static_dir: media -- cheers Gipsy -- cheers Gipsy --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Are entities returned by value or by reference?
Hello, In my code I have two variables that point to an entity that is the result of some query. I then modify some of the properties using one of the variables and then call put() on that variable. These changes do not propagate to the 2nd variable that was pointing to that entity. This leads me to believe that these are just copies of the underlying datastore record and not references. Is this correct? What's the best practice when it comes to things like this? i.e., I have a session variable that is a datastore entity with all the user's info. Some parts of my site may make changes to this entity and update the datastore, but the session entity does not see these changes unless I re-query the datastore. Thanks. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Get deployed app version at runtime?
Thank you. On 6 Mar, 14:45, Steve Robillard steverobill...@gmail.com wrote: J You can retrieve it using the method on this pagehttp://code.google.com/appengine/docs/python/runtime.html Near the bottom is the code needed HTH Steve -Original Message- From: google-appengine@googlegroups.com [mailto:google-appeng...@googlegroups.com] On Behalf Of Jarek Zgoda Sent: Friday, March 06, 2009 8:01 AM To: Google App Engine Subject: [google-appengine] Get deployed app version at runtime? Is there any possibility to get full application version at runtime (not only major version from app.yaml)? I'm thinking of making memcache keys versioned by something that changes on every deployment and the app version seems to be obvious choice... Cheers J. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Random 502 errors
Hi, I saw the post saying that all the issues were resolved only a little latency issues remain.. But this is no the case for my application I have be getting random 502 (Bad Gateway errors) from the get go.. Now the frequency for these errors have gone up At the time of this post I was not able to get any request through to a particular page in my app (the function in this page was added recently, if that has anything to do with the issue). Any help or follow-up will be greatly appreciated. There is another similar scheduled update on Monday (I am keeping my fingers crossed for this one). Thanks, Arun Shanker Prasad. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Query latency is not resolved
Another thing : even the Dashboard is slower. And since this morning it is more and more slow, particularly when you click on the '+' in the log. On Mar 6, 2:56 pm, Sylvain sylvain.viv...@gmail.com wrote: I agree, the latency is higher than last week before the upgradre. One of my handler is still 1k ms-cpu higher. Regards On Mar 6, 10:45 am, GregF g.fawc...@gmail.com wrote: Don't take my word for it - that was just what I see happening. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: query vs filter()
I don't know what you mean about running a loop of filter calls, but something like Class.all().filter().filter()... is very efficient. My impression is that the GQL interpretation is slightly more expensive, but that the difference is negligible. Note that the call to the data store does not occur until you actually issue the fetch or get ... and this is what's really expensive. On Mar 5, 4:44 pm, pedepy paul.ro...@gmail.com wrote: is there any difference in performance to use a single query call (like in, WHERE prop = value AND prop = value, etc vs running a loop of filter() calls and then executing the query ? seems to me that if you can build your query all in one shot, you can avoid one or many loop(s) in your code ... but everyone seems to be all about using all().filter() these days .. help? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: cooperate with top Google Apps Engine developer
On Mar 6, 12:30 am, dalenewman dalenew...@gmail.com wrote: Alex, You should use oDesk (www.odesk.com) for this. One catch though -- you'll have to pay the developers :-) ... if you can call $2/hr getting payed. oDesk is a joke. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Datastore Timeouts ( large amount of data per row )
I understand that there have been recent problems with latency with regards to the datastore. I am not sure if it is the app engine environment that is the problem or if is my app. I am consistently getting datastore timeouts for certain querys. My app is storing farely large image files ~500KB each in the datastore. Since I want my user to by upload images files dynamically, putting them in the datastore seems to be the only way of doing this. I have around 80 images in the datastore currently. I looked into only fetch'ing() a certain limit at a time and then incrementing offset however the datastore still fetch's a constant number of rows from the datastore. Is there anyway around this problem ( or perhaps a better way of handling this ). --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: pytz and astimezone
I am no where near 1000 files. Adam Tistler 1(732)718-2631 atist...@gmail.com On Mar 6, 2009, at 1:59 AM, Tim Hoffman wrote: HI The main thing to watch is the number of files in the fill pytz distribution, if you software stack also has a lot fo files you find youself over the 1000 file limit T On Mar 6, 9:17 am, Stephen Judd judd.step...@gmail.com wrote: I downloaded it and import it for Mashical.com without a problem. It probably adds some overhead at startup, but it's an invaluable utility if your dealing with multiple timezones. Steve On Thu, Mar 5, 2009 at 6:34 PM, Tim Hoffman zutes...@gmail.com wrote: Hi You can't probably can't just download and include it with your project as it has too many files in the module. Have a look at this. http://takashi-matsuo.blogspot.com/2008/07/using-zipped-pytz-on-gae.html Rgds T On Mar 6, 6:29 am, andrew andrew.r...@gmail.com wrote: Any idea on how to include it with appengine? On Mar 5, 3:59 am, Tim Hoffman zutes...@gmail.com wrote: pytz isn't included with python or gae, you will need to get the package from pypi T On Mar 5, 10:34 am, andrew andrew.r...@gmail.com wrote: I was able to convert the datetime timezone from the datastore to EST by following thehttp://timezones.appspot.com/ for example: event.date = event.date.replace(tzinfo=TZINFOS ['utc']) event.date = event.date.astimezone(TZINFOS ['est']) This works great, however I noticed that EST is hardcoded to UTC-5: def utcoffset(self, dt): return datetime.timedelta(hours=-5) So when spring rolls around and we are in daylight savings, I'm going to have to update the code to UTC-4, or my time will be off by an hour. It seems that pytz would solve this problem but I couldn't figure out how to import it into my application. I tried import pytz but got error type 'exceptions.ImportError': No module named pytz Any suggestions? Thanks --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] How to read URL path values as parameter
I wanted to use http://xyz.appspot.com/process/chicago/il URL instead of http://xyz.appspot.com/process?city=chicagostate=il How do I convert these path values as GET parameters? Thanks! --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Are entities returned by value or by reference?
In my code I have two variables that point to an entity that is the result of some query. How do you get those two variables? Did you do: v1 = {some query/get} v2 = v1 or v1 = {some query/get} v2 = {some query/get} In the first case, v1 and v2 are pointing to the same db.Model instance. Changing something via v1 will be visible via v2 (as long as you don't assign to either v1 or v2). In the second case, v1 and v2 are pointing to different db.Model instances. Changing something via v1 will not change the instance pointed to by v2. Be sure that you understand why I'm writing db.Model instance and not datastore entity. Queries and db.get copy datastore entities into db.Model instances which you can then manipulate. Put copies db.Model instances into the datastore as entities. It's important to realize that entities and db.Model instances can change independently of one another. On Mar 6, 6:58 am, solidus e.smolens...@gmail.com wrote: Hello, In my code I have two variables that point to an entity that is the result of some query. I then modify some of the properties using one of the variables and then call put() on that variable. These changes do not propagate to the 2nd variable that was pointing to that entity. This leads me to believe that these are just copies of the underlying datastore record and not references. Is this correct? What's the best practice when it comes to things like this? i.e., I have a session variable that is a datastore entity with all the user's info. Some parts of my site may make changes to this entity and update the datastore, but the session entity does not see these changes unless I re-query the datastore. Thanks. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: How to read URL path values as parameter
You have (at least) 2 options: 1) Use the regexp in webapp to extract them, ie, your URL mapping: (/process/([^/]+)/([^/]+),MyProcessHandler), ... Then MyProcessHandler.get() will get called with two extra arguments, one set to each of the groups in the regexp 2) Parse path_info yourself. It's handed in as part of the webapp at self.request.path_info On Mar 6, 10:04 am, kshah kunal.software.engin...@gmail.com wrote: I wanted to usehttp://xyz.appspot.com/process/chicago/il URL instead ofhttp://xyz.appspot.com/process?city=chicagostate=il How do I convert these path values as GET parameters? Thanks! --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: HTTPS pages with some unencrypted information
As my pages are still very simple, there was no media tab within Tools- page info, but some maybe-useful stuff in the page info, thanks for the hint. Also working with the firebug hasn't found me the error. I even had a file without javascript, where I had the issue. And within the comparison with pages without that issue I found it: the css file and the javascript file are coming from a static directory, after a secure: always into the app.yaml the error has vanished. thanks for the hints nevertheless, I've learnd more about firefox today ;-) On 6 Mrz., 09:08, bd_ bdon...@gmail.com wrote: On Mar 6, 1:22 am, OliWeiD oliver.weimar.dr...@googlemail.com wrote: Hi, I have setup some pages in app.yaml with secure: always and some few are getting the following warn message in e.g. Firefox (IE7 is similar): You have requested an encrypted page that contains some unencrypted information. Information that you see or enter on this page could easily be read by a third party. Is there a plug in or something to identify, which elements are unencrypted? Or a list of hints to check? Tools-page info-media Look for anything not coming through https. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: accepting user url link as input and making it a clickable link
an understandable trivial example with pure gae (no additional django patch needed just a recent sdk): .py: path = os.path.join(os.path.dirname(__file__), 'directory', 'detail.html') a='www.google.com' self.response.out.write(template.render(path, {'a':a, ...othervariables detail.html: {{a|urlize}} urlize should be no problem provided the variable's value with the link is set. it will complete. regards Niklas Stockholm On Mar 6, 7:03 pm, thebrianschott schott.br...@gmail.com wrote: Andrew and Niklas, I only now got around to trying the Django {{urlize}} b/c I just read these replies. I incorrectly thought I had asked replies to come to my email, so I did not notice your replies earlier. {{urlize}} messed up my SDK version of the app, but that may be because I have not upgraded my SDK for a couple of months. I'll try again later. What happened is the application just slowed to a halt and after a long delay (20 minutes?) it finally finished without having urlized. Brian in Atlanta --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: a fundamental increase in App Engine transparency and locality is needed
This is a very interesting thread. And yes, indeed, cluster stability and uptime and transparency are all of the utmost importance to us here on the App Engine team. I also agree that a fundamental increase in transparency would serve everyone's interests. As far as I can tell, transparency through a crisis occurs in one of three ways: (a) direct communication, (b) broadcasts of pr-approved messages, and (c) raw data. As an engineer, I like (c) more than (a) or (b). It's objective, and it can be distributed more efficiently. It's more efficient than (b) because we don't have to wordsmith it or get it reviewed and approved, it just goes out immediately. It's more efficient than (a) because it happens automatically; you don't take up the time of an engineer who would otherwise be busy trying to solve the problem. This is why our team has made it a priority to be very transparent about real time and detailed performance data with our Status Site: http://code.google.com/status/appengine. I encourage everyone who cares about their application to spend a bit of time learning that site. Make sure to click through to the detailed graphs as well. Further, if there is more data you would like us to export, then let us know. It is in everyone's best interests for us to export more raw data. It is my personal belief that by continuing to iterate and improve upon our Status Site that we will achieve the fundamental increase in transparency, as opposed to Daniel's proposal of dedicated hardware, direct communication, and promises as to when problems will be fixed. Although, Daniel does bring up the excellent point that there is not a particularly efficient way for developers to report live production problems other than this group. Any thoughts on systems that we should look into here to make this more efficient? Jon On Fri, Mar 6, 2009 at 9:25 AM, johnP j...@thinkwave.com wrote: My experience has shown that customers are generally OK with a response: There is a problem. We are aware of it and people are working on it. It is estimated to be resolved in X time. So if we (as vendors) are able to act as a positive PR army for AppEngine, we need to be quickly armed with the data necessary to accurately answer the above questions. If vendors (on the front lines of PR Triage) don't have this data, a blame-game will start. No, we have no %$#$% idea what's wrong. No - those #$$#^%$ are not saying anything. Etc. So far, I'd say the following. Google has been almost good about keeping the information flowing. There have been periods of 'radio silence'; and the official status report usually reports that There has been an anomaly but we have determined that nobody was affected (am I a nobody?). But overall, they have responded. And have resolved issues. And have upgraded the product. And in the end, have built something really special. And I agree with Greg about sleeping at night. johnP On Mar 6, 5:42 am, peterk peter.ke...@gmail.com wrote: It's an interesting issue...I think we're all happy for things to behave pretty much like a black box when stuff is working as it's meant to, but are we so happy with that when things aren't working? Personally I don't need to know who specifically is responsible for the machines my apps run on, to be able to contact them directly etc. And I don't think that's really a viable option. However, I agree more feedback on causes and fix schedules when things go south would be good, along with frequent updates. I think 'naming and shaming' Google on infrastructure let downs, on your app, would be an option for you too, to lay the responsibility with Google. Significant issues, particularly on popular apps with decent visibility, are surely embarassing for Google given their reputation. Serving them a dose of that embarassment by telling your visitors 1) we're Google's infrastructure, 2) they're having problems right now, would probably give Google more incentive to avoid repetition of these issues.. :) If a number of popular apps were frequently reporting issues with Google, word about that would get around. From listening to talks from GAE folk though, I get the impression stability is of paramount importance..so I'm hopeful issues like those recently will be exceptions. On Mar 6, 2:24 am, dsw daniel.wilker...@gmail.com wrote: I have long wanted to build apps on Google App Engine and have learned a lot about it in preparation for doing so. However the one problem is if I have a customer and their app goes down for an hour and they call me and say what happened? and how can we prevent that in the future? my only response will be I don't know and we can't. These are unacceptable answers. If you want App Engine to cross the chasm and become really for real then at the very least what you need to do is provide the kind of depth of sight into your infrastructure that you the Google engineers have. Further
[google-appengine] Latency problem still really a problem
Our app is still experiencing at least double the latency as compared to last week and the app is basically unusable. I'm really concerned about this since the GAE team has stated that the latency issue has been resolved. This is so disappointing if the current performance is considered to be fine. I'm really hoping that this isn't the case. I'm curious as to how you are testing latency internally? Perhaps the tests aren't reflecting very well some real world scenarios and that some combination of datastore operations are particularly onerous. In any case, latency is still much much worse than before the server maintenance. P.S. also getting random 502 errors which I assume is related to this issue: http://groups.google.com/group/google-appengine/browse_thread/thread/391a6ecc2febfc22/f43d82010fb1b598 --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: a fundamental increase in App Engine transparency and locality is needed
Jon, I think we'd all agree that an automatically published report is better than a), or b). However, because there's Secret Sauce running behind App Engine, surely a myriad of infrastructure details that you'll never be allowed to publish detailed data on, c) will also probably never be enough. Or, well, I'll ask the question: what infrastructure was involved in the most recent maintenance, and what about its performance characteristics changed? Measuring/publishing various reports that we all *could* generate ourselves *is* helpful, but what of the behind the scenes stuff that can break? Based on increases in latency, I could come up with all kinds of explanations (I've worked with Hadoop for a number of years, so I know of the general types of odd conditions that come up with a cluster of machines attempting to work in concert but managed by failure-tolerant software). Did a network switch fail that caused a large fraction of the DataStore nodes to become unreachable? If so, would you ever be willing to publish switch performance analytics as part of the App Engine health status? Or, more generally, was it something misconfigured or that just doesn't perform as well as predicted? If misconfigured, can it be hot-updated, or is another downtime necessary to repair the mistake? The discussion of dedicated clusters does bring up a related question: Google apparently does have some cluster update process, as evidenced by the way features roll out to different users of Gmail at different rates. I assume, based on everything we've been (not) told about AppEngine, that AppEngine is essentially running as one single instance of whatever granularity Gmail and similar apps are maintained at Google. Could it be split into several? Then, presumably, maintenance and upgrade periods could be scheduled somewhat independently for different pools. Ok, enough conjecture on my part. My point is, I think a PR-sanitized message is going to still be necessary unless you guys truly disclose the inner workings of the infrastructure that provides AppEngine, which seems unlikely to ever completely happen. -Bryan On Mar 6, 2:37 pm, Jon McAlister jon...@google.com wrote: This is a very interesting thread. And yes, indeed, cluster stability and uptime and transparency are all of the utmost importance to us here on the App Engine team. I also agree that a fundamental increase in transparency would serve everyone's interests. As far as I can tell, transparency through a crisis occurs in one of three ways: (a) direct communication, (b) broadcasts of pr-approved messages, and (c) raw data. As an engineer, I like (c) more than (a) or (b). It's objective, and it can be distributed more efficiently. It's more efficient than (b) because we don't have to wordsmith it or get it reviewed and approved, it just goes out immediately. It's more efficient than (a) because it happens automatically; you don't take up the time of an engineer who would otherwise be busy trying to solve the problem. This is why our team has made it a priority to be very transparent about real time and detailed performance data with our Status Site:http://code.google.com/status/appengine. I encourage everyone who cares about their application to spend a bit of time learning that site. Make sure to click through to the detailed graphs as well. Further, if there is more data you would like us to export, then let us know. It is in everyone's best interests for us to export more raw data. It is my personal belief that by continuing to iterate and improve upon our Status Site that we will achieve the fundamental increase in transparency, as opposed to Daniel's proposal of dedicated hardware, direct communication, and promises as to when problems will be fixed. Although, Daniel does bring up the excellent point that there is not a particularly efficient way for developers to report live production problems other than this group. Any thoughts on systems that we should look into here to make this more efficient? Jon On Fri, Mar 6, 2009 at 9:25 AM, johnP j...@thinkwave.com wrote: My experience has shown that customers are generally OK with a response: There is a problem. We are aware of it and people are working on it. It is estimated to be resolved in X time. So if we (as vendors) are able to act as a positive PR army for AppEngine, we need to be quickly armed with the data necessary to accurately answer the above questions. If vendors (on the front lines of PR Triage) don't have this data, a blame-game will start. No, we have no %$#$% idea what's wrong. No - those #$$#^%$ are not saying anything. Etc. So far, I'd say the following. Google has been almost good about keeping the information flowing. There have been periods of 'radio silence'; and the official status report usually reports that There has been an anomaly but we have determined that nobody was affected (am I a nobody?). But
[google-appengine] Re: a fundamental increase in App Engine transparency and locality is needed
Jon, I agree and would add that publishing raw data would also require some educational resource for those of us who are not network or system engineers Steve -Original Message- From: google-appengine@googlegroups.com [ mailto:google-appengine@googlegroups.com mailto:google-appeng...@googlegroups.com] On Behalf Of Bryan A. Pendleton Sent: Friday, March 06, 2009 3:17 PM To: Google App Engine Subject: [google-appengine] Re: a fundamental increase in App Engine transparency and locality is needed Jon, I think we'd all agree that an automatically published report is better than a), or b). However, because there's Secret Sauce running behind App Engine, surely a myriad of infrastructure details that you'll never be allowed to publish detailed data on, c) will also probably never be enough. Or, well, I'll ask the question: what infrastructure was involved in the most recent maintenance, and what about its performance characteristics changed? Measuring/publishing various reports that we all *could* generate ourselves *is* helpful, but what of the behind the scenes stuff that can break? Based on increases in latency, I could come up with all kinds of explanations (I've worked with Hadoop for a number of years, so I know of the general types of odd conditions that come up with a cluster of machines attempting to work in concert but managed by failure-tolerant software). Did a network switch fail that caused a large fraction of the DataStore nodes to become unreachable? If so, would you ever be willing to publish switch performance analytics as part of the App Engine health status? Or, more generally, was it something misconfigured or that just doesn't perform as well as predicted? If misconfigured, can it be hot-updated, or is another downtime necessary to repair the mistake? The discussion of dedicated clusters does bring up a related question: Google apparently does have some cluster update process, as evidenced by the way features roll out to different users of Gmail at different rates. I assume, based on everything we've been (not) told about AppEngine, that AppEngine is essentially running as one single instance of whatever granularity Gmail and similar apps are maintained at Google. Could it be split into several? Then, presumably, maintenance and upgrade periods could be scheduled somewhat independently for different pools. Ok, enough conjecture on my part. My point is, I think a PR-sanitized message is going to still be necessary unless you guys truly disclose the inner workings of the infrastructure that provides AppEngine, which seems unlikely to ever completely happen. -Bryan On Mar 6, 2:37 pm, Jon McAlister jon...@google.com wrote: This is a very interesting thread. And yes, indeed, cluster stability and uptime and transparency are all of the utmost importance to us here on the App Engine team. I also agree that a fundamental increase in transparency would serve everyone's interests. As far as I can tell, transparency through a crisis occurs in one of three ways: (a) direct communication, (b) broadcasts of pr-approved messages, and (c) raw data. As an engineer, I like (c) more than (a) or (b). It's objective, and it can be distributed more efficiently. It's more efficient than (b) because we don't have to wordsmith it or get it reviewed and approved, it just goes out immediately. It's more efficient than (a) because it happens automatically; you don't take up the time of an engineer who would otherwise be busy trying to solve the problem. This is why our team has made it a priority to be very transparent about real time and detailed performance data with our Status Site:http://code.google.com/status/appengine. I encourage everyone who cares about their application to spend a bit of time learning that site. Make sure to click through to the detailed graphs as well. Further, if there is more data you would like us to export, then let us know. It is in everyone's best interests for us to export more raw data. It is my personal belief that by continuing to iterate and improve upon our Status Site that we will achieve the fundamental increase in transparency, as opposed to Daniel's proposal of dedicated hardware, direct communication, and promises as to when problems will be fixed. Although, Daniel does bring up the excellent point that there is not a particularly efficient way for developers to report live production problems other than this group. Any thoughts on systems that we should look into here to make this more efficient? Jon On Fri, Mar 6, 2009 at 9:25 AM, johnP j...@thinkwave.com wrote: My experience has shown that customers are generally OK with a response: There is a problem. We are aware of it and people are working on it. It is estimated to be resolved in X time. So if we (as vendors) are able to act as a positive PR army for AppEngine, we
[google-appengine] Re: Initializing datastore with binary data
I have no idea why I'm getting errors when I do: import helloworld from google.appengine.ext import db entries = helloworld.Greeting.all().order(-date).fetch(10) and my app.yaml contains: - url: /remote_api script: $PYTHON_LIB/google/appengine/ext/remote_api/handler.py login: admin The dev_appserver gives this error: INFO 2009-03-06 20:51:38,287 dev_appserver_index.py] Updating / home/wikid/Code/google_appengine_v2/caribbeanvisit/index.yaml INFO 2009-03-06 20:51:50,570 dev_appserver.py] POST /remote_api? HTTP/1.1 404 - Here's the error: Traceback (most recent call last): File console, line 1, in module File /home/wikid/Code/google_appengine_v2/google/appengine/ext/db/ __init__.py, line 1390, in fetch raw = self._get_query().Get(limit, offset) File /home/wikid/Code/google_appengine_v2/google/appengine/api/ datastore.py, line 942, in Get return self._Run(limit, offset)._Next(limit) File /home/wikid/Code/google_appengine_v2/google/appengine/api/ datastore.py, line 1536, in _Next apiproxy_stub_map.MakeSyncCall('datastore_v3', 'Next', req, result) File /home/wikid/Code/google_appengine_v2/google/appengine/api/ apiproxy_stub_map.py, line 68, in MakeSyncCall apiproxy.MakeSyncCall(service, call, request, response) File /home/wikid/Code/google_appengine_v2/google/appengine/api/ apiproxy_stub_map.py, line 240, in MakeSyncCall stub.MakeSyncCall(service, call, request, response) File /home/wikid/Code/google_appengine_v2/google/appengine/ext/ remote_api/remote_api_stub.py, line 169, in MakeSyncCall handler(request, response) File /home/wikid/Code/google_appengine_v2/google/appengine/ext/ remote_api/remote_api_stub.py, line 207, in _Dynamic_Next 'remote_datastore', 'RunQuery', request, query_result) File /home/wikid/Code/google_appengine_v2/google/appengine/ext/ remote_api/remote_api_stub.py, line 135, in MakeSyncCall request_pb.Encode())) File /home/wikid/Code/google_appengine_v2/google/appengine/tools/ appengine_rpc.py, line 303, in Send f = self.opener.open(req) File /usr/lib/python2.5/urllib2.py, line 387, in open response = meth(req, response) File /usr/lib/python2.5/urllib2.py, line 498, in http_response 'http', request, response, code, msg, hdrs) File /usr/lib/python2.5/urllib2.py, line 425, in error return self._call_chain(*args) File /usr/lib/python2.5/urllib2.py, line 360, in _call_chain result = func(*args) File /usr/lib/python2.5/urllib2.py, line 506, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) HTTPError: HTTP Error 404: Not Found On Mar 4, 9:18 am, Nick Johnson arach...@notdot.net wrote: You can do what you want with remote_api and a little custom code. See the article here:http://code.google.com/appengine/articles/remote_api.html -Nick Johnson On Mar 4, 3:04 am, Pavel Byles pavelby...@gmail.com wrote: Is there a way to initialize thedatastorewith binary data to be stored in a blob field (without using a form)? I have tried putting the data into a CSV file and uploading it using bulkloader, but that didn't seem to work. Any help would be appreciated. -- -Pav --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Query latency is not resolved
For me things like Add a new entity result in timeout errors in the dashboard. On Mar 6, 10:50 am, Sylvain sylvain.viv...@gmail.com wrote: Another thing : even the Dashboard is slower. And since this morning it is more and more slow, particularly when you click on the '+' in the log. On Mar 6, 2:56 pm, Sylvain sylvain.viv...@gmail.com wrote: I agree, the latency is higher than last week before the upgradre. One of my handler is still 1k ms-cpu higher. Regards On Mar 6, 10:45 am, GregF g.fawc...@gmail.com wrote: Don't take my word for it - that was just what I see happening. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Datastore Timeouts ( large amount of data per row )
For me even fetching 1-2 entities can be too many and cause a Timeout. It seems to depend on the complexity of the query. I recommend you don't do any queries until the issues are resolved: just fetch entities by key. That still works just fine. On Mar 6, 1:32 am, gobagoo atist...@gmail.com wrote: I understand that there have been recent problems with latency with regards to the datastore. I am not sure if it is the app engine environment that is the problem or if is my app. I am consistently getting datastore timeouts for certain querys. My app is storing farely large image files ~500KB each in the datastore. Since I want my user to by upload images files dynamically, putting them in the datastore seems to be the only way of doing this. I have around 80 images in the datastore currently. I looked into only fetch'ing() a certain limit at a time and then incrementing offset however the datastore still fetch's a constant number of rows from the datastore. Is there anyway around this problem ( or perhaps a better way of handling this ). --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Transcript: App Engine chat time March 4
good chat! sorry i missed it. i have a few comments, inline: On Mar 5, 11:27 am, Marzia Niccolai ma...@google.com wrote: [7:05pm] amichail: How to fix an index that is stuck on Building? ... [7:06pm] marzia_google: if an index has been in building more than 24 hours you will need to send an email to the group and someone will be able to fix it more info: http://code.google.com/appengine/articles/index_building.html http://code.google.com/appengine/docs/python/datastore/queriesandindexes.html#Big_Entities_and_Exploding_Indexes [7:19pm] Kardax: Ok, next question: we have db.run_in_transaction; is there a chance of getting a db.run_in_snapshot? [7:20pm] Kardax: I'd like to be able to read an entity group from a consistant state without the overhead of a transaction. db.run_in_transaction() actually adds very little extra overhead. for read-only transactions, all it adds is a single disk seek to read the timestamp of the entity group's log header. that read will always be smaller than any of get(), and more importantly for latency, it's only a single disk seek, as opposed to queries, which take multiple disk seeks. given that, i'd recommend using db.run_in_transaction(). you should only see minimal performance impact. [7:19pm] dankles: Q: What (if any) progress / plans are there on reducing Datastore CPU usage? [7:22pm] marzia_google: @dankles there isn't anything specific to report wrt to datastore cpu we've actually made a number of solid improvements to datastore CPU in the last couple months, both to how much CPU we actually use and to the accuracy of our measurements. having said that, one useful thing to note is that CPU is a broad category. along with pure CPU, it also includes the cost of disk accesses, particularly disk seeks, which are slow (relative to pure CPU and in-memory operations) and expensive. [7:27pm] dankles: Q: Not sure if this has come up... Any plans to offer/parter with CDN, so a few lines in app.yaml could push a directory of static assets out for efficient serving? ... [7:30pm] dankles: @angerman: but GAE isn't really well suited for being a CDN [7:33pm] dankles: @angerman : a good CDN has servers all over the world, serving each user from the closest edge, and optimized for low bandwidth costs, static assets... GAE design goals were different, as it clusters around itself + Datastore, etc. that's true for serving dynamic requests, but static files aren't subject to those constraints. you'll probably find that static files served through app engine are already fairly efficient and low latency, regardless of where you are in the world, and we expect that to get even better in the future. of course, no need to take our word for it. you can always measure yourself and compare to other CDNs, or look at a few of the blog posts and threads on the group that have already done that. [7:35pm] Kardax: Another question: How big can an entity group be before problems are encountered (besides concurrency)? What's the definitiion of big? What problems are seen? [7:36pm] marzia_google: with entity groups, the biggest issues is contention [7:36pm] marzia_google: since writes to an entity group happen serially [7:37pm] marzia_google: so an entity group is too 'big', i would say, when it can't reasonably handle the number of writes to the group ... [7:38pm] Kardax: I'm more concerned with physical size limitations... for example, if I can make reasonably sure that contention will be low, but it could have 10's of thousands of entities in size, is that going to work? marzia's absolutely right here. there isn't really any meaningful limit to entity group size, either bytes or number of entities. the main thing entity groups limit is write throughput, not size. [7:55pm] angerman: marzia_google: could you publish a list of successfull/high traffic app-engine apps? definitely! http://code.google.com/appengine/casestudies.html --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Transcript: App Engine chat time March 4
On Mar 6, 3:09 pm, ryan ryanb+appeng...@google.com wrote: db.run_in_transaction() actually adds very little extra overhead. for read-only transactions, all it adds is a single disk seek to read the timestamp of the entity group's log header. that read will always be smaller than any of get(), and more importantly for latency, it's only a single disk seek, as opposed to queries, which take multiple disk seeks. another way to phrase this is, if you only do reads inside db.run_in_transaction(), it effectively already is run_in_snapshot(). it provides the read a consistent snapshot functionality with the minimum possible overhead. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Latency problem still really a problem
They said it has been stabilized. But I agree, it is still much worse. The timeouts are the real problem; it's just impossible to complete certain operations. On Mar 6, 3:05 pm, cz czer...@gmail.com wrote: Our app is still experiencing at least double the latency as compared to last week and the app is basically unusable. I'm really concerned about this since the GAE team has stated that the latency issue has been resolved. This is so disappointing if the current performance is considered to be fine. I'm really hoping that this isn't the case. I'm curious as to how you are testing latency internally? Perhaps the tests aren't reflecting very well some real world scenarios and that some combination of datastore operations are particularly onerous. In any case, latency is still much much worse than before the server maintenance. P.S. also getting random 502 errors which I assume is related to this issue:http://groups.google.com/group/google-appengine/browse_thread/thread/... --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Problem with bulkloader.py and Google Apps account.
Hi. I have appengine application, that supports authorization only for users of domain xxx (google apps for domains). I tried to use bulkloader. So, if i install remote_key hook in app.yaml like in manual (http:// code.google.com/appengine/docs/python/tools/uploadingdata.html), i've 500 error in logs. bulkloader haven't even ask me about login/ password. I've removed line admin: yes from app.yaml and tried again. Bulkloader asked me about login/password. I've typed such login/ passowrd which i type when deploy application. In Logs i've 401 error. So, is there no remote_key support in applications, that connected to google apps for domain authorization? I need to upload a lot of data to my real app What can i do? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Random 502 errors
Hi, Thanks Marzia for the response. I took a look the log and did some debugging and found that I was getting the deadline exceeded error. But my operations were fairly simple, although there was a couple of DB hits and a memcahce hit, but this put me over the limit. I think maybe the latency issues are making the response time higher than usual. Thanks for the find and I have modified my code accordingly. And the post you pointed to was made last month, any progress on the ETA? or a work around? Thanks, Arun Shanker Prasad. On Mar 6, 11:42 pm, Marzia Niccolai ma...@google.com wrote: Hi, If you are serving off a Google Apps domain, you are likely seeing the same issue as this thread:http://groups.google.com/group/google-appengine/browse_thread/thread/... Our team is looking investigating this issue, thank you for your patience. -Marzia On Fri, Mar 6, 2009 at 7:32 AM, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, I saw the post saying that all the issues were resolved only a little latency issues remain.. But this is no the case for my application I have be getting random 502 (Bad Gateway errors) from the get go.. Now the frequency for these errors have gone up At the time of this post I was not able to get any request through to a particular page in my app (the function in this page was added recently, if that has anything to do with the issue). Any help or follow-up will be greatly appreciated. There is another similar scheduled update on Monday (I am keeping my fingers crossed for this one). Thanks, Arun Shanker Prasad. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] In appgallery, my Application disapear or removed: www.gceel.com
Hello app engine, I am the owner of www.gceel.com application which was registered last month in appgallery. And this application was 5 stared by the Editor. But today, I found my application could not be found in appgallery. Is my application removed ? Could you tell me the reason? Thanks! --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Go2 is going to pay the bill. Go2 accepts donation now. Any cooperation is welcome.
Go2 is the second popular app on GAE. Go2 is very fast. Sometimes it is faster than you visiting the website directly. Go2 also supports to sign in lots of web sites, including bebo etc. . There are more than 10,000 visitors from all over the world using Go2 every day. And the number is increasing every day. According to the google's new policy, the free bandwidth of the app will be changed from 20G(10G in and 10G out) to 1G after May 25th, 2009. The extra bandwidth must be purchased. 1G bandwidth is not enough for Go2. We estimate that Go2 will consume more than 100G bandwidth per day after May 25th, 2009. In order to continue providing the Go2's free service to the world, Go2 is going to pay the bill, which is about $360 per month (100G*$0.12/G*30). Now the go2's advertising income is about $120 per month, which is not enough to pay the bill. So please donate to Go2, let Go2 continue providing the excellent service to people all over the world who need it. Any cooperation is also welcome. go2.appspot.com Appendix A. Go2 is the second popular app on GAE. See the report of alexa. The data is at the bottom of the page http://www.alexa.com/data/details/traffic_details/appspot.com . B. Who are using Go2? The top 20 countries or regions are: 1China 2United Kingdom 3United States 4Norway 5Colombia 6Australia 7Canada 8India 9Saudi Arabia 10Hong Kong 11Russia 12Philippines 13Brazil 14Ireland 15Mexico 16Ghana 17Netherlands 18France 19Japan 20Germany (Data from Google Analytics) --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: How to do this?
It is still very confusing as I am not able to point out what to do Let me explain my problem in more detail I have to create a django template based web application that includes a home page with a login section and a new user sign-up link. When a new user visits the sight for the first time then he chooses the new user sign-up link that consissts of there step registration process step1.html step2.html step3.html In step1.html form asks the user for the most basic info like firstname, lastname, address etc. Then step2 and step3.html fiels asks for other related info. My problem is that how should I persist user information across multiple pages. I do not want to store the information in datastore for persisting user information It seems to me that I have to use cookie based sessions but does not get any idea how tostart. Can anybody tell me the steps that i need to use in order to manage data persistency across multiple pages Thanks --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Query latency is not resolved
I've checked the errors in the Dashboard for my app this morning and I've got many Datastore Timeout that didn't occurs last week. So, I think there is still an issue there. Regards On 7 mar, 00:05, Brandon Thomson gra...@gmail.com wrote: For me things like Add a new entity result in timeout errors in the dashboard. On Mar 6, 10:50 am, Sylvain sylvain.viv...@gmail.com wrote: Another thing : even the Dashboard is slower. And since this morning it is more and more slow, particularly when you click on the '+' in the log. On Mar 6, 2:56 pm, Sylvain sylvain.viv...@gmail.com wrote: I agree, the latency is higher than last week before the upgradre. One of my handler is still 1k ms-cpu higher. Regards On Mar 6, 10:45 am, GregF g.fawc...@gmail.com wrote: Don't take my word for it - that was just what I see happening. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Basic Python GSQL Question..
Hi guys, I'm trying to put together a list of various objects. There are about 5 different classes of objects I need to put in the list then iterate through. It looks like this: class Stuff(db.Model): something= db.StringProperty() class Object_A(Stuff): pass class Object_B(Stuffl): pass object_a = db.GqlQuery(SELECT * FROM GroupA+ ORDER BY timestamp ASC LIMIT 200) object_b = db.GqlQuery(SELECT * FROM GroupB+ ORDER BY timestamp ASC LIMIT 200) Both a and b inherit from the same class and are very similar. What I need is to be able to put these in a list then iterate through the list like... for object in list: object.something = this the problem is that when I try to set something it gives me errors. When however I just do objects a or objects b by themselves its fine. Any pointers on how to create that list? Thanks in advance, -d --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Datastore errors, timeouts, general difficulties
I created a simple page that simply instantiates and stores a model with about 9 primitive properties. The model is filled with the same data each time, and that data is less than 100 bytes. I don't have indices on any of the properties. I did some load tests, storing approximately half a million of the objects at most. Some of the tests were done during the recent latency problems. Some were done after latency was stabilized. All tests with significant concurrency (50) generated fairly high timeout and quota exceeded error rates. So, I got significant log spew. My total data size should be around 50 megs of real user data. Today, my data usage jumped from about 0.5% of my data storage limit to 67% of my data storage limit without any intervening tests. That was surprising since that's about 10x what I really should be using. But, I figured that data limit might count all replicas or something odd. And, perhaps there's a latency between the data store and the data size calculation. So, I wrote a delete all page that deletes 50 items, then redirects to itself, to delete the next 50. I just delete the first 50 items returned. I'm not paging or anything. The script works locally. I ran that delete page for a while, periodically getting annoying timeouts and quota exceeded. I did not run the page in parallel. Now that I'm using 99% of my data storage limit. I'm afraid I may have to buy data storage before I can delete more items. Any ideas? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Datastore errors, timeouts, general difficulties
That should read, after deleting, I'm now using 99% of my data storage limit with no additional puts. On Mar 6, 6:00 pm, Jonathan Ultis jonathan.ul...@gmail.com wrote: I created a simple page that simply instantiates and stores a model with about 9 primitive properties. The model is filled with the same data each time, and that data is less than 100 bytes. I don't have indices on any of the properties. I did some load tests, storing approximately half a million of the objects at most. Some of the tests were done during the recent latency problems. Some were done after latency was stabilized. All tests with significant concurrency (50) generated fairly high timeout and quota exceeded error rates. So, I got significant log spew. My total data size should be around 50 megs of real user data. Today, my data usage jumped from about 0.5% of my data storage limit to 67% of my data storage limit without any intervening tests. That was surprising since that's about 10x what I really should be using. But, I figured that data limit might count all replicas or something odd. And, perhaps there's a latency between the data store and the data size calculation. So, I wrote a delete all page that deletes 50 items, then redirects to itself, to delete the next 50. I just delete the first 50 items returned. I'm not paging or anything. The script works locally. I ran that delete page for a while, periodically getting annoying timeouts and quota exceeded. I did not run the page in parallel. Now that I'm using 99% of my data storage limit. I'm afraid I may have to buy data storage before I can delete more items. Any ideas? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---