[google-appengine] Re: Error in quota usage
Hi Vignesh, I imagine that what is happening is that the quota usage throughout the day tended to overestimate your actual quota usage. When we calculate billing amounts for the day we recalculate resource usage so the quota numbers will sometimes go down (especially if your app has certain behavior patterns). I see this most often in the storage quota. If you wouldn't mind sharing your app ID I can take a closer look. Thank you, Jeff On Mon, Aug 31, 2009 at 8:19 PM, Vignesh wrote: > > My app is currently using around 40% CPU every day and I have also > used up around 46% data storage, > Today suddenly my quotas got reset in the middle of the day and with > just 4 hours remaining its only showing 4% CPU usage, around 70 mails > have been sent and it is showing only 6 mails. More importantly my > data storage is down to 37%, should I be worried about lost data. How > do I deal this issue, please advice > > Thank you > > > --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Performance of site seems much slower after maintenance.
Hello, My application (ID: jacob-6) seems to be performing worse after the maintenance of yesterday. I have not made any significant changes that would affect performance to this degree, but I definitely see a change since yesterday. Requests are taking much longer and is unpredictable. For example, look at the following two requests. Both for the exact same information, doing the exact same processing. The times are very close since I ran the request manually. The first took much longer to process. 09-02 06:56PM 13.604 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 329ms 385cpu_ms 151api_cpu_ms 09-02 06:55PM 51.014 /project/topactions/ agdqYWNvYi02cg4LEgdQcm9qZWN0GOoHDA? milestone_id=agdqYWNvYi02chALEglNaWxlc3RvbmUY4zYM 200 1508ms 1240cpu_ms 151api_cpu_ms This behavior is happening across all my requests. I'll try it from a different network connection when I go home tonight. Maybe this has something to do with it. Any ideas? My app went from pretty snappy to pretty slow overnight. Barry --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: 30 Max simultaneous requests (maxThreads)?
On Sep 2, 4:25 pm, "Brandon N. Wirtz" wrote: > > Is anyone actually hitting Thread limit errors? Or is this just a typical > I'm going to be the next Facebook OMG Google won't work for this when I get > to 1.2m active users guess I should build my own server in my basement > because it will be better, sort of naval gazing that I face with PMs and > SysArc's on a regular basis? You can't break the speed of light with a Jet > Engine either, but its still over kill for my soapbox derby car. > Some engineers prefer to try to anticipate the problems they may run into rather than wait until the wings fall off their plane in midflight. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: About uploading data with appcfg.py
Ping... Any help would be greatly appreciated. -Shri On Sep 1, 11:37 pm, ShriJ wrote: > Hi, > > I have a problem while uploading data using appcfg.py. > > I have a file named videoloader.py which has the definition of the > following classes: > > class Videos(db.Expando): > ... > > class VideoLoader(bulkload.Loader): > def __init__(self): > ... > > loaders = [VideoLoader] > > So the same file has the class definitions of class Videos and > VideoLoader. > When I run appcfg.py with the upload_data option: > $ python appcfg.py upload_data --config_file=videoloader.py -- > filename=data.csv --kind=Videos myVideoApp > > I get the following error: > > Traceback (most recent call last): > File "appcfg.py", line 60, in > run_file(__file__, globals()) > File "appcfg.py", line 57, in run_file > execfile(script_path, globals_) > File "/home/new_google_appengine/google_appengine/google/appengine/ > tools/appcfg.py", line 2453, in > main(sys.argv) > File "/home/new_google_appengine/google_appengine/google/appengine/ > tools/appcfg.py", line 2444, in main > result = AppCfgApp(argv).Run() > File "/home/new_google_appengine/google_appengine/google/appengine/ > tools/appcfg.py", line 1605, in Run > self.action(self) > File "/home/new_google_appengine/google_appengine/google/appengine/ > tools/appcfg.py", line 2332, in __call__ > return method() > File "/home/new_google_appengine/google_appengine/google/appengine/ > tools/appcfg.py", line 2221, in PerformUpload > run_fn(args) > File "/home/new_google_appengine/google_appengine/google/appengine/ > tools/appcfg.py", line 2131, in RunBulkloader > sys.exit(bulkloader.Run(arg_dict)) > File "/home/new_google_appengine/google_appengine/google/appengine/ > tools/bulkloader.py", line 3581, in Run > return _PerformBulkload(arg_dict) > File "/home/new_google_appengine/google_appengine/google/appengine/ > tools/bulkloader.py", line 3439, in _PerformBulkload > loader = Loader.RegisteredLoader(kind) > File "/home/new_google_appengine/google_appengine/google/appengine/ > tools/bulkloader.py", line 2406, in RegisteredLoader > return Loader.__loaders[kind] > KeyError: 'Videos' --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Datastore question
Hello, I am a newbie to Datastore. Here's what I am trying to accomplish: Trying to set an "Unowned" one-to-many relationship between 2 objects. (I chose "unowned" because I wasn't sure if I could have an "owned" many-to-many. Also wasn't sure if "lazy loading" is available for the children. Is "owned" the recommended way?) Anyway, I have a *Parent *class in which I have this... @Persistent private Set children = new HashSet(); In the *Child *class I have this... @Persistent private Key parent = null; I am doing the following: 1) Create a Parent.. This worked. The parent.getId() gives me the Id. 2) While creating a child, I want to attach the child to parent, so I tried several variations such as this: String parentId = parent.getId().toString(); child.setParent(KeyFactory.stringToKey(parentd)); This is NOT working. What's the best way to do this? 3) Also, I need to put the key of child into Parent. As per, Max Ross' presentation at Google I/O this doesn't work in the same transaction. Has that issue been fixed? Is there any tutorial available that shows this? Any help in this regard will be greatly appreciated. Thanks. - Ajay --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Problem with filling sms issue
If the waitlist SMS issues form redirects you to the applications overview, then it sounds like your account can now create applications. Cheers, Jeff On Mon, Aug 31, 2009 at 2:15 AM, Sergey Okhotny wrote: > > I'm trying to fill this form "If you are unable to verify your account > using SMS, please fill out the this form" (https:// > appengine.google.com/waitlist/sms_issues) > But after authorizing it redirects me to create application form. > > > > --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: 30 Max simultaneous requests (maxThreads)?
I'm not sure that would be acceptable in the Terms of Most Search engines... And many of the search engines are likely going to start blocking GAE traffic... But for arguments sake let's say you are using API's and it was allowed. Because you are building say a Price Engine powered by Amazon and Buy.com and 28 others. I have done a similar project already. Caching. 80% of your queries will be for 20% of the terms as such new queries will take 2 seconds (your number), old queries will take 85ms. With 80% cache hit you will have an average page served time of 468ms. To reduce this you would do predictive searches. (Crawling :-) ) Precaching terms you expect to see. Which could take you to 95% cache hits and closer to 90ms average response time. -Brandon Wirtz -Original Message- From: google-appengine@googlegroups.com [mailto:google-appeng...@googlegroups.com] On Behalf Of ted stockwell Sent: Wednesday, September 02, 2009 1:59 PM To: Google App Engine Subject: [google-appengine] Re: 30 Max simultaneous requests (maxThreads)? On Sep 2, 2:34 pm, "Brandon N. Wirtz" wrote: > What would you need all those threads for in a web App? If you were > crunching DNA, or calculating the path of particles from the big bang that > would make sense... > When you make an asynchronous URLFetch call does each asynchronous call to URLFetch count as a separate thread??? Suppose I want to write an app that will aggregate the search results from 30 different search engines (that's not an unrealistic real-life scenario, lots of things have to be done asynchrounously). Suppose each call to a search engine takes 1 second. Suppose I make 30 aynchronous calls to each search engine. It'll take 2 seconds for each request (cause I blew pass my thread limit on the 30th async call so I'll have to wait an extra second for that last request). And now I can only handle one user every second. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Getting java.lang.NoClassDefFoundError
Hi James, I came across the same problem but the solution was simple: Check, if you are currentliy running the newest version of your app. At the top left of your app engine account/dashboard there is "Application: " and next to it there is a dropdown menu with your versions (or under Administration > Versions). If you uploaded a new version, your engine did not start using the newest. You have to tell your engine what version you want to be online. Hope this helps ... did I read the tutorial too fast or didn't anyone tell me that new versions are not automatically set? (still, good feature NOT using the lastest as greatest) Regards Norbert --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: 30 Max simultaneous requests (maxThreads)?
And there is a form you can fill out to have your request per second limit increased if that is a need. http://code.google.com/support/bin/request.py?contact_type=AppEngineCPUReque st Just explain why you need more resources and they will be granted. Even 100k people showing up with in a 5 minute time frame is only 333 requests a second. You should have a hard time hitting the 500 QPQ limit. Also you can round robin portions of your cycles by putting a request proxy ahead of your large app so that you are less restricted by these already generous limits. Is anyone actually hitting Thread limit errors? Or is this just a typical I'm going to be the next Facebook OMG Google won't work for this when I get to 1.2m active users guess I should build my own server in my basement because it will be better, sort of naval gazing that I face with PMs and SysArc's on a regular basis? You can't break the speed of light with a Jet Engine either, but its still over kill for my soapbox derby car. -Brandon Wirtz -Original Message- From: google-appengine@googlegroups.com [mailto:google-appeng...@googlegroups.com] On Behalf Of Jeff Enderwick Sent: Wednesday, September 02, 2009 12:40 PM To: google-appengine@googlegroups.com Subject: [google-appengine] Re: 30 Max simultaneous requests (maxThreads)? There are application domains that spike severely. One example is AAA for corporate environments. There are large companies on the planet where *everyone* comes to work @ 8am +/-10min and logs in. Just one example from a prior life... --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Opera login to App Engine application
Has anyone been able to log into their app engine application using Opera? When I try to login, Google authenticates ok (doc.google.com shows the correct user data) but the page never redirects. Also, when I try to manually redirect and jump to my appspot.com page after the "failed" login it doesn't show me as being logged in. When I test using the app engine SDK, I can log in and get redirect to the correct page using Opera. So: 1. the authentication works in Opera 2. the authentication and redirect to docs.google.com works in Opera 3. the test SDK app engine application works in Opera. Any ideas? Thanks, Tim ps. using Opera 10 but 9.5 didn't work either. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: 30 Max simultaneous requests (maxThreads)?
On Sep 2, 2:34 pm, "Brandon N. Wirtz" wrote: > What would you need all those threads for in a web App? If you were > crunching DNA, or calculating the path of particles from the big bang that > would make sense... > When you make an asynchronous URLFetch call does each asynchronous call to URLFetch count as a separate thread??? Suppose I want to write an app that will aggregate the search results from 30 different search engines (that's not an unrealistic real-life scenario, lots of things have to be done asynchrounously). Suppose each call to a search engine takes 1 second. Suppose I make 30 aynchronous calls to each search engine. It'll take 2 seconds for each request (cause I blew pass my thread limit on the 30th async call so I'll have to wait an extra second for that last request). And now I can only handle one user every second. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Problem with authentication services
Silly question, you were logged in to one of the Google Apps Accounts you specified in the Config? Did you check the error log in the dash board? That would be helpful information to have in trouble shooting your issue. -Brandon Wirtz -Original Message- From: google-appengine@googlegroups.com [mailto:google-appeng...@googlegroups.com] On Behalf Of Dario Sent: Wednesday, September 02, 2009 11:24 AM To: Google App Engine Subject: [google-appengine] Problem with authentication services Hi all, I created a Java application on Google App Engine using authentication services. I tested both using hard coding and using the web.xml file approaches. First I configured an App Engine application to "allow anyone with a Google Account" and authentication did work. But when I configured an App Engine application as "restrict to a Google Apps Account" then authentication did not work, giving always a 500 error. Someone can help me? Thanks Dario --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Problem with authentication services
Hi all, I created a Java application on Google App Engine using authentication services. I tested both using hard coding and using the web.xml file approaches. First I configured an App Engine application to "allow anyone with a Google Account" and authentication did work. But when I configured an App Engine application as "restrict to a Google Apps Account" then authentication did not work, giving always a 500 error. Someone can help me? Thanks Dario --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Using Twitter4j in AppEngine
Do a few calls, but enough people are doing twitter stuff from the Google IP's that much like the Yahoo Pipe Issues AppEngine Users have faced Twitter routinely hits the API throttles even with the pool of IPs. Not to mention you have "jerks" like me who are using AppEngine as an API caching Proxy so that multiple applications of mine can make calls to an API and Duplicate requests don't burn my API key limits. But I have to gracefully handle the "500" or request limit exceeded errors from Amazon, Yahoo, Goog, and others when I hit those limits. -Brandon Wirtz -Original Message- From: google-appengine@googlegroups.com [mailto:google-appeng...@googlegroups.com] On Behalf Of Mark Sent: Wednesday, September 02, 2009 1:14 PM To: Google App Engine Subject: [google-appengine] Re: Using Twitter4j in AppEngine Hi all, Was integration of twitter4j and app engine successful? I was about to start doing this myself and just saw this recent post activity. If it works, I'm wondering how twitter will work with the API rate limits? They say 150 requests per hour per IP, but if the code is being run on GAE, will it appear as coming from multiple IPs? Thanks --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: delete application
You can't. http://code.google.com/p/googleappengine/issues/detail?id=335&q=delete%20application&colspec=ID%20Type%20Status%20Priority%20Stars%20Owner%20Summary%20Log%20Component On Sep 2, 8:45 am, nasrul hanapi wrote: > How do I delete an applications? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: app instance is completely broken, DeadlineExceededError
Actually I did have two versions of my application. Both of them went down, including the production version that hadn't been updated in nearly a week. It was never a problem with my code; the problem is quite clearly with google's infrastructure, although I'm willing to be proven wrong. I uploaded my code (both production and latest) to a new application instance by changing the app.yaml file and it ran perfectly. I pulled out all datastore touches from the code on the broken instance to see if that was the issue, it wasn't. If you look at the stack traces they appear to be happening during module import, not during my application running. I do appreciate the input though, it is good advice. On Sep 2, 8:40 pm, "Brandon N. Wirtz" wrote: > > Google, how am I supposed to run a business on this platform? > > That is why there is versioning. Upload to one version, test that it works, > push the button to change the default version. > > Always have two copies of your application, so you don't risk corrupting > your live data. > > Make sure you only have one guy with the rights to deploy to your primary > app so that a momentary lapse in Yaml configuration doesn't bork your site. > > "With Great power comes great responsibility" :-) so make sure that when > leveraging the Power of the Goog, you don't break the baby, cause it can be > a real pain if your have 100 megs of application and screw it up, cause it's > kind of slow to put back. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Using Twitter4j in AppEngine
Hi all,
Was integration of twitter4j and app engine successful? I was about to
start doing this myself and just saw this recent post activity.
If it works, I'm wondering how twitter will work with the API rate
limits? They say 150 requests per hour per IP, but if the code is
being run on GAE, will it appear as coming from multiple IPs?
Thanks
On Aug 30, 1:54 pm, "Alessandro Loche"
wrote:
> I answered your question in a previuos post. If you use getSession(true)
> you'll create a new session. You should pass false or no argument to method,
> instead.
>
> --
> From: "Stream"
> Sent: Sunday, August 30, 2009 1:51 PM
> To: "Google App Engine"
> Subject: [google-appengine] Re: UsingTwitter4jin AppEngine
>
>
>
> > I advanced on this a bit... you just need to have the server generate
> > the request url... then pass that back to the client... let the client
> > click on that and authenticate... that will cause twitter to redirect
> > to your site... (you'll need to edit your host file if you are testing
> > locally... since twitter only redirects to valid url's)
>
> > Now I am stuck on how to persist data across requests. I tried using
> > the session state, however the object isn't being persisted across
> > requests ... perhaps because the twitter callback is considered a new
> > session? a bug in app engine?
>
> > This is how i write:
> > this.getThreadLocalRequest().getSession(true).setAttribute
> > ("RequestToken", requestToken);
>
> > This is how i read:
> > RequestToken requestToken = (RequestToken)this.getThreadLocalRequest
> > ().getSession(true).getAttribute("RequestToken");
>
> > anyone know whats wrong?
>
> > On Aug 24, 11:12 pm, Some Dude wrote:
> >> Same here. I am completely confused on how to usetwitter4j+ app engine
> >> + gwt!
>
> >> Anyone?
>
> >> On Sunday, August 23, 2009, Jeune wrote:
>
> >> > Hi all!
>
> >> > Has anyone of you tried usingtwitter4jin appengine? I am a bit stuck
> >> > and the code examples on their website isn't helping me very much at
> >> > all. I am struggling to find a way to use it using servlets etc
> >> > because the code examples are in a main method.
>
> >> > I delineate my problem more in a post I made here:
> >> >http://stackoverflow.com/questions/1318840/right-way-to-use-twitter4j...
>
> >> > Any insight would be greatly appreciated!
>
> >> > Thanks!
>
>
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---
[google-appengine] Re: 30 Max simultaneous requests (maxThreads)?
There are application domains that spike severely. One example is AAA for corporate environments. There are large companies on the planet where *everyone* comes to work @ 8am +/-10min and logs in. Just one example from a prior life... On Wed, Sep 2, 2009 at 12:34 PM, Brandon N. Wirtz wrote: > > What would you need all those threads for in a web App? If you were > crunching DNA, or calculating the path of particles from the big bang that > would make sense... > > But if your App completes a request in less than 3 seconds, you would still > be able to server 10 users a second, 600 users a minute, 864k requests a > day. > > If having 3 threads sped this up to 1 second, the math would work out to the > same number of request potentials. > > Do to the CPU time limits on a task, it is unlikely you would want 2000 > threads because you'd burn through your Cycle limit just setting up those > threads. > > I'm assuming from the Smiley after your comment about Cranking up the max > threads, that you THINK you are doing something clever. In all likely > unless you are doing some super computing apps on a CPU(s) with enough cores > to support that number of threads you are just wasting cycles in thread > management, and time slicing. > > -Brandon Wirtz > > -Original Message- > From: google-appengine@googlegroups.com > [mailto:google-appeng...@googlegroups.com] On Behalf Of Adligo > Sent: Tuesday, September 01, 2009 5:34 PM > To: Google App Engine > Subject: [google-appengine] 30 Max simultaneous requests (maxThreads)? > > > Hi, > > I am developing a app (or more than one) that I would like to host > on Google App Engine, however the architecture of the app involves > cranking up the maxThreads (I am using my home grown hosting which now > has Tomcat set to 2,000 maxThreads :) ). > > For example (1 six+ year old machine in my basement) > http://zeuhl.adligo.com/gwt_util_demo_v3_1/GwtDemo.html?show_log=true > > > > > --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: app instance is completely broken, DeadlineExceededError
> Google, how am I supposed to run a business on this platform? That is why there is versioning. Upload to one version, test that it works, push the button to change the default version. Always have two copies of your application, so you don't risk corrupting your live data. Make sure you only have one guy with the rights to deploy to your primary app so that a momentary lapse in Yaml configuration doesn't bork your site. "With Great power comes great responsibility" :-) so make sure that when leveraging the Power of the Goog, you don't break the baby, cause it can be a real pain if your have 100 megs of application and screw it up, cause it's kind of slow to put back. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: 30 Max simultaneous requests (maxThreads)?
What would you need all those threads for in a web App? If you were crunching DNA, or calculating the path of particles from the big bang that would make sense... But if your App completes a request in less than 3 seconds, you would still be able to server 10 users a second, 600 users a minute, 864k requests a day. If having 3 threads sped this up to 1 second, the math would work out to the same number of request potentials. Do to the CPU time limits on a task, it is unlikely you would want 2000 threads because you'd burn through your Cycle limit just setting up those threads. I'm assuming from the Smiley after your comment about Cranking up the max threads, that you THINK you are doing something clever. In all likely unless you are doing some super computing apps on a CPU(s) with enough cores to support that number of threads you are just wasting cycles in thread management, and time slicing. -Brandon Wirtz -Original Message- From: google-appengine@googlegroups.com [mailto:google-appeng...@googlegroups.com] On Behalf Of Adligo Sent: Tuesday, September 01, 2009 5:34 PM To: Google App Engine Subject: [google-appengine] 30 Max simultaneous requests (maxThreads)? Hi, I am developing a app (or more than one) that I would like to host on Google App Engine, however the architecture of the app involves cranking up the maxThreads (I am using my home grown hosting which now has Tomcat set to 2,000 maxThreads :) ). For example (1 six+ year old machine in my basement) http://zeuhl.adligo.com/gwt_util_demo_v3_1/GwtDemo.html?show_log=true --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: app instance is completely broken, DeadlineExceededError
I'm seeing the same with our app.
On Sep 2, 7:46 pm, Kenneth wrote:
> Hi,
>
> I appear to have completely broken my application instance. If I
> upload the application into another instance it runs correctly, but
> I'm only seeing deadline exceeded errors in the instance that has my
> data. On the client side I just see a blank page after 30 seconds.
>
> I've cleared out my cookies, pulled out all my middleware, pulled out
> all my urls except my home page and changed that to:
>
> def home(request):
> return http.HttpResponse('hello world')
>
> If anyone has any suggestions on how to debug this problem I'd love to
> hear them.
>
> The exceptions change every time but here's a sample:
>
> #
>
> 1.
> 09-02 10:20AM 01.322 / 500 31421ms 1315cpu_ms 0kb Mozilla/5.0
> (Windows; U; Windows NT 6.1; en-GB; rv:1.9.1.2) Gecko/20090729 Firefox/
> 3.5.2 (.NET CLR 3.5.30729),gzip(gfe)
> See details
>
> - - [02/Sep/2009:10:20:32 -0700] "GET / HTTP/1.1" 500 0 -
> "Mozilla/5.0 (Windows; U; Windows NT 6.1; en-GB; rv:1.9.1.2) Gecko/
> 20090729 Firefox/3.5.2 (.NET CLR 3.5.30729),gzip(gfe)"
> "easyschooladmin.appspot.com"
>
> 2.
> E 09-02 10:20AM 32.706
>
> :
> Traceback (most recent call last):
> File "/base/data/home/apps/easyschooladmin/
> 1.336057423874075874/django_bootstrap.py", line 64, in
> main()
> File "/base/data/home/apps/easyschooladmin/
> 1.336057423874075874/django_bootstrap.py", line 61, in main
> util.run_wsgi_app(application)
> File "/base/python_lib/versions/1/google/appengine/ext/webapp/
> util.py", line 76, in run_wsgi_app
> result = application(env, _start_response)
> File "/base/python_lib/versions/third_party/django-1.0/django/
> core/handlers/wsgi.py", line 239, in __call__
> response = self.get_response(request)
> File "/base/python_lib/versions/third_party/django-1.0/django/
> core/handlers/base.py", line 128, in get_response
> return self.handle_uncaught_exception(request, resolver,
> exc_info)
> File "/base/python_lib/versions/third_party/django-1.0/django/
> core/handlers/base.py", line 141, in handle_uncaught_exception
> from django.core.mail import mail_admins
> File "/base/python_lib/versions/third_party/django-1.0/django/
> core/mail.py", line 5, in
> import mimetypes
>
> #
>
> 1.
> 09-02 10:44AM 24.212 / 500 29251ms 1455cpu_ms 0kb Mozilla/4.0
> (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR
> 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC
> 6.0; Tablet PC 2.0),gzip(gfe)
> See details
>
> - - [02/Sep/2009:10:44:53 -0700] "GET / HTTP/1.1" 500 0 -
> "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0;
> SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729;
> Media Center PC 6.0; Tablet PC 2.0),gzip(gfe)"
> "easyschooladmin.appspot.com"
>
> 2.
> E 09-02 10:44AM 53.447
>
> :
> Traceback (most recent call last):
> File "/base/data/home/apps/easyschooladmin/
> 1.336057955581180609/django_bootstrap.py", line 68, in
> main()
> File "/base/data/home/apps/easyschooladmin/
> 1.336057955581180609/django_bootstrap.py", line 65, in main
> util.run_wsgi_app(application)
> File "/base/python_lib/versions/1/google/appengine/ext/webapp/
> util.py", line 76, in run_wsgi_app
> result = application(env, _start_response)
> File "/base/python_lib/versions/third_party/django-1.0/django/
> core/handlers/wsgi.py", line 228, in __call__
> self.load_middleware()
> File "/base/python_lib/versions/third_party/django-1.0/django/
> core/handlers/base.py", line 38, in load_middleware
> mod = __import__(mw_module, {}, {}, [''])
> File "/base/data/home/apps/easyschooladmin/
> 1.336057955581180609/security.py", line 6, in
> from django import shortcuts
> File "/base/python_lib/versions/third_party/django-1.0/django/
> shortcuts/__init__.py", line 9, in
> from django.db.models.manager import Manager
> File "/base/python_lib/versions/third_party/django-1.0/django/
> db/models/__init__.py", line 5, in
> from django.db.models.query import Q
> File "/base/python_lib/versions/third_party/django-1.0/django/
> db/models/query.py", line 7, in
> from django.db.models.fields import DateField
> File "/base/python_lib/versions/third_party/django-1.0/django/
> db/models/fields/__init__.py", line 16, in
> from django import forms
> File "/base/python_lib/versions/third_party/django-1.0/django/
> forms/__init__.py", line 14, in
> from widgets import *
> File "/base/python_lib/versions/third_party/django-1.0/django/
> forms/widgets.py", line 21, in
> from urlparse import urljoin
>
> Thanks very much.
--~--~-~--~~~---
[google-appengine] Re: app instance is completely broken, DeadlineExceededError
Yet the system status says everythng is fine. I guess all the
engineers are away fixing gmail. :-)
Google, how am I supposed to run a business on this platform?
On Sep 2, 7:17 pm, Koen Bok wrote:
> I'm seeing the same with our app.
>
> On Sep 2, 7:46 pm, Kenneth wrote:
>
> > Hi,
>
> > I appear to have completely broken my application instance. If I
> > upload the application into another instance it runs correctly, but
> > I'm only seeing deadline exceeded errors in the instance that has my
> > data. On the client side I just see a blank page after 30 seconds.
>
> > I've cleared out my cookies, pulled out all my middleware, pulled out
> > all my urls except my home page and changed that to:
>
> > def home(request):
> > return http.HttpResponse('hello world')
>
> > If anyone has any suggestions on how to debug this problem I'd love to
> > hear them.
>
> > The exceptions change every time but here's a sample:
>
> > #
>
> > 1.
> > 09-02 10:20AM 01.322 / 500 31421ms 1315cpu_ms 0kb Mozilla/5.0
> > (Windows; U; Windows NT 6.1; en-GB; rv:1.9.1.2) Gecko/20090729 Firefox/
> > 3.5.2 (.NET CLR 3.5.30729),gzip(gfe)
> > See details
>
> > - - [02/Sep/2009:10:20:32 -0700] "GET / HTTP/1.1" 500 0 -
> > "Mozilla/5.0 (Windows; U; Windows NT 6.1; en-GB; rv:1.9.1.2) Gecko/
> > 20090729 Firefox/3.5.2 (.NET CLR 3.5.30729),gzip(gfe)"
> > "easyschooladmin.appspot.com"
>
> > 2.
> > E 09-02 10:20AM 32.706
>
> > :
> > Traceback (most recent call last):
> > File "/base/data/home/apps/easyschooladmin/
> > 1.336057423874075874/django_bootstrap.py", line 64, in
> > main()
> > File "/base/data/home/apps/easyschooladmin/
> > 1.336057423874075874/django_bootstrap.py", line 61, in main
> > util.run_wsgi_app(application)
> > File "/base/python_lib/versions/1/google/appengine/ext/webapp/
> > util.py", line 76, in run_wsgi_app
> > result = application(env, _start_response)
> > File "/base/python_lib/versions/third_party/django-1.0/django/
> > core/handlers/wsgi.py", line 239, in __call__
> > response = self.get_response(request)
> > File "/base/python_lib/versions/third_party/django-1.0/django/
> > core/handlers/base.py", line 128, in get_response
> > return self.handle_uncaught_exception(request, resolver,
> > exc_info)
> > File "/base/python_lib/versions/third_party/django-1.0/django/
> > core/handlers/base.py", line 141, in handle_uncaught_exception
> > from django.core.mail import mail_admins
> > File "/base/python_lib/versions/third_party/django-1.0/django/
> > core/mail.py", line 5, in
> > import mimetypes
>
> > #
>
> > 1.
> > 09-02 10:44AM 24.212 / 500 29251ms 1455cpu_ms 0kb Mozilla/4.0
> > (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR
> > 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC
> > 6.0; Tablet PC 2.0),gzip(gfe)
> > See details
>
> > - - [02/Sep/2009:10:44:53 -0700] "GET / HTTP/1.1" 500 0 -
> > "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0;
> > SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729;
> > Media Center PC 6.0; Tablet PC 2.0),gzip(gfe)"
> > "easyschooladmin.appspot.com"
>
> > 2.
> > E 09-02 10:44AM 53.447
>
> > :
> > Traceback (most recent call last):
> > File "/base/data/home/apps/easyschooladmin/
> > 1.336057955581180609/django_bootstrap.py", line 68, in
> > main()
> > File "/base/data/home/apps/easyschooladmin/
> > 1.336057955581180609/django_bootstrap.py", line 65, in main
> > util.run_wsgi_app(application)
> > File "/base/python_lib/versions/1/google/appengine/ext/webapp/
> > util.py", line 76, in run_wsgi_app
> > result = application(env, _start_response)
> > File "/base/python_lib/versions/third_party/django-1.0/django/
> > core/handlers/wsgi.py", line 228, in __call__
> > self.load_middleware()
> > File "/base/python_lib/versions/third_party/django-1.0/django/
> > core/handlers/base.py", line 38, in load_middleware
> > mod = __import__(mw_module, {}, {}, [''])
> > File "/base/data/home/apps/easyschooladmin/
> > 1.336057955581180609/security.py", line 6, in
> > from django import shortcuts
> > File "/base/python_lib/versions/third_party/django-1.0/django/
> > shortcuts/__init__.py", line 9, in
> > from django.db.models.manager import Manager
> > File "/base/python_lib/versions/third_party/django-1.0/django/
> > db/models/__init__.py", line 5, in
> > from django.db.models.query import Q
> > File "/base/python_lib/versions/third_party/django-1.0/django/
> > db/models/query.py", line 7, in
> > from django.db.models.fields import DateField
> > File "/base/python_lib/versions/third_party/django-1.0/django/
> > db/models/fields/__init__.py", line 16, in
[google-appengine] Re: app instance is completely broken, DeadlineExceededError
It seems to be back. I sort feel like a network engineer pulling out
all the patch cables when the power was out. Oh well.
It would be great if someone from google could comment on this.
On Sep 2, 7:46 pm, Kenneth wrote:
> Yet the system status says everythng is fine. I guess all the
> engineers are away fixing gmail. :-)
>
> Google, how am I supposed to run a business on this platform?
>
> On Sep 2, 7:17 pm, Koen Bok wrote:
>
> > I'm seeing the same with our app.
>
> > On Sep 2, 7:46 pm, Kenneth wrote:
>
> > > Hi,
>
> > > I appear to have completely broken my application instance. If I
> > > upload the application into another instance it runs correctly, but
> > > I'm only seeing deadline exceeded errors in the instance that has my
> > > data. On the client side I just see a blank page after 30 seconds.
>
> > > I've cleared out my cookies, pulled out all my middleware, pulled out
> > > all my urls except my home page and changed that to:
>
> > > def home(request):
> > > return http.HttpResponse('hello world')
>
> > > If anyone has any suggestions on how to debug this problem I'd love to
> > > hear them.
>
> > > The exceptions change every time but here's a sample:
>
> > > #
>
> > > 1.
> > > 09-02 10:20AM 01.322 / 500 31421ms 1315cpu_ms 0kb Mozilla/5.0
> > > (Windows; U; Windows NT 6.1; en-GB; rv:1.9.1.2) Gecko/20090729 Firefox/
> > > 3.5.2 (.NET CLR 3.5.30729),gzip(gfe)
> > > See details
>
> > > - - [02/Sep/2009:10:20:32 -0700] "GET / HTTP/1.1" 500 0 -
> > > "Mozilla/5.0 (Windows; U; Windows NT 6.1; en-GB; rv:1.9.1.2) Gecko/
> > > 20090729 Firefox/3.5.2 (.NET CLR 3.5.30729),gzip(gfe)"
> > > "easyschooladmin.appspot.com"
>
> > > 2.
> > > E 09-02 10:20AM 32.706
>
> > > :
> > > Traceback (most recent call last):
> > > File "/base/data/home/apps/easyschooladmin/
> > > 1.336057423874075874/django_bootstrap.py", line 64, in
> > > main()
> > > File "/base/data/home/apps/easyschooladmin/
> > > 1.336057423874075874/django_bootstrap.py", line 61, in main
> > > util.run_wsgi_app(application)
> > > File "/base/python_lib/versions/1/google/appengine/ext/webapp/
> > > util.py", line 76, in run_wsgi_app
> > > result = application(env, _start_response)
> > > File "/base/python_lib/versions/third_party/django-1.0/django/
> > > core/handlers/wsgi.py", line 239, in __call__
> > > response = self.get_response(request)
> > > File "/base/python_lib/versions/third_party/django-1.0/django/
> > > core/handlers/base.py", line 128, in get_response
> > > return self.handle_uncaught_exception(request, resolver,
> > > exc_info)
> > > File "/base/python_lib/versions/third_party/django-1.0/django/
> > > core/handlers/base.py", line 141, in handle_uncaught_exception
> > > from django.core.mail import mail_admins
> > > File "/base/python_lib/versions/third_party/django-1.0/django/
> > > core/mail.py", line 5, in
> > > import mimetypes
>
> > > #
>
> > > 1.
> > > 09-02 10:44AM 24.212 / 500 29251ms 1455cpu_ms 0kb Mozilla/4.0
> > > (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR
> > > 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC
> > > 6.0; Tablet PC 2.0),gzip(gfe)
> > > See details
>
> > > - - [02/Sep/2009:10:44:53 -0700] "GET / HTTP/1.1" 500 0 -
> > > "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0;
> > > SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729;
> > > Media Center PC 6.0; Tablet PC 2.0),gzip(gfe)"
> > > "easyschooladmin.appspot.com"
>
> > > 2.
> > > E 09-02 10:44AM 53.447
>
> > > :
> > > Traceback (most recent call last):
> > > File "/base/data/home/apps/easyschooladmin/
> > > 1.336057955581180609/django_bootstrap.py", line 68, in
> > > main()
> > > File "/base/data/home/apps/easyschooladmin/
> > > 1.336057955581180609/django_bootstrap.py", line 65, in main
> > > util.run_wsgi_app(application)
> > > File "/base/python_lib/versions/1/google/appengine/ext/webapp/
> > > util.py", line 76, in run_wsgi_app
> > > result = application(env, _start_response)
> > > File "/base/python_lib/versions/third_party/django-1.0/django/
> > > core/handlers/wsgi.py", line 228, in __call__
> > > self.load_middleware()
> > > File "/base/python_lib/versions/third_party/django-1.0/django/
> > > core/handlers/base.py", line 38, in load_middleware
> > > mod = __import__(mw_module, {}, {}, [''])
> > > File "/base/data/home/apps/easyschooladmin/
> > > 1.336057955581180609/security.py", line 6, in
> > > from django import shortcuts
> > > File "/base/python_lib/versions/third_party/django-1.0/django/
> > > shortcuts/__init__.py", line 9, in
> > > from django.db.models.manager import Manager
> > > File "/base/python_lib/versions/th
[google-appengine] 30 Max simultaneous requests (maxThreads)?
Hi, I am developing a app (or more than one) that I would like to host on Google App Engine, however the architecture of the app involves cranking up the maxThreads (I am using my home grown hosting which now has Tomcat set to 2,000 maxThreads :) ). For example (1 six+ year old machine in my basement) http://zeuhl.adligo.com/gwt_util_demo_v3_1/GwtDemo.html?show_log=true I was reading somewhere that my app will be limited to 30 Max simultaneous requests (maxThreads), and I didn't see anything about being able to change this (EVEN IF YOU PAY FOR IT). So is it possible to change this? If not why, it should be billable like everything else... How much would it cost? Also I think that it seems like a silly limit (although probably a good starting point for most apps). Some apps need a lot of threads, some have a lot of page requests. For instance my app needs a lot of threads (the above version uses at least 1 per user ALL THE TIME) and will go to 2 per user in the next release :) Or rather to be more specific One thread per open browser window, so I can 'send' data to the browser window in near real time with out having the browser window send a request every millisecond (which causes other problems). So it will be limited to 15 users on Googles App Engine yikes! Cheers, Scott --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Request file size limit?
I read on stackoverflow that the maximum file size you can request with urlfetch is 1MB, is this true? That doesn't seem very large for a platform made to scale. I have a zip file that can be > 15MB and I was looking at app engine to save/unzip the file, parse it into the data store and build a web service to expose the data. Will I be able to download such a large file with app engine? Thanks. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] app instance is completely broken, DeadlineExceededError
Hi,
I appear to have completely broken my application instance. If I
upload the application into another instance it runs correctly, but
I'm only seeing deadline exceeded errors in the instance that has my
data. On the client side I just see a blank page after 30 seconds.
I've cleared out my cookies, pulled out all my middleware, pulled out
all my urls except my home page and changed that to:
def home(request):
return http.HttpResponse('hello world')
If anyone has any suggestions on how to debug this problem I'd love to
hear them.
The exceptions change every time but here's a sample:
#
1.
09-02 10:20AM 01.322 / 500 31421ms 1315cpu_ms 0kb Mozilla/5.0
(Windows; U; Windows NT 6.1; en-GB; rv:1.9.1.2) Gecko/20090729 Firefox/
3.5.2 (.NET CLR 3.5.30729),gzip(gfe)
See details
- - [02/Sep/2009:10:20:32 -0700] "GET / HTTP/1.1" 500 0 -
"Mozilla/5.0 (Windows; U; Windows NT 6.1; en-GB; rv:1.9.1.2) Gecko/
20090729 Firefox/3.5.2 (.NET CLR 3.5.30729),gzip(gfe)"
"easyschooladmin.appspot.com"
2.
E 09-02 10:20AM 32.706
:
Traceback (most recent call last):
File "/base/data/home/apps/easyschooladmin/
1.336057423874075874/django_bootstrap.py", line 64, in
main()
File "/base/data/home/apps/easyschooladmin/
1.336057423874075874/django_bootstrap.py", line 61, in main
util.run_wsgi_app(application)
File "/base/python_lib/versions/1/google/appengine/ext/webapp/
util.py", line 76, in run_wsgi_app
result = application(env, _start_response)
File "/base/python_lib/versions/third_party/django-1.0/django/
core/handlers/wsgi.py", line 239, in __call__
response = self.get_response(request)
File "/base/python_lib/versions/third_party/django-1.0/django/
core/handlers/base.py", line 128, in get_response
return self.handle_uncaught_exception(request, resolver,
exc_info)
File "/base/python_lib/versions/third_party/django-1.0/django/
core/handlers/base.py", line 141, in handle_uncaught_exception
from django.core.mail import mail_admins
File "/base/python_lib/versions/third_party/django-1.0/django/
core/mail.py", line 5, in
import mimetypes
#
1.
09-02 10:44AM 24.212 / 500 29251ms 1455cpu_ms 0kb Mozilla/4.0
(compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR
2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC
6.0; Tablet PC 2.0),gzip(gfe)
See details
- - [02/Sep/2009:10:44:53 -0700] "GET / HTTP/1.1" 500 0 -
"Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0;
SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729;
Media Center PC 6.0; Tablet PC 2.0),gzip(gfe)"
"easyschooladmin.appspot.com"
2.
E 09-02 10:44AM 53.447
:
Traceback (most recent call last):
File "/base/data/home/apps/easyschooladmin/
1.336057955581180609/django_bootstrap.py", line 68, in
main()
File "/base/data/home/apps/easyschooladmin/
1.336057955581180609/django_bootstrap.py", line 65, in main
util.run_wsgi_app(application)
File "/base/python_lib/versions/1/google/appengine/ext/webapp/
util.py", line 76, in run_wsgi_app
result = application(env, _start_response)
File "/base/python_lib/versions/third_party/django-1.0/django/
core/handlers/wsgi.py", line 228, in __call__
self.load_middleware()
File "/base/python_lib/versions/third_party/django-1.0/django/
core/handlers/base.py", line 38, in load_middleware
mod = __import__(mw_module, {}, {}, [''])
File "/base/data/home/apps/easyschooladmin/
1.336057955581180609/security.py", line 6, in
from django import shortcuts
File "/base/python_lib/versions/third_party/django-1.0/django/
shortcuts/__init__.py", line 9, in
from django.db.models.manager import Manager
File "/base/python_lib/versions/third_party/django-1.0/django/
db/models/__init__.py", line 5, in
from django.db.models.query import Q
File "/base/python_lib/versions/third_party/django-1.0/django/
db/models/query.py", line 7, in
from django.db.models.fields import DateField
File "/base/python_lib/versions/third_party/django-1.0/django/
db/models/fields/__init__.py", line 16, in
from django import forms
File "/base/python_lib/versions/third_party/django-1.0/django/
forms/__init__.py", line 14, in
from widgets import *
File "/base/python_lib/versions/third_party/django-1.0/django/
forms/widgets.py", line 21, in
from urlparse import urljoin
Thanks very much.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more o
[google-appengine] Googles 'in-ability' to actually listen to - Those That CARE.
Googles in-ability to learn from Microsoft's 'MISTAKES' Makes you the most ARROGANT S.O.B.s "Here" !!! How can you offer a 'website' (of change) Without offering some sort of 'Web Site' address - to which people can post their 'comments' !!! You call yourselves 'Origins of the Internet' (there Googles) [But you have forgotten the 'Rules Of The Internet' - so soon ???] The true Internet consists of 'ACCOUNTABILITY'. [Something that your Web 'Hosters' have lost sight of here - lately.] Just A Thought HERE - there GOOGLES. Fix the PROBLEM . ;- ) --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] delete application
How do I delete an applications? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] New Datastore Error when working with GWT
I'm seeing a new Datastore error from my GWT/RPC calls that weren't there prior to today's Maintenance. threw an unexpected exception: java.lang.NoClassDefFoundError: Could not initialize class com.google.appengine.api.datastore.DataTypeTranslator at com.google.gwt.user.server.rpc.RPC.encodeResponseForFailure (RPC.java:360) at com.google.gwt.user.server.rpc.RPC.invokeAndEncodeResponse (RPC.java:546) at com.google.gwt.user.server.rpc.RemoteServiceServlet.processCall (RemoteServiceServlet.java:166) at com.google.gwt.user.server.rpc.RemoteServiceServlet.doPost (RemoteServiceServlet.java:86) at javax.servlet.http.HttpServlet.service(HttpServlet.java:713) at javax.servlet.http.HttpServlet.service(HttpServlet.java:806) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java: 487) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter (ServletHandler.java:1093) at com.google.apphosting.runtime.jetty.SaveSessionFilter.doFilter (SaveSessionFilter.java:35) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter (ServletHandler.java:1084) at com.google.apphosting.utils.servlet.TransactionCleanupFilter.doFilter (TransactionCleanupFilter.java:43) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter (ServletHandler.java:1084) Looks like something changed, what do I need to do on my end to resolve this? - Joakim --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: A couple of questions:
key() should be the same. You can confirm by writing a simple test --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: "Quota exceeded"... although it doesn't seem to be
> You need to ratelimit the upload to a slower speed in order to not exhaust > your short-term quotas. > > -Nick Johnson Thanks a ton Nick. I do delete the data in batches. The problem is not so much with delete. I can always restart the deletion process and clear out all the data. The problem is with uploading. I tried uploading in batches of 100 (lines in the csv file). Then with 50. None of them worked. How do I rate-limit the upload to a slower speed? Also, I think the appcfg.py with the upload data option tackles this problem of restarting the upload process from wherever it crashes last. I am getting some errors in that too. Can you help me with that? http://groups.google.com/group/google-appengine/browse_thread/thread/795f1030500440f0# Thanks in advance. -Shri --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: A couple of questions:
Hi Answers in reverse order ;-) 3. Use elementtree it is much faster and in my opinion much easier to use. it is a standard part of python (since 2.5). (But it is not a dom based api) 2. the key stays the same if you update data 1. if you want a unique value you could use the uuid module T On Sep 2, 10:51 pm, John Newlin wrote: > 1) In the Java environment they have this handy type: > @Persistent(valueStrategy = IdGeneratorStrategy.IDENTITY) > > which gives a nice integer unique key per record. > > Is there an equivalent way to this with the Python interface, I didn't > see it if there is. > > 2) Question on key(). If I update some of the data in a row, will the > key() change, or is the key() going to be unique per row? > > 3) Why is xml.dom.minidom so slow? It takes ~2s to parse my xml file. > The Java parser does it in like 20ms. Is there an alternative to > minidom that is faster, or a way to make minidom run faster? > > Ok thanks for your time. > > thanks, > > -John --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Google Apps Dashboard
I'm not sure if Google Apps Dashboard is covered by the Google Apps Engine discussion group, but since I couldn't find a separate group for it, I'm posting my question here. If there is a better group, please move this to the appropriate group. My question has to do with the symbol displayed for each day in the columns labeled with the mm/dd. There were problems on 9/1/09 with Google Mail, and during that day the "wrench" symbol has displayed. Today, it still shows that wrench symbol, but when the details are displayed, the last-dated symbol is the blue "information" symbol. For other applications, like Google Calendar or Google Sites, if "information" was the last symbol for that day, that's what's displayed on the Dashboard. Why doesn't Google Mail show "information" for 9/1/09 ?? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] A couple of questions:
1) In the Java environment they have this handy type: @Persistent(valueStrategy = IdGeneratorStrategy.IDENTITY) which gives a nice integer unique key per record. Is there an equivalent way to this with the Python interface, I didn't see it if there is. 2) Question on key(). If I update some of the data in a row, will the key() change, or is the key() going to be unique per row? 3) Why is xml.dom.minidom so slow? It takes ~2s to parse my xml file. The Java parser does it in like 20ms. Is there an alternative to minidom that is faster, or a way to make minidom run faster? Ok thanks for your time. thanks, -John --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Datastore query performance
Rewrote using the ArrayProperty, works great! Very fast and about 1/4
the size of pickled data.
thanks a lot!
-john
On Tue, Sep 1, 2009 at 7:51 AM, John Newlin wrote:
> Thanks for the pointer Nick, I'll give that a try.
>
> -john
>
>
> On Tue, Sep 1, 2009 at 6:00 AM, Philippe wrote:
>>
>> thank you Nick.
>> I will then also use ArrayProperty in my Models !
>> I really thought that I could use ListProperty with indexed=False,
>> just as a quick and cheap list.
>>
>>
>> On Sep 1, 1:56 pm, "Nick Johnson (Google)"
>> wrote:
>>> Hi Philippe,
>>>
>>> On Tue, Sep 1, 2009 at 12:43 PM, Philippe wrote:
>>>
>>> > hello Nick,
>>>
>>> > Why do you advice using ArrayProperty instead of db.ListProperty
>>> > (float, indexed=False)
>>> > with the indexed=False, it should behave the same way, no ?
>>>
>>> A ListProperty requires encoding each element of the list as a separate
>>> property entry in the Entity Protocol Buffer. Protocol Buffer encoding in
>>> Python is less efficient than simple array encoding (which is extremely
>>> straightforward), and you also incur the additional overhead of serializing
>>> the key multiple times - eg, a 1000 entry list is serialized as 1000 (key,
>>> value) pairs.
>>>
>>> -Nick Johnson
>>>
>>>
>>>
>>>
>>>
>>> > Philippe
>>>
>>> > On Sep 1, 11:48 am, "Nick Johnson (Google)"
>>> > wrote:
>>> > > Hi John,
>>> > > You might also want to look at the ArrayProperty in the App Engine
>>> > > Cookbook:
>>> >http://appengine-cookbook.appspot.com/recipe/store-arrays-of-numeric-
>>> > > Pickling is not particularly efficient, so using an Array is likely to
>>> > > be
>>> > > both faster and more compact.
>>>
>>> > > -Nick Johnson
>>>
>>> > > On Tue, Sep 1, 2009 at 4:55 AM, John Newlin wrote:
>>>
>>> > > > Did some more trial and error, and found that if I change the
>>> > > > ListProperty(float) to BlobProperty with pickled data, the time for
>>> > > > queries goes down from 700ms to 70ms, which seems pretty reasonable.
>>>
>>> > > > -john
>>>
>>> > > > On Sun, Aug 30, 2009 at 2:08 PM, jnewlin wrote:
>>> > > > > Hi all,
>>>
>>> > > > > I'm seeing from the logs that my query is taking 400ms up to around
>>> > > > > 1000ms. My model looks like:
>>> > > > > class Track2(db.Model):
>>> > > > > name = db.StringProperty(required=True)
>>> > > > > date = db.StringProperty(required=True)
>>> > > > > max_speed = db.StringProperty(required=True)
>>> > > > > owner = db.UserProperty(required=True)
>>> > > > > latitudes = db.ListProperty(float, indexed=False)
>>> > > > > longitudes = db.ListProperty(float, indexed=False)
>>> > > > > altitudes = db.ListProperty(float, indexed=False)
>>> > > > > heart_rates = db.ListProperty(int, indexed=False)
>>> > > > > speeds = db.ListProperty(float, indexed=False)
>>>
>>> > > > > Each of the lists has just under 1500 entries (I only have 1 row at
>>> > > > > the moment)
>>>
>>> > > > > You can see an example of what I do with this here:
>>>
>>> > > >http://mytrackviewer.appspot.com/trackView/ag1teXRyYWNrdmlld2Vycg0LEg.
>>> > ..
>>>
>>> > > > > (I know, there are other places to put track data, I don't care, I'm
>>> > > > > mostly just learning at this point)
>>>
>>> > > > > My fetch code looks like:
>>> > > > > track_data = db.get(track_id)
>>> > > > > if track_data and ( len(track_data.latitudes) == len
>>> > > > > (track_data.longitudes) ):
>>> > > > > logging.debug('fetched track data with %d lat/longs' %
>>> > > > > len
>>> > > > > (track_data.latitudes))
>>> > > > > # blah blah blah, writes out stuff to generate the map from here.
>>>
>>> > > > > This log entry here though happens after ~750ms from the request log
>>> > > > > entry.
>>>
>>> > > > > So my question is this: Is there some way to speed this up?
>>>
>>> > > > > I also tried splitting the Track common stuff from the Trackpoints,
>>> > > > > and keeping all of the points in a separate table. That was a
>>> > > > > little
>>> > > > > slower, so I'm guessing pulling 1 really big row with all the data
>>> > > > > is
>>> > > > > faster than pulling 1500 individual rows, is that correct?
>>>
>>> > > > > Anything else I can try to speed up the query? would turning off
>>> > > > > the
>>> > > > > validator help? I'm not sure what else to try.
>>>
>>> > > > > ok thanks
>>>
>>> > > > > -John
>>>
>>> > > --
>>> > > Nick Johnson, Developer Programs Engineer, App Engine
>>>
>>> --
>>> Nick Johnson, Developer Programs Engineer, App Engine
>> >>
>>
>
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---
[google-appengine] Re: Merge-Join Performance?
There is a video about building scalable apps by Brett Slatkin on http://code.google.com/io At the end of the video it is hinted (I believe - I could be wrong) that the order of your filters matters, so that means that you should choose key with the highest entropy first (my terminology might be incorrect) but if your data is not very unique it should be used later in the merge join query. Paul 2009/9/2 Jai > > Also does it use the keyword histogram to optimize the set- > intersection performance(AND queries) in merge-join? > > Regards, > Jai > > On Sep 1, 12:07 pm, Devel63 wrote: > > I'm seeing very slow times on some merge-join (zig zag) queries, and > > just want to confirm that App Engine is smart about these things. > > > > In particular, if I have a poperty for which most records have an > > identical value, does GAE does have to scan the related entire index > > linearly, or, if I'm in the middle of a merge join, does it > > intelligently find a good starting point based on the desired __key__ > > value? > > > > Imagine 1M records with a db.BooleanProperty set to False... > > > --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Merge-Join Performance?
Also does it use the keyword histogram to optimize the set- intersection performance(AND queries) in merge-join? Regards, Jai On Sep 1, 12:07 pm, Devel63 wrote: > I'm seeing very slow times on some merge-join (zig zag) queries, and > just want to confirm that App Engine is smart about these things. > > In particular, if I have a poperty for which most records have an > identical value, does GAE does have to scan the related entire index > linearly, or, if I'm in the middle of a merge join, does it > intelligently find a good starting point based on the desired __key__ > value? > > Imagine 1M records with a db.BooleanProperty set to False... --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Building indexes stucked
OK Problem solved it was probably some server error.The indexes are now deleted Thanks for the help Jeff !!! On Sep 1, 2:07 am, JcOaCrO wrote: > Hi ! > Sorry for being boring but i am stuck again. ( Just like my > indexes :-) > the indexes are now in error state but i cannot delete them. here's > what i did: > > D:\Program Files\Google\google_appengine>python appcfg.py > vacuum_indexes need-ha > ve > Fetching index definitions diff. > This index is no longer defined in your index.yaml file. > > kind: GameScore > properties: > - name: date > - direction: desc > name: score > > Are you sure you want to delete this index? (N/y/a): y > This index is no longer defined in your index.yaml file. > > kind: GameScore > properties: > - name: date > - name: score > > Are you sure you want to delete this index? (N/y/a): y > This index is no longer defined in your index.yaml file. > > kind: GameScore > properties: > - name: date > - name: level > - name: score > > Are you sure you want to delete this index? (N/y/a): y > Deleting selected index definitions. > Error 400: --- begin server output --- > Deleting a composite index failed: ApplicationError: 4 > --- end server output --- > > I couldn't find what this error means. The index i am uploading is > empty just like the > one which was stucked. Same happens with the other app. > > Thanks > > On Aug 31, 6:23 pm, "Jeff S (Google)" wrote: > > > I've errored the indexes for these three apps. In order to recreate them > > you'll need to use the vaccum_indexes command and reupload them. In general, > > it is best to wait for index creation/deletion to finish before uploading > > new indexes. As to your last question if you have an app which you do not > > plan to use anymore, uploading an empty project is the recommended approach > > for now. > > > Cheers, > > > Jeff > > > On Sun, Aug 30, 2009 at 12:03 AM, JcOaCrO wrote: > > > > the id's are : mit-fb , the-end , need-have > > > > the first two have the same app installed. I was just testing some > > > apps i am not experienced > > > so maby i made a mistake. > > > Is there a problem if I upload new version or some other app while the > > > indexes are building? > > > Does uploading an empty project deletes the indexes and files? > > > Sorry for the questions i hope i'll not mess again. > > > > On Aug 29, 7:50 pm, "Jeff S (Google)" wrote: > > > > Index building will usually take at most 24 hours (usually much less > > > > than > > > > that) so since it has been two days these index tasks will likely need > > > > to > > > be > > > > errored out by one of us Googlers. I imagine the issue here was the high > > > > index building latency that we experienced yesterday which resulted in a > > > few > > > > stuck jobs. If you tell me your app ID I will error these out for you so > > > > that you can vacuum and recreate them. > > > > > Thank you, > > > > > Jeff > > > > > On Sat, Aug 29, 2009 at 1:53 AM, JcOaCrO wrote: > > > > > > Hi ! > > > > > i was trying to test bloog on appengine and seems building indexes is > > > > > stucked like 2 days. I tried automatic index building on a new app and > > > > > that one is stucked. How can this be resolved and what's the averadge > > > > > time to build indexes? > > > > > > Thanks --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Datastore restored? Was 5GB, but it's now using 89GB.
Hi TJ, Nothing has happened to the datastore. Have you created new indexes, or uploaded additional data in the past day or two? -Nick Johnson On Tue, Sep 1, 2009 at 4:56 AM, TJ wrote: > > I removed many data from Datastore. > > Yesterday my app used about 5GB of DataStore. > But, today Dashboard tells me that my app uses 89GB of DataStore > (costs money too). > > What happened? DataStore restored automagically? > > > > -- Nick Johnson, Developer Programs Engineer, App Engine --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Serving static files problem
Hi bbayer, Have you checked the capitalization of your files and the places where you reference them? Windows is not case-sensitive, but App Engine is. -Nick Johnson On Tue, Sep 1, 2009 at 12:02 AM, bbayer wrote: > > Hello, > I have an application and it is working like a charm on a win32 > machine with development server. The problem occurs when I uploaded it > to app engine. It seems it couldnt find my static folder contents. It > responds 404 when I am trying to get css files. Here it is app.yml > > handlers: > > - url: /media > static_dir: ./media > > > - url: /favicon\.ico > static_files: ./media/favicon.ico > upload: ./media/favicon.ico > > - url: /robots\.txt > static_files: ./templates/robots.txt > upload: ./templates/robots.txt > > - url: /update > login: admin > script: django_bootstrap.py > > - url: .* > script: django_bootstrap.py > > templates directory is django directory and there is nothing about it. > All problem is related with media folder. Any idea? > > > > -- Nick Johnson, Developer Programs Engineer, App Engine --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Create an Application - Google Keeps Asking me to create an application
Hi Jay, You need to log in at http://appengine.google.com/a/bhatti.com in order to see your apps. -Nick Johnson On Tue, Sep 1, 2009 at 4:22 AM, Jay wrote: > > OK - this is really frunstrating - i login to app engine, and it asks > me to create an application, > > https://appengine.google.com/start/createapp? > > i give it a name and such (and even check if it is available). and > when i click save i get routed back to teh "welcome to google app > enginepage (https://appengine.google.com/start) and the only button > there is "create an application" > > can someone at google please help me out of this infinite loop so i > can create an app > > > > -- Nick Johnson, Developer Programs Engineer, App Engine --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: "Quota exceeded"... although it doesn't seem to be
Hi ShriJ, On Wed, Sep 2, 2009 at 2:44 AM, ShriJ wrote: > > Hi, > > I've been having a very hard time since the last few days w.r.t. > deleting existing data and uploading new data in my datastore. > > For deleting: I get a row using the key_name and then delete it. >dbRow = modelObject.get_by_key_name(key_name) >if dbRow: > dbRow.delete() > My datastore has roughly 60K rows and I delete them one by one. Many > times when doing this, I get a quota exceeded exception. But when I > login to appspot.com for seeing whats wrong, I don't see any error. > It's possible to run out of short-term quota without exhausting your daily quota. This limit exists in order to prevent a burst of traffic taking your site offline for the rest of the day. Is there a reason you're not deleting records in batches? This will be much easier on your quotas. > Similarly, when uploading data, I am using the bulkload_client.py > script for uploading the data. There again I see the same issues. > There are times when after inserting 500 rows, I get the error and > thereafter no matter how many times I start again, I see the same > error. > You need to ratelimit the upload to a slower speed in order to not exhaust your short-term quotas. -Nick Johnson > > I've almost come to the conclusion that downloading and uploading the > data on the same day is kinda impossible. > > Am I doing something fundamentally incorrect? If not, is there any ETA > on when will things get better. My website has been down since the > last 4 days because of these issues :(. > > -Shri > > > -- Nick Johnson, Developer Programs Engineer, App Engine --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Resetting Google Apps Account / App Engine Custom Domain
Hi gadgster, There's no need to 'reset' anything - just create a new association with the Apps account you want to associate your app with. Apps are not limited to being mapped to a single domain at a time. -Nick Johnson On Wed, Sep 2, 2009 at 10:10 AM, gadgster wrote: > > Hello, > > I have an App Engine application that had a custom domain name linked > to it via Google Apps. This Google Apps account no longer exists and I > want associate the App with a Google Apps account. There doesn't seem > to be any way of resetting the link between an App Engine application > and a Google Apps account. Does anyone know how to do this? > > > > > -- Nick Johnson, Developer Programs Engineer, App Engine --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Resetting Google Apps Account / App Engine Custom Domain
Hello, I have an App Engine application that had a custom domain name linked to it via Google Apps. This Google Apps account no longer exists and I want associate the App with a Google Apps account. There doesn't seem to be any way of resetting the link between an App Engine application and a Google Apps account. Does anyone know how to do this? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: How to gracefully deal with the maintenance in 12 hours time
This quota bug was fixed yesterday, before the rollover. My apologies for
not reporting it fixed sooner (it was outside my work hours in Dublin).
-Nick
On Tue, Sep 1, 2009 at 9:49 PM, GregF wrote:
>
> On Sep 1, 6:50 am, tijer wrote:
> > HOWEVER, there is a huge problem. I just did something similar for my
> > app, with the result that it immediately gave me massive quota-fails.
> > As soon as 100 of the capabilities.CapabilitySet('datastore_v3',
> > ['write']).is_enabled() had been used, it began returning over-quota
> > errors in the logs.
>
> I am using CapabilitySet and am not seeing the same problem -
> currently it has been called 250 times. But thanks for your warning -
> I'll be watching it like a hawk.
>
> Also I have posted code similar to yours that checks memcache as well
> as datastore - see
> http://groups.google.com/group/google-appengine-python/browse_thread/thread/2a74e6fdc79f5704#
>
> Cheers
> Greg.
> >
>
--
Nick Johnson, Developer Programs Engineer, App Engine
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---
[google-appengine] Re: How to gracefully deal with the maintenance in 12 hours time
Hi,
I've got it in my logs:
File "/base/data/home/apps/contact-birthdays/1.336002949603692439/
birthdaysapp/views.py", line 123, in index_view
read_only = not(capabilities.CapabilitySet('datastore_v3',
['write']).is_enabled())
File "/base/python_lib/versions/1/google/appengine/api/capabilities/
__init__.py", line 98, in is_enabled
config = self._get_status()
File "/base/python_lib/versions/1/google/appengine/api/capabilities/
__init__.py", line 167, in _get_status
self._stub_map.MakeSyncCall('capability_service', 'IsEnabled',
req, resp)
File "/base/python_lib/versions/1/google/appengine/api/
apiproxy_stub_map.py", line 72, in MakeSyncCall
apiproxy.MakeSyncCall(service, call, request, response)
File "/base/python_lib/versions/1/google/appengine/api/
apiproxy_stub_map.py", line 255, in MakeSyncCall
rpc.CheckSuccess()
File "/base/python_lib/versions/1/google/appengine/api/
apiproxy_rpc.py", line 111, in CheckSuccess
raise self.exception
OverQuotaError: The API call capability_service.IsEnabled() required
more quota than is available.
There's nothing in the dashboard, but quotas have been reset since
I've started receiving this exception, now everything's ok.
Application id: contact-birthdays
Regards,
Pedro Morais
On Sep 1, 10:51 am, "Nick Johnson (Google)"
wrote:
> Hi tijer,
> What is your App ID, and what is the exact quota error you were seeing?
>
> -Nick
>
>
>
>
>
> On Mon, Aug 31, 2009 at 7:50 PM, tijer wrote:
>
> > 12 hours from now everything will revert to read-only and memcache
> > will fail. So, what to do? Well, x from Google provided a very useful
> > option on how to detect that the server has gone into read-only mode:
>
> > capabilities.CapabilitySet('datastore_v3', ['write']).is_enabled()
>
> > This will return a boolean value, and should look something like the
> > following in python:
>
> > from google.appengine.api import capabilities # check capabilities
> > with this import
>
> > if capabilities.CapabilitySet('datastore_v3', ['write']).is_enabled()
> > == False:
> > # render page normally here, including relying on writes and
> > memcache
> > else:
> > # fail gracefully here - possibly letting the user know that there's
> > maintenance going on and that he/she should wait half an hour and
> > check again
>
> > HOWEVER, there is a huge problem. I just did something similar for my
> > app, with the result that it immediately gave me massive quota-fails.
> > As soon as 100 of the capabilities.CapabilitySet('datastore_v3',
> > ['write']).is_enabled() had been used, it began returning over-quota
> > errors in the logs.
>
> > I can't find the quota-reference that I have presumably been
> > surpassing anywhere in the documentation, but it suddenly showed up as
> > "Capability Configs Requested" and "Capability Configs Recieved". This
> > should really have been reflected in the email sent out, or at least
> > in the quota documentation.
>
> > Under normal circumstances I would cache the response by is_enabled()
> > in memcache - but since this will not work either during maintenance -
> > there's really nothing to use the above for unless your site will have
> > less than 100 hits.
>
> > I write this, so that others might not do the same.
>
> --
> Nick Johnson, Developer Programs Engineer, App Engine
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---
