[google-appengine] Re: Understanding Request was aborted after waiting too long
Great post, I would like to know the definitive answers as well. For your big question #2, I belive a request has a total of 60 seconds to return a response, and the timer against this 60 seconds starts when the request comes in. So both all the piping actual request handling has to occur in this time. On Thursday, November 8, 2012 6:09:49 AM UTC+2, ckhan wrote: Several requests over the last two days have failed with: 0.1.0.2 - - [06/Nov/2012:10:26:04 -0800] POST /_ah/queue/deferred HTTP/1.1 500 0 http://myapp.appspot.com/my/url; AppEngine-Google; (+ http://code.google.com/appengine) 1:1352226364.645785 Request was aborted after waiting too long to attempt to service your request. I know this problem is reported and discussed often here - but I'm still unclear on precisely how to interpret it. I'm trying to make sure I understand the relationship between idle instances, pending latency, dynamic/resident instances, warmup requests and startup time. My configuration: Idle instances : 4 - Automatic Pending latency: Autoomatic - Automatic My app makes having use of deferred, at the time of the failure several dozen tasks were posted to the app from taskqueue. 1. I'm going to start by assuming that while this request came to my app from the taskqueue (via the deferred library), this problem has nothing to do with the taskqueue per se. 2. The 500 means that this request in the Pending Queue: https://developers.google.com/appengine/docs/adminconsole/performancesettings App Engine's scheduler is responsible for routing incoming requests to be served by your app's instances. Sometimes the volume of incoming requests exceeds the capacity of the instances currently available to your app. When this happens, incoming requests may have to wait in the Pending Queue until busy instances become available, or until the scheduler starts new instances. 3. So by that definition, there were only 3 ways out of the queue. After minimum pending latency, but before max, Scheduler does one of these: 1. One of the 4 resident instances becomes idle, and get the request. 2. One of the dynamic instances becomes idle, and gets the request. 3. Scheduler spins up a new dynamic instance. 3a. If the instance comes up in time, the request is sent there. As the 'inaugural request' to this instance, this request is known as a loading request. Your app handles the request, but its noticeably slower. You get the warning in the log: This request caused a new process to be started for your application, and thus caused your application code to be loaded for the first time. This request may thus take longer and use more CPU than a typical request for your application. 3b. If the instance does not come up in time, the request is aborted in the Pending Queue before the app ever sees it. You get the error in the log: Request was aborted after waiting too long to attempt to service your request. The big questions I have : 1. Is my summary above accurate? Are there any other cases where request was aborted after waiting too long happens? 2. How long can you sit in the pending queue before you hit case #3b, and the request is aborted? Do I have any control over this value? 3. I don't have warmup requests configured. Would this have helped? If so, why? The scheduler has *real* requests waiting in the pending queue, why/when would it need to send me warmup ones? And most importantly: How can I tell the difference between : my instance took too long to come up because my app isn't optimized properly (ie, my problem) AND my instance took too long to come up because of something internal to GAE, entirely outside of my control (ie, an issue that should be reported GAE prod) Thanks so much for any comments/pointers/responses. -ckhan -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/4QCjoarn57cJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: SDK 1.7.3 not detecting source file changes - ANNOYING!
Has anyone created an issue on the tracker? I'd star it too. (Mac OS) On Fri, Nov 9, 2012 at 2:11 PM, Nijin Narayanan niji...@gmail.com wrote: +1 On windows 7. Same issue here. Because of this issue we have downgrade to 1.7.2. :( -Nijin Narayanan HP: +91 96 56 56 41 91 On Fri, Nov 9, 2012 at 8:38 AM, Kaan Soral kaanso...@gmail.com wrote: +1 on Windows 7, on an old app, very annoying since it uses default datastore and a reset takes more than a minute On Wednesday, November 7, 2012 10:02:28 PM UTC+2, Jason Collins wrote: I've been seeing this on Mac as well. Very misleading and annoying. On Tuesday, 6 November 2012 18:17:43 UTC-6, Jakob Holmelund wrote: We have the same issue. 4 guys running on ubuntu. This is really annoying.. Den tirsdag den 6. november 2012 04.55.41 UTC+1 skrev GregF: I just updated to SDK 1.7.3 running on Linux. At the same time I switched to the SQLite datastore stub, suggested by the depreciation message. After this, edits to source (python) files are not always detected, and I have to stop and restart the SDK after every edit. Occasionally it starts working for a run, then stops working again. Jinja2 template file modifications are being detected properly, presumably because it has it's own file change detection. I asked on Stackoverflow, but apart from one other person with the same problem, got no responses. This is intensely annoying. Is anyone else seeing this? Any ideas on how to diagnose and fix it? Cheers! Greg. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/rHdrQDX5ppAJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] GAE / GWT RPC caching issue
Hey Guys, I´m running into a strange caching issue. I have two GWT modules. One admin module and one user module. In my admin module I can add an entity and persist it to the GAE datastore (via objectify). Everything works fine there. In my user module I have two activites: one for showing a list of those entities and one entitiy-detail activity. When I change one of those entities in the admin module all changes are showed in the entity-list activity. But when I switch to the detail view of the entity, it shows an old version. No matter how many times I hit refresh. Datastore looks fine and I don´t use memcache at this point. The list and detail activity are using the same service interface/server side servlet. It´s really weird. I checked the payload - it´s always the first response of a request after redeploying or restarting the server (yes - changes appear after restarting the app). I don´t get it. The admin module is using a different service but the method for fetching a single entity is the same as in the user-end service. Changes appear there immediately. I guess it must be an GAE issue because in every browser I try to fetch the entity, the same (old) entity gets fetched again. Any ideas? Thanks, Michael -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/ezlLe2CrjZwJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: SDK 1.7.3 not detecting source file changes - ANNOYING!
Issue #8383: http://code.google.com/p/googleappengine/issues/detail?id=8383 Some suggestions of workarounds in there too. They didn't help me though. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/Bk48x_gxb0wJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Sending emails from gae using mailgun
I use mailgun with GAE... it works with local development environment and
deployed production environment. Their support is awesome and the web
service is lightning fast. I moved to mailgun because my app requires more
flexibility than what the native GAE email capabilities provide
(specifically I needed additional sender capability). The other mail
service I'd consider is http://postmarkapp.com/ which now also offers an
inbound email web service (they can invoke your HTTP handler) similar to
mailgun. I still prefer mailgun though. Many other email services are
purely geared towards outbound mail and limit inbound to mail protocols
such as pop, imap, etc... vs calling an http handler asynchronously.
On Friday, November 9, 2012 4:30:46 PM UTC-5, Emmanuel Mayssat wrote:
I am writing an app that requires email to be sent (notifications)
I am contemplating using mailgun as a service.
1/ I s there a email web service you recommended?
I can send emails through mailgun using the 'request' python module
def send_simple_message():
data = {from: Excited User m...@samples.mailgun.org javascript:
,
to: [t...@gmail.com javascript:,
to...@outlook.comjavascript:],
#
subject: [https] Hello Mama (REQUEST),
text: Testing some Mailgun awesomness!}
return requests.post(
mailgun_url,
auth = HTTPBasicAuth(username, password),
# -- or simply auth=(username, password)
data = data )
I can also send emails from the shell using urllib2 (More complex because
of https)
Cutting and pasting my urllib2 code in my gae app doesn't report any error
or anything else
2/ Can email be send when using the local gae server or the app have to be
fully deployed?
3/ Is there a way to send emails through google app engine? (including for
users that do not have gmail accounts)
4/ I cannot make sense of the gae policy as far as sending emails
What are administrator password?
Where are the administrator accounts?
My domain is not hosted on gae.
I am just using gae for test right now.
Regards
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/uQorsITU44gJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Sending emails from gae using mailgun
I have heard good things about Mailgun but have not used it myself. I have
used sendgrid.com and mandrill.com and both work well. I like the
flexibility of Mandrill being able to send from multiple domains with DKIM
and SPF but the whitelabelling in Sendgrid is more complete. 12,000 free
emails a month from Mandrill is nice. For me the important part of these
services is having a better view into deliverability. GAE email gives you
no deliverability info at all which is insanely frustrating when sending
transactional email.
As you mentioned if you send through GAE's mail library you can only send
email as an account that is an administrator of the app. That includes
users who only have viewer permissions. When I was using GAE's mail I had
a no-re...@domain.com email address as a viewer of the app and used it to
send most email. If I needed to send email as a user who is not an admin
I would just send the email using my no-reply address and use the
reply-to email header so that if someone replies to the email it goes to
the expected user. With an external mailing service you do not have to do
that (as you should be able to send as anyone) however you do not get DKIM
and SPF if you are sending as a user who is not on a domain you control so
their are benefits to using the reply-to trick even in this case.
- Bryce
On Friday, November 9, 2012 1:30:46 PM UTC-8, Emmanuel Mayssat wrote:
I am writing an app that requires email to be sent (notifications)
I am contemplating using mailgun as a service.
1/ I s there a email web service you recommended?
I can send emails through mailgun using the 'request' python module
def send_simple_message():
data = {from: Excited User m...@samples.mailgun.org javascript:
,
to: [t...@gmail.com javascript:,
to...@outlook.comjavascript:],
#
subject: [https] Hello Mama (REQUEST),
text: Testing some Mailgun awesomness!}
return requests.post(
mailgun_url,
auth = HTTPBasicAuth(username, password),
# -- or simply auth=(username, password)
data = data )
I can also send emails from the shell using urllib2 (More complex because
of https)
Cutting and pasting my urllib2 code in my gae app doesn't report any error
or anything else
2/ Can email be send when using the local gae server or the app have to be
fully deployed?
3/ Is there a way to send emails through google app engine? (including for
users that do not have gmail accounts)
4/ I cannot make sense of the gae policy as far as sending emails
What are administrator password?
Where are the administrator accounts?
My domain is not hosted on gae.
I am just using gae for test right now.
Regards
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/8P3jYqVs57MJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] which email/password for deploy
I have tried to deploy an app and keep getting password or email address error on deployment. Which address/password is to be used? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/B3P60QDrakUJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Explicit Base 64 Encoding byte array required for special characters on deployed instance but not local instance
Recently we've been setting up a system where work is allocated outside of app engine and sends back to an App Engine application a JSONified Map containing a byte array that represents a pdf file's contents, which is then uploaded to Google Drive. Within a local configuration the the flow of the pdf is uploaded and appears correctly in Drive. However, when deploying this to an actual App Engine Node the file does not appear valid. After debugging and diagnosis the issue is with the contents of special characters within the strings being passed, despite being UTF-8 encoded at every possible point. Originally URL Encoding was being used and failing still, however, after searching a solution proposed to Base64 encode the array of bytes, and thus this resolved the problem and Document uploaded correctly. The question therefore is what is the difference with respect to byte array handling that would require explicit base 64 encoding to handle special characters between a localised App Engine environment and a deployed instance? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/uuE7XSA7ABQJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Anybody out that can help me build an app
Hello i¨m starting a new business and i need some help building an app is there anybody who can help. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/gj0KYiJx40cJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Getting started
I,m new to all this and i would like to build an app. Any ideas on how i can get started??? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/DHQQAlQCXCAJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Getting started
Hi Kevin, The sample apps are a pretty good starting place. Python: https://developers.google.com/appengine/docs/python/gettingstartedpython27/helloworld Java: http://googcloudlabs.appspot.com/ -Robert Fischer www.DealScorcher.com On Fri, Nov 9, 2012 at 12:19 AM, Kevin natureeye.tay...@gmail.com wrote: I,m new to all this and i would like to build an app. Any ideas on how i can get started??? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/DHQQAlQCXCAJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] which email/password for deploy
Danial, If you've set up 2-step verification, you'll need to generate an application-specific password - http://support.google.com/accounts/bin/answer.py?hl=enanswer=185833. Or, you can use oauth, e.g. % appcfg.py update --oauth2 project_dir then follow the instructions. On 11 November 2012 09:16, Danial danial.ra...@gmail.com wrote: I have tried to deploy an app and keep getting password or email address error on deployment. Which address/password is to be used? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/B3P60QDrakUJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Question on how to modularize handlers
Two things:
1. You need an __init__.py file in the handlers directory
2. Your script line should read 'handlers.test.application'
On Saturday, 10 November 2012 10:52:35 UTC+11, Kyle Finley wrote:
Shan, if you are using the python27 runtime it should be:
# app.yaml
runtime: python27
- url: /test
script: handlers/test.application
https://developers.google.com/appengine/docs/python/config/appconfig#Script_Handlers
-- Kyle
On Friday, November 9, 2012 9:18:35 AM UTC-6, Shan Sikdar wrote:
Hi basic question,
Basically I'm having trouble modularizing handlers in GAE.
Specifically in my application I have a download button that calls a Test
handler so far I have:
script
$('#download').button().click(function(){
$('iframe id=dlBox name=dlBox hieght=0px width=0px
src=/test').appendTo('body');
});
/script
And then at the bottom of the code I have :
class Test(webapp2.RequestHandler):
def get(self):
logging.info(Entered Handler)
self.response.headers['Content-Type'] = 'text/csv'
self.response.headers['Content-Disposition'] = attachment;
filename=fname.csv
self.response.out.write(','.join(['a', 'cool', 'test']))
application = webapp2.WSGIApplication([('/', MainHandler),
('/query', QueryHandler),
('/test', Test) ],
debug=True)
And this works but I want to be able to make the Test class into its own
.py file.
So I made a folder called handlers saved the class as test.py and then
changed my app.yaml to include:
- url: /test
script: handlers/test.py
However when I try clicking the download button it gives the error :
ImportError('Could not find module %s' % fullname)
ImportError: Could not find module handlers.test
I have also tried changing the app.yaml to:
- url: /handlers
static_dir: handlers
and changing the source in the javascript code to src=/handlers/test.py
but in this case there's no error but also it doesn't enter the handler at
all it simply just says GET /handlers/test.py HTTP/1.1 200 -
What am I missing?
Thanks!
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/istXVwDc0kYJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
