[google-appengine] URLFetch Issue
Our app is getting Deadline exceeded while waiting for HTTP response from URL while making urlfetch calls. Please look into it asap. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Is it possible for a transactional db.get() to return a stale result if a recent transaction raised a “special” exception?
This is in the appengine transaction docshttps://developers.google.com/appengine/docs/python/datastore/transactions ... Note: If your application receives an exception when committing a transaction, it does not always mean that the transaction failed. You can receive Timeout, TransactionFailedError, or InternalError exceptions in cases where transactions have been committed and eventually will be applied successfully... Consider the following scenario 1. I update entity A within a transaction. 2. transaction operation results in the above described special exception where the transaction have been committed and eventually will be applied 3. I run db.get(entity_a_key_goes_here) within a transaction right after, or almost at the same time as step 2. *My Question:* Is it ever possible for the db.get() operation at step 3 above to return a stale value (or not the updated value set on step 1)? Are transactional db.get() operations guaranteed to return the freshest result even if the weird transaction exception occurs right before it? Thanks! I also asked this in stackoverflowhttp://stackoverflow.com/questions/16998682/is-it-possible-for-a-transactional-db-get-to-return-a-stale-result-if-a-recent, but I didn't get an answer. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Intermittent “500 Server Error” on “/_ah/openid_verify” using AppEngine Federated / OpenID login
Please use this test script instead On Monday, 10 June 2013 15:12:56 UTC+2, Graeme Pyle wrote: I am getting this error about 20% of the time. I've dumped and compared traffic on successful and failed requests and there is no noticeable difference: https://lh4.googleusercontent.com/-GnApPdHPlvM/UbXQlA3uCyI/F3w/fUa3uN1wO6s/s1600/comparison.png There's nothing in the AppEngine logs or dashboard, and also no way to catch exceptions on requests that hit /_ah URLs. I've attached a script that tries the login every 5 minutes, as well as the traffic dumps for successful and failed requests. I would really appreciate it if someone from Google could take a look at this. The error definitely occurs deep in the bowls of the AppEngine OpenID implementation and there is no way for an outsider to see such errors. Thanks, Graeme -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out. #!/bin/bash cd `dirname $0` TIMESTAMP=`date +%Y%m%d-%H%M` /usr/sbin/tcpdump -w $TIMESTAMP.dump -s 0 port 80 rm cookies curl -L --cookie-jar cookies http://ami-mooc-pilot-dev.appspot.com/_ah/login_redir?claimid=http://dev.africanmanagers.orgcontinue=http://ami-mooc-pilot-dev.appspot.com/preview; $TIMESTAMP.1.out FORM_ID=`grep form_build_id $TIMESTAMP.1.out| tail -1 | awk -F\ '{ print $6 }'` echo Form ID: $FORM_ID curl -L --cookie cookies --data name=Graeme+Pylepass=alanisform_build_id=$FORM_IDform_id=user_loginop=Log+in http://dev.africanmanagers.org/user/login?destination=openid/provider/continue; $TIMESTAMP.2.out grep graemep.me $TIMESTAMP.2.out touch $TIMESTAMP.success || touch touch $TIMESTAMP.error killall tcpdump
[google-appengine] Re: redirect user if they are not admin via security constraint
The same question... For now I've created a second page that redirects user if he has an admin role. Otherwise there is a link to logout and login again as admin user. On Saturday, June 1, 2013 12:45:49 AM UTC+4, Aidan Mack wrote: security-constraint web-resource-collection url-pattern/admin/*/url-pattern /web-resource-collection auth-constraint role-nameadmin/role-name /auth-constraint /security-constraint Hi im using the above security restraint to stop none admin. If a none admin trys to access a page I get a HTTP ERROR 403 error User not in required role Instead of this how do I redirect back to my home page? Thanks Aidan -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Timeout for https://accounts.google.com/o/oauth2/token
Pertti, I'm having this same problem. Did you figure out what the cause was? On Thursday, April 4, 2013 6:45:37 AM UTC-4, Pertti Kellomäki wrote: Hi, I am accessing users' YouTube accounts using OAuth2Decorator in Python. Access worked fine until yesterday, but today I'm getting this: HTTPException: Deadline exceeded while waiting for HTTP response from URL: https://accounts.google.com/o/oauth2/token The Python traceback shows the exception coming from the decorator, before my application's get() handler starts executing. The application id is clickercon-testi. -- Pertti -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Re: Timeout for https://accounts.google.com/o/oauth2/token
Hi Aaron, Unfortunately I have no clue, the problem just went away by itself. Probably some kind of transient failure. Pertti On Mon, Jun 10, 2013 at 7:56 PM, Aaron Sykes aaronpaulsy...@gmail.comwrote: Pertti, I'm having this same problem. Did you figure out what the cause was? On Thursday, April 4, 2013 6:45:37 AM UTC-4, Pertti Kellomäki wrote: Hi, I am accessing users' YouTube accounts using OAuth2Decorator in Python. Access worked fine until yesterday, but today I'm getting this: HTTPException: Deadline exceeded while waiting for HTTP response from URL: https://accounts.google.com/o/**oauth2/tokenhttps://accounts.google.com/o/oauth2/token The Python traceback shows the exception coming from the decorator, before my application's get() handler starts executing. The application id is clickercon-testi. -- Pertti -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Re: 1.8.1 Pre-release SDKs Available.
Vinny: The intended replacement for the FilesAPI is not the library you link to, but the one here: https://code.google.com/p/appengine-gcs-client/ It is very deliberately modeled after the FilesAPI. On Sat, Jun 8, 2013 at 8:33 AM, Vinny P vinny...@gmail.com wrote: Hi Chris, thanks for stopping by. *My need: Better libraries.* What I liked about the Files API (and particularly in regards to the Blobstore) is that it made writing files so unbelievably easy. For example, in Java all I needed to do was get an instance of FileService, then I could write and read using openWriteChannel/openReadChannel. The Files API handled the dirty part of configuring access to the datastore, managing the write, etc. Frankly, I think the Files API is one of the best engineered parts of GAE* (give whoever wrote that API a raise and a promotion please!).* But you look at the javadoc for the Java Cloud Storage library, and it's an utter mess. See for yourself: https://developers.google.com/resources/api-libraries/documentation/storage/v1beta2/java/latest/ . For one, there's not enough examples. Two, I have to mess around with BucketAccessControls and Builders and a whole mess of things. Chris, I just want to write some files to persistent storage, I don't want to have to micromanage everything else and deal with extra fluff. I'll micromanage if I have to, but the Blobstore took care of that for me. Get the guy who wrote the Files API and put him to work on writing the GCS library. - -Vinny P Technology Media Advisor Chicago, IL My Go side project: http://invalidmail.com/ On Saturday, June 8, 2013 1:04:23 AM UTC-5, Chris Ramsdale wrote: a bunch of great feedback that we'll continue to address. in regards to timeline, we have no plans of decommissioning this API before end of year. that said, assuming the following: - App Engine = Google Cloud Storage performance is equivalent to (if not better than) App Engine = Blobstore - all blobs were auto-migrated over to Cloud Storage (free of charge) - all existing URLs just worked what would keep you from migrating over to a Cloud Storage-based solution? -- Chris -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Re: 1.8.1 Pre-release SDKs Available.
Jeff: Replies inline On Sat, Jun 8, 2013 at 9:49 AM, Jeff Schnitzer j...@infohazard.org wrote: Some questions: * Will the current upload mechanism be preserved? Looking through the docs it appears the answer is that you create a signed url directly into GCS and have the client POST/PUT it, which seems like it should be compatible with the existing BlobstoreService.getUploadUrl() approach. But how do we get notification when the upload is complete? Right now the blobstore upload mechanism gives us a callback, and I do important things on this callback. This will continue to function as it does now. This api is not affected. * Will this work with the image service the way the blobstore does now? I transform, resize, and crop images on the fly - this rarely-lauded feature is actually one of my favorite parts of GAE. Yes. In fact you can already use the image service with files in GCS and blobstore using the same API. * Will existing blobstore-based image urls be preserved? I have a lot of these in my datastore. Today's announcement will have no effect on files store in blobstore. * What does the GAE dev environment do with the GCS apis? What about the Local Unit Testing framework? It will work and use local disk as the backing store. As long as there are sane answers to these questions, I have no objection to GCS... although it will require that I rewrite and some code: * I read PDF data out of the blobstore using the files api, send it off to a service for transformation into an image, then write the image back to the blobstore. This sounds pretty straightforward with GCS. * I de-dup all uploaded images using the hash, and track image references. This means I have a lot of data referencing BlobKeys in the datastore. This brings up the question, if data is migrated from Blobstore to GCS, what are the new keys? Will it be clear how to migrate this data? You can generate a BlobKey from an Item in GCS so this code would not need to be changed much. Data migration is not being done, nor is it necessary for you to plan for at this time. I don't object to rewriting code as long as the migration path is clear. I can appreciate consolidating development effort around a single blobstore-ish offering. Thanks, Jeff -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Re: 1.8.1 Pre-release SDKs Available.
Jon the three criteria you specify are all available today: You can use the Images API with files in GCS by getting a blobKey for them which can be done by calling getBlobKey. File upload is supported. Headers can be specified at upload time. On Sat, Jun 8, 2013 at 5:26 PM, jon jonni.g...@gmail.com wrote: I will migrate to GCS if: * All conditions stated by Chris Ramsdale are met * It is fully compatible with Blobstore's dynamic resize feature (eg the =s parameter still works) * It allows for a file upload (especially from mobile apps) to be completed in one HTTP request * It sets far future expiry header -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Why is only one of my instances taking all the traffic?
Thank you. -Andrew -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: channel 404
Hi venkman, two years have passed and we're encountering that exact same issue! I really hope you remember how you've solved this. any clues what's going on? We did add the channel_presence config and we callbacks are being called. Except the channel is disconnecting by itself with Error 404 like you've described. thanks, Bach On Tuesday, 21 June 2011 12:49:30 UTC+10, venkman wrote: We're seeing 404 errors for the following channel api urls: /_ah/channel/disconnected/ /_ah/channel/connected/ /_ah/channel/error/ Anyone else seeing these or know how to fix them? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.