[google-appengine] URLFetch Issue

2013-06-10 Thread vivpuri
Our app is getting Deadline exceeded while waiting for HTTP response from 
URL while making urlfetch calls. Please look into it asap.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




[google-appengine] Is it possible for a transactional db.get() to return a stale result if a recent transaction raised a “special” exception?

2013-06-10 Thread Albert


This is in the appengine transaction 
docshttps://developers.google.com/appengine/docs/python/datastore/transactions
...

Note: If your application receives an exception when committing a 
transaction, it does not always mean that the transaction failed. You can 
receive Timeout, TransactionFailedError, or InternalError exceptions in 
cases where transactions have been committed and eventually will be applied 
successfully...

Consider the following scenario

   1. I update entity A within a transaction.
   2. transaction operation results in the above described special 
   exception where the transaction have been committed and eventually will 
   be applied
   3. I run db.get(entity_a_key_goes_here) within a transaction right 
   after, or almost at the same time as step 2.

*My Question:*

Is it ever possible for the db.get() operation at step 3 above to return a 
stale value (or not the updated value set on step 1)? Are transactional 
db.get() operations guaranteed to return the freshest result even if the 
weird transaction exception occurs right before it?


Thanks!

I also asked this in 
stackoverflowhttp://stackoverflow.com/questions/16998682/is-it-possible-for-a-transactional-db-get-to-return-a-stale-result-if-a-recent,
 
but I didn't get an answer.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




[google-appengine] Re: Intermittent “500 Server Error” on “/_ah/openid_verify” using AppEngine Federated / OpenID login

2013-06-10 Thread Graeme Pyle
Please use this test script instead

On Monday, 10 June 2013 15:12:56 UTC+2, Graeme Pyle wrote:

 I am getting this error about 20% of the time. I've dumped and compared 
 traffic on successful and failed requests and there is no noticeable 
 difference:


 https://lh4.googleusercontent.com/-GnApPdHPlvM/UbXQlA3uCyI/F3w/fUa3uN1wO6s/s1600/comparison.png

 There's nothing in the AppEngine logs or dashboard, and also no way to 
 catch exceptions on requests that hit /_ah URLs. I've attached a script 
 that tries the login every 5 minutes, as well as the traffic dumps for 
 successful and failed requests.

 I would really appreciate it if someone from Google could take a look at 
 this. The error definitely occurs deep in the bowls of the AppEngine OpenID 
 implementation and there is no way for an outsider to see such errors.

 Thanks, Graeme


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.


#!/bin/bash

cd `dirname $0`

TIMESTAMP=`date +%Y%m%d-%H%M`

/usr/sbin/tcpdump -w $TIMESTAMP.dump -s 0 port 80 

rm cookies

curl -L --cookie-jar cookies http://ami-mooc-pilot-dev.appspot.com/_ah/login_redir?claimid=http://dev.africanmanagers.orgcontinue=http://ami-mooc-pilot-dev.appspot.com/preview;  $TIMESTAMP.1.out



FORM_ID=`grep form_build_id $TIMESTAMP.1.out| tail -1 | awk -F\ '{ print $6 }'`


echo Form ID: $FORM_ID

curl -L --cookie cookies --data name=Graeme+Pylepass=alanisform_build_id=$FORM_IDform_id=user_loginop=Log+in http://dev.africanmanagers.org/user/login?destination=openid/provider/continue;  $TIMESTAMP.2.out

grep graemep.me $TIMESTAMP.2.out  touch $TIMESTAMP.success || touch touch $TIMESTAMP.error

killall tcpdump

[google-appengine] Re: redirect user if they are not admin via security constraint

2013-06-10 Thread Андрей Колпаков
The same question... For now I've created a second page that redirects user 
if he has an admin role. Otherwise there is a link to logout and login 
again as admin user.

On Saturday, June 1, 2013 12:45:49 AM UTC+4, Aidan Mack wrote:

 security-constraint
 web-resource-collection
 url-pattern/admin/*/url-pattern
 /web-resource-collection
 auth-constraint
 role-nameadmin/role-name
 /auth-constraint
 /security-constraint


 Hi im using the above security restraint to stop none admin. 
 If a none admin trys to access a page I get a 
 HTTP ERROR 403 error

 User not in required role


 Instead of this how do I redirect back to my home page?


 Thanks

 Aidan




-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




[google-appengine] Re: Timeout for https://accounts.google.com/o/oauth2/token

2013-06-10 Thread Aaron Sykes
Pertti,

I'm having this same problem. Did you figure out what the cause was?

On Thursday, April 4, 2013 6:45:37 AM UTC-4, Pertti Kellomäki wrote:

 Hi,

 I am accessing users' YouTube accounts using OAuth2Decorator in Python. 
 Access worked fine until yesterday, but today I'm getting this:

HTTPException: Deadline exceeded while waiting for HTTP response from 
 URL: https://accounts.google.com/o/oauth2/token

 The Python traceback shows the exception coming from the decorator, before 
 my application's get() handler starts executing. The application id is 
 clickercon-testi.
 -- 
 Pertti



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




Re: [google-appengine] Re: Timeout for https://accounts.google.com/o/oauth2/token

2013-06-10 Thread Pertti Kellomäki
Hi Aaron,

Unfortunately I have no clue, the problem just went away by itself.
Probably some kind of transient failure.

Pertti


On Mon, Jun 10, 2013 at 7:56 PM, Aaron Sykes aaronpaulsy...@gmail.comwrote:

 Pertti,

 I'm having this same problem. Did you figure out what the cause was?

 On Thursday, April 4, 2013 6:45:37 AM UTC-4, Pertti Kellomäki wrote:

 Hi,

 I am accessing users' YouTube accounts using OAuth2Decorator in Python.
 Access worked fine until yesterday, but today I'm getting this:

HTTPException: Deadline exceeded while waiting for HTTP response from
 URL: 
 https://accounts.google.com/o/**oauth2/tokenhttps://accounts.google.com/o/oauth2/token

 The Python traceback shows the exception coming from the decorator,
 before my application's get() handler starts executing. The application id
 is clickercon-testi.
 --
 Pertti

  --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To unsubscribe from this group and stop receiving emails from it, send an
 email to google-appengine+unsubscr...@googlegroups.com.
 To post to this group, send email to google-appengine@googlegroups.com.
 Visit this group at http://groups.google.com/group/google-appengine?hl=en.
 For more options, visit https://groups.google.com/groups/opt_out.




-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




Re: [google-appengine] Re: 1.8.1 Pre-release SDKs Available.

2013-06-10 Thread Tom Kaitchuck
Vinny:
The intended replacement for the FilesAPI is not the library you link to,
but the one here: https://code.google.com/p/appengine-gcs-client/
It is very deliberately modeled after the FilesAPI.


On Sat, Jun 8, 2013 at 8:33 AM, Vinny P vinny...@gmail.com wrote:

 Hi Chris, thanks for stopping by.

 *My need: Better libraries.*

 What I liked about the Files API (and particularly in regards to the
 Blobstore) is that it made writing files so unbelievably easy. For example,
 in Java all I needed to do was get an instance of FileService, then I could
 write and read using openWriteChannel/openReadChannel. The Files API
 handled the dirty part of configuring access to the datastore, managing the
 write, etc. Frankly, I think the Files API is one of the best engineered
 parts of GAE* (give whoever wrote that API a raise and a promotion
 please!).*

 But you look at the javadoc for the Java Cloud Storage library, and it's
 an utter mess. See for yourself:
 https://developers.google.com/resources/api-libraries/documentation/storage/v1beta2/java/latest/
  .
 For one, there's not enough examples. Two, I have to mess around with
 BucketAccessControls and Builders and a whole mess of things. Chris, I just
 want to write some files to persistent storage, I don't want to have to
 micromanage everything else and deal with extra fluff. I'll micromanage if
 I have to, but the Blobstore took care of that for me.

 Get the guy who wrote the Files API and put him to work on writing the GCS
 library.

 -
 -Vinny P
 Technology  Media Advisor
 Chicago, IL

 My Go side project: http://invalidmail.com/


 On Saturday, June 8, 2013 1:04:23 AM UTC-5, Chris Ramsdale wrote:

 a bunch of great feedback that we'll continue to address.  in regards to
 timeline, we have no plans of decommissioning this API before end of year.
 that said, assuming the following:

- App Engine = Google Cloud Storage performance is equivalent to
(if not better than) App Engine = Blobstore
- all blobs were auto-migrated over to Cloud Storage (free of charge)
- all existing URLs just worked

 what would keep you from migrating over to a Cloud Storage-based solution?

 -- Chris

  --
 You received this message because you are subscribed to the Google Groups
 Google App Engine group.
 To unsubscribe from this group and stop receiving emails from it, send an
 email to google-appengine+unsubscr...@googlegroups.com.
 To post to this group, send email to google-appengine@googlegroups.com.
 Visit this group at http://groups.google.com/group/google-appengine?hl=en.
 For more options, visit https://groups.google.com/groups/opt_out.




-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




Re: [google-appengine] Re: 1.8.1 Pre-release SDKs Available.

2013-06-10 Thread Tom Kaitchuck
Jeff: Replies inline


On Sat, Jun 8, 2013 at 9:49 AM, Jeff Schnitzer j...@infohazard.org wrote:


 Some questions:

  * Will the current upload mechanism be preserved? Looking through the
 docs it appears the answer is that you create a signed url directly into
 GCS and have the client POST/PUT it, which seems like it should be
 compatible with the existing BlobstoreService.getUploadUrl() approach. But
 how do we get notification when the upload is complete? Right now the
 blobstore upload mechanism gives us a callback, and I do important things
 on this callback.


This will continue to function as it does now. This api is not affected.


  * Will this work with the image service the way the blobstore does now? I
 transform, resize, and crop images on the fly - this rarely-lauded feature
 is actually one of my favorite parts of GAE.


Yes. In fact you can already use the image service with files in GCS and
blobstore using the same API.


  * Will existing blobstore-based image urls be preserved? I have a lot of
 these in my datastore.


Today's announcement will have no effect on files store in blobstore.


  * What does the GAE dev environment do with the GCS apis? What about the
 Local Unit Testing framework?


It will work and use local disk as the backing store.


 As long as there are sane answers to these questions, I have no objection
 to GCS... although it will require that I rewrite and some code:

  * I read PDF data out of the blobstore using the files api, send it off
 to a service for transformation into an image, then write the image back to
 the blobstore. This sounds pretty straightforward with GCS.

  * I de-dup all uploaded images using the hash, and track image
 references. This means I have a lot of data referencing BlobKeys in the
 datastore. This brings up the question, if data is migrated from Blobstore
 to GCS, what are the new keys? Will it be clear how to migrate this data?


You can generate a BlobKey from an Item in GCS so this code would not need
to be changed much.
Data migration is not being done, nor is it necessary for you to plan for
at this time.


 I don't object to rewriting code as long as the migration path is clear. I
 can appreciate consolidating development effort around a single
 blobstore-ish offering.

 Thanks,
 Jeff



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




Re: [google-appengine] Re: 1.8.1 Pre-release SDKs Available.

2013-06-10 Thread Tom Kaitchuck
Jon the three criteria you specify are all available today:
You can use the Images API with files in GCS by getting a blobKey for them
which can be done by calling getBlobKey.
File upload is supported.
Headers can be specified at upload time.

On Sat, Jun 8, 2013 at 5:26 PM, jon jonni.g...@gmail.com wrote:

 I will migrate to GCS if:
 * All conditions stated by Chris Ramsdale are met
 * It is fully compatible with Blobstore's dynamic resize feature (eg the
 =s parameter still works)
 * It allows for a file upload (especially from mobile apps) to be
 completed in one HTTP request
 * It sets far future expiry header


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




[google-appengine] Re: Why is only one of my instances taking all the traffic?

2013-06-10 Thread Andrew Brogdon
Thank you. 

-Andrew

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




[google-appengine] Re: channel 404

2013-06-10 Thread Bach
Hi venkman,

two years have passed and we're encountering that exact same issue!
I really hope you remember how you've solved this.
any clues what's going on?

We did add the channel_presence config and we callbacks are being called.
Except the channel is disconnecting by itself with Error 404 like you've 
described.

thanks,
Bach

On Tuesday, 21 June 2011 12:49:30 UTC+10, venkman wrote:

 We're seeing 404 errors for the following channel api urls:

 /_ah/channel/disconnected/
 /_ah/channel/connected/
 /_ah/channel/error/

 Anyone else seeing these or know how to fix them?


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.