[google-appengine] How many re-tries should I wrap my (failing) URL fetches in?

2013-06-11 Thread Cesium
(Never end a topic with a preposition :) So, I just love writing and deploying code on-the-fly to cope with App Engine's failings. My question is, how many re-tries do you guys do before punting on a URL fetch? Infinite loop that just times out? N, where N is large? Cheers, (no, I take that b

Re: [google-appengine] How many re-tries should I wrap my (failing) URL fetches in?

2013-06-11 Thread Google Tasks Backup Moderator
I use 4 tries in total. The original, then 1 retry, then sleep and retry, then sleep a little longer and retry one last time. In my experience, if it hasn't succeeded after the first sleep, it almost never succeeds after the 2nd sleep, but I still give it that one extra chance, because it does ver

Re: [google-appengine] How many re-tries should I wrap my (failing) URL fetches in?

2013-06-12 Thread Cesium
My overnight tests show that N=2 is not sufficient. I'll bump it up to 4. Do you use: Thread.sleep() ? David -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email

Re: [google-appengine] How many re-tries should I wrap my (failing) URL fetches in?

2013-06-12 Thread Google Tasks Backup Moderator
I'm using Python, so I import time and use time.sleep() On 13 June 2013 00:45, Cesium wrote: > My overnight tests show that N=2 is not sufficient. > > I'll bump it up to 4. > > Do you use: Thread.sleep() ? > > David > > -- > You received this message because you are subscribed to the Google Gr

Re: [google-appengine] How many re-tries should I wrap my (failing) URL fetches in?

2013-06-13 Thread Jeff Schnitzer
On Tue, Jun 11, 2013 at 4:20 PM, Cesium wrote: > > So, I just love writing and deploying code on-the-fly to cope with App > Engine's failings. > Are you certain the problem is GAE? FWIW, I do retries (never with a sleep) on most idempotent urlfetches to external services, but that's because mos

Re: [google-appengine] How many re-tries should I wrap my (failing) URL fetches in?

2013-06-13 Thread Cesium
Hey Jeff, Urlfetch failures have been increasing in frequency lately. This is a fetch from another appengine app of mine. I have been receiving emails almost daily from the GAE team about problems with backends and urlfetches. How you been, man? David -- You received this message because you a