[google-appengine] Re: images.GetUrlBase deadline problems since yesterday morning
Facing the same problem recently thought of a ppossible solution, The google.appengine.api.images has a method create_rpc.The create_rpc take deadline as param. Hence, one cloud initiate an RPC with greater deadline value then the default 5sec and pass that to images.get_serving_url method. images.get_serving_url(blob_key, secure_url=True, rpc=create_rpc(deadline=15)) Haven't deployed this yet, hoping this might solve the problem else would need to revert to loop to try getting url n number of times. On Saturday, 21 January 2012 04:06:15 UTC+5:30, blackpawn wrote: > > I figured this would just clear up after awhile but since it's been > over 24 hours I thought I better post so it can get checked out. For > a day now I'm getting tons of these errors: > > The API call images.GetUrlBase() took too long to respond and was > cancelled > > That API is regularly taking over 5 seconds and getting aborted and > before Thursday morning had no problems. Meanwhile the system status > page says latencies are fine. O_o Has there been some change to > Images or Blobstore that requires us to update our servers or is this > a temporary problem? > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at https://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/fcd5b29e-ed64-4709-86ae-b3e55dd9574f%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [google-appengine] Re: images.GetUrlBase deadline problems since yesterday morning
Let me haunt this thread, instead of creating a new one: DeadlineExceededError: The API call images.GetUrlBase() took too long to respond and was cancelled. My app received these errors today, during a time period, for the first time It's pretty devastating losing an uploaded image, and potentially a user because of errors like these Any ideas? Will it re-occur, should I improve my upload routines? Thanks in Advance -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
Re: [google-appengine] Re: images.GetUrlBase deadline problems since yesterday morning
Thanks for the advice Vinny, much appreciated. On Sun, Aug 18, 2013 at 6:48 PM, Vinny P vinny...@gmail.com wrote: On Sun, Aug 18, 2013 at 5:44 PM, Richard Spillane necro...@gmail.comwrote: Our website has to wait for the image to become available. So, should we poll somehow (repeatedly call getServingUrl())? Is there a way to be notified when getServingUrl() will no longer fail (some kind of completion callback we need to fill out)? What is the best way to wait for getServingUrl() to succeed? For a previous project I did, I scheduled a task to repeatedly attempt to call getServingUrl(). If the task failed, the Task Queue service automatically retried the task until it succeeded. As for best way, it really doesn't matter what option you choose, you just need to find a way to buy time until GAE processes your uploaded image. - -Vinny P Technology Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to a topic in the Google Groups Google App Engine group. To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/Fj2MLH-wJIg/unsubscribe . To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out. -- Dr. Richard P. Spillane necro...@gmail.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Re: images.GetUrlBase deadline problems since yesterday morning
Hi Vinny, so what is the best practice in this case? Our website has to wait for the image to become available. So, should we poll somehow (repeatedly call getServingUrl())? Is there a way to be notified when getServingUrl() will no longer fail (some kind of completion callback we need to fill out)? What is the best way to wait for getServingUrl() to succeed? On Tue, Aug 13, 2013 at 2:03 AM, Vinny P vinny...@gmail.com wrote: On Sun, Aug 11, 2013 at 6:39 PM, Richard Spillane necro...@gmail.comwrote: I've been experiencing this exact same problem, but for the go client. When I upload a small image (1M), then call getServingUrl on the blob key, everything works fine, but when I upload a larger image (8M was what I tried), I consistently got timeout error when calling image.getServingUrl. How soon are you calling getServingUrl after you write/upload the image? As the issue you linked stated, the blobstore needs some time to process the image before it can provide a serving URL. - -Vinny P Technology Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to a topic in the Google Groups Google App Engine group. To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-appengine/Fj2MLH-wJIg/unsubscribe . To unsubscribe from this group and all its topics, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out. -- Dr. Richard P. Spillane necro...@gmail.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Re: images.GetUrlBase deadline problems since yesterday morning
On Sun, Aug 18, 2013 at 5:44 PM, Richard Spillane necro...@gmail.comwrote: Our website has to wait for the image to become available. So, should we poll somehow (repeatedly call getServingUrl())? Is there a way to be notified when getServingUrl() will no longer fail (some kind of completion callback we need to fill out)? What is the best way to wait for getServingUrl() to succeed? For a previous project I did, I scheduled a task to repeatedly attempt to call getServingUrl(). If the task failed, the Task Queue service automatically retried the task until it succeeded. As for best way, it really doesn't matter what option you choose, you just need to find a way to buy time until GAE processes your uploaded image. - -Vinny P Technology Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Re: images.GetUrlBase deadline problems since yesterday morning
On Sun, Aug 11, 2013 at 6:39 PM, Richard Spillane necro...@gmail.comwrote: I've been experiencing this exact same problem, but for the go client. When I upload a small image (1M), then call getServingUrl on the blob key, everything works fine, but when I upload a larger image (8M was what I tried), I consistently got timeout error when calling image.getServingUrl. How soon are you calling getServingUrl after you write/upload the image? As the issue you linked stated, the blobstore needs some time to process the image before it can provide a serving URL. - -Vinny P Technology Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: images.GetUrlBase deadline problems since yesterday morning
I've been experiencing this exact same problem, but for the go client. When I upload a small image (1M), then call getServingUrl on the blob key, everything works fine, but when I upload a larger image (8M was what I tried), I consistently got timeout error when calling image.getServingUrl. On Wednesday, February 22, 2012 4:41:12 PM UTC-8, Stuart Langley wrote: Please see the comment I added to the issue in the tracker. http://code.google.com/p/googleappengine/issues/detail?id=6771 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: images.GetUrlBase deadline problems since yesterday morning
Please see the comment I added to the issue in the tracker. http://code.google.com/p/googleappengine/issues/detail?id=6771 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/tGNXe_9roZsJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: images.GetUrlBase deadline problems since yesterday morning
We're experiencing the same issue, with varied images sizes and types. We are also getServingUrl() twice on a given key. Our app id is zealous-co (www.zealous.co / http://8.zealous-co.appspot.com/) -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: images.GetUrlBase deadline problems since yesterday morning
this doesn't seem to have made a difference, i've updated to 1.6.2 and still see this time out with 5 second requests. :/ -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/KnNwuimimi8J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
RE: [google-appengine] Re: images.GetUrlBase deadline problems since yesterday morning
I think there are still performance issues. Wide spread. I'm seeing it on several apps, higher than average errors, longer latencies and higher than normal CPU usage. Brandon Wirtz BlackWaterOps: President / Lead Mercenary Description: http://www.linkedin.com/img/signature/bg_slate_385x42.jpg Work: 510-992-6548 Toll Free: 866-400-4536 IM: drak...@gmail.com (Google Talk) Skype: drakegreene YouTube: http://www.youtube.com/blackwateropsdotcom BlackWaterOpsDotCom http://www.blackwaterops.com/ BlackWater Ops http://www.cloudonastring.com/ Cloud On A String Mastermind Group From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of blackpawn Sent: Thursday, February 02, 2012 2:20 AM To: google-appengine@googlegroups.com Subject: Re: [google-appengine] Re: images.GetUrlBase deadline problems since yesterday morning this doesn't seem to have made a difference, i've updated to 1.6.2 and still see this time out with 5 second requests. :/ -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/KnNwuimimi8J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. image001.jpg
Re: [google-appengine] Re: images.GetUrlBase deadline problems since yesterday morning
thanks for sharing your solution pamela. i have some image processing that happens in task queues and those retry and retry and retry until they finally get a serving URL. i'm still reworking parts that the users should be able to expect happen immediately to handle some notice that the changes will be applied eventually or something. (rotating images for example) -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/hYJQWjXjY5MJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: images.GetUrlBase deadline problems since yesterday morning
After a week this is still killing my app. :( Would love any extra info I can get on the issue or things I can do to help track it down or work around it. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/9-YOHmh9BdIJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: images.GetUrlBase deadline problems since yesterday morning
Here's how I am currently dealing with it, if it helps: 1) I upload blobs using the deferred queue, and save the blob_key to an entity. I try to save the URLs in the entity via get_serving_url, but if it fails, I set them to a designated empty URL (e.g. blank.png) 2) On a cron job (run every 20 minutes), I find all the entities with empty URLs, and attempt to save the URLs then. Eventually I get the URLs for them. - pamela On Wed, Jan 25, 2012 at 12:41 PM, blackpawn pharmapsycho...@gmail.comwrote: After a week this is still killing my app. :( Would love any extra info I can get on the issue or things I can do to help track it down or work around it. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/9-YOHmh9BdIJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: images.GetUrlBase deadline problems since yesterday morning
FYI I've extended the deadline from 5 sec to 15 sec. This change will be available in the 1.6.2 release. It would be great to get some feedback on any improvements that are noticed with this chance once 1.6.2 is available. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/dybHH__kYnAJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: images.GetUrlBase deadline problems since yesterday morning
I am also experiencing an increased number of these (although I also have more traffic going to my app generally, so the increase in errors may be proportional). Either way, I call this function on a deferred task, and the most recent task has retried 15 times trying to call GetUrlBase. Is there anything I can do? (My app id is everyday-app, if that is useful). I see this issue is also logged here: http://code.google.com/p/googleappengine/issues/detail?id=6771 On Jan 20, 2:36 pm, blackpawn pharmapsycho...@gmail.com wrote: I figured this would just clear up after awhile but since it's been over 24 hours I thought I better post so it can get checked out. For a day now I'm getting tons of these errors: The API call images.GetUrlBase() took too long to respond and was cancelled That API is regularly taking over 5 seconds and getting aborted and before Thursday morning had no problems. Meanwhile the system status page says latencies are fine. O_o Has there been some change to Images or Blobstore that requires us to update our servers or is this a temporary problem? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: images.GetUrlBase deadline problems since yesterday morning
On Tue, Jan 24, 2012 at 1:19 PM, pamela pamela...@eatdifferent.com wrote: I am also experiencing an increased number of these (although I also have more traffic going to my app generally, so the increase in errors may be proportional). Either way, I call this function on a deferred task, and the most recent task has retried 15 times trying to call GetUrlBase. Is there anything I can do? (My app id is everyday-app, if that is useful). I see this issue is also logged here: http://code.google.com/p/googleappengine/issues/detail?id=6771 So that we can gather as much info as possible, if anyone else has been seeing a large number of GetUrlBase timeouts, can you add a note to the issue above (or post to this thread)? On Jan 20, 2:36 pm, blackpawn pharmapsycho...@gmail.com wrote: I figured this would just clear up after awhile but since it's been over 24 hours I thought I better post so it can get checked out. For a day now I'm getting tons of these errors: The API call images.GetUrlBase() took too long to respond and was cancelled That API is regularly taking over 5 seconds and getting aborted and before Thursday morning had no problems. Meanwhile the system status page says latencies are fine. O_o Has there been some change to Images or Blobstore that requires us to update our servers or is this a temporary problem? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
