Re: [google-appengine] Hanging on last Backend (or Module) memcache writes
On Sat, Aug 24, 2013 at 9:50 AM, Julian Kent wrote: > In the appstats, further down I'm seeing memcache.Set() entries with times > such as "real=8831941ms", which is clearly where it is hanging. Personally, > I don't consider 8000 seconds, that is over 2 hours, reasonable latency in > a single memcache Set() call ;-) > Hi Julian, Yes, 2 hours is definitely not reasonable latency for a single call! I think your code is fine - as you said only 20% of your runs are failing in this manner, which means that 80% of the time it's working fine. I think GAE is just occasionally having difficulty storing so much data simultaneously into memcache. It's like when kids come home from Halloween with bulging bags of candy - they try to eat it all at once and then they get sick! Try giving GAE some extra time between memcache *sets* to process all of the incoming data. In your code, I see you put in *time.sleep(0.1)* just after the *set* call. Try increasing that to 5-10 seconds. If that doesn't work, increase it a bit more. Also try making more *set* calls - you said in an earlier email that you're making 18 *set_multi_async* calls - try upping that to 30 - 32 calls, with each call storing roughly the same amount of data. Lastly, try the new dedicated memcache feature ( https://developers.google.com/appengine/docs/adminconsole/memcache ). It seems to be more reliable, faster, and simply provides a better experience overall. - -Vinny P Technology & Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] its blank
Hello Paulus, On Sat, Aug 24, 2013 at 3:07 AM, Paulus Tanuwijaya wrote: > > My tutorial is from https://developers.google.com/glass/overview. Are you sure the tutorial is from the Google Glass page? The code you supplied looks to be identical to the Python App Engine tutorial at https://developers.google.com/appengine/docs/python/gettingstartedpython27/usingdatastore On Sat, Aug 24, 2013 at 3:07 AM, Paulus Tanuwijaya wrote: > What I meant by it still doesn't work is when I run the program on the web > there is nothing (blank). According to the tutorial it supposes to show box > and sign in guest book. The root page is blank, but what about the other pages? Can you visit the * /sign* path on your web app (so for example, if you deployed the application the url would be *(your-app-id) . appspot . com / sign* (remove the spaces). The reason I'm asking you to do this is because the guestbook defines two pages, one at root ( / ) and one at /sign. If that fails to work, can you look at your App Engine logs page and see if any error messages show up? Also try deploying a simpler Python application - try this one (it's a basic Python app demonstrating the Users service): https://developers.google.com/appengine/docs/python/gettingstartedpython27/usingusers - -Vinny P Technology & Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com - -Vinny P Technology & Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Unable to connect to GAE apps due to Timeout errors
Hi Alex, Thanks for letting me know, I have updated this value to 50 instances. If it worked then I will again update this to minimum working value for my application. On Saturday, August 24, 2013 11:36:36 PM UTC+5, Alex Burgel wrote: > > On Saturday, August 24, 2013 11:12:35 AM UTC-7, muhamma...@k2-labs.comwrote: > >> Thanks Vinny P for your reply, >> >> I have increased the number of idle instances from Automatic to 100 and >> lower the minimum pending latency slider from Automatic to 100ms. I will >> update in few days if I faced this issue again. >> > > Did you change the _minimum_ number of idle instances to 100? Because that > means you will pay for at least 100 instances per hour, which, at $0.08 per > hour, is $192 per day. Just wanted to give you a heads up on that so you > don't get shocked by your next bill. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Unable to connect to GAE apps due to Timeout errors
On Saturday, August 24, 2013 11:12:35 AM UTC-7, muhamma...@k2-labs.com wrote: > Thanks Vinny P for your reply, > > I have increased the number of idle instances from Automatic to 100 and > lower the minimum pending latency slider from Automatic to 100ms. I will > update in few days if I faced this issue again. > Did you change the _minimum_ number of idle instances to 100? Because that means you will pay for at least 100 instances per hour, which, at $0.08 per hour, is $192 per day. Just wanted to give you a heads up on that so you don't get shocked by your next bill. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Unable to connect to GAE apps due to Timeout errors
Thanks Vinny P for your reply, I have increased the number of idle instances from Automatic to 100 and lower the minimum pending latency slider from Automatic to 100ms. I will update in few days if I faced this issue again. On Saturday, August 24, 2013 8:15:07 AM UTC+5, Vinny P wrote: > > On Fri, Aug 23, 2013 at 2:38 AM, wrote: > >> I am again facing this error on my few applications. More than >> 12,000 hits failed with this error in last 24 hours (about 26%) on my >> billing enabled instance. Can anyone tell me what is happening? >> >> >> > > > Can you increase the number of idle instances and lower the minimum > pending latency slider on your admin console? See > https://developers.google.com/appengine/docs/adminconsole/performancesettings#scheduler > > Try it out for a day and see if the app's performance improves. > > - > -Vinny P > Technology & Media Advisor > Chicago, IL > > App Engine Code Samples: http://www.learntogoogleit.com > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Hanging on last Backend (or Module) memcache writes
OK, I managed to catch one. I saved the appstats page, as well as the logs, here: https://dl.dropboxusercontent.com/u/4066735/LiteRumble_error/LiteRumble_error.zip If you want to step through code the latest is available here: https://bitbucket.org/jkflying/literumble/src/3542f1e636fe8675cf6e5b70126d271963386e71/BatchRankings.py?at=default In the appstats, further down I'm seeing memcache.Set() entries with times such as "real=8831941ms", which is clearly where it is hanging. Personally, I don't consider 8000 seconds, that is over 2 hours, reasonable latency in a single memcache Set() call ;-) Also, this handler only terminated because I did a manual shutdown of the instance. In the log I linked you see the /_ah/stop being called just before the memcache.set 'woke up' after being hung for 2 hours. Thanks for the help Julian On Saturday, 24 August 2013 05:05:33 UTC+2, Vinny P wrote: > > On Fri, Aug 23, 2013 at 1:36 AM, Julian Kent wrote: > >> Will do. Right now it is tough to catch these though, they only happen >> ~20% of the time. It always seems to happen while I'm asleep :-/ Is there >> some way of getting appstats to save to db so I can see it later? >> > > > 20% occurrence rate is more than enough for appstats to retain the > appropriate data. We don't need to see every single failure, just a few > good examples of what the memcache calls are doing and how long they take. > > > - > -Vinny P > Technology & Media Advisor > Chicago, IL > > App Engine Code Samples: http://www.learntogoogleit.com > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] How to view Google datastore in locally ? and which structure used Google datastore ?
Actually you don't use /_ah/admin on the dev server any more. With the new version of the SDK (1.7.x - can't remember the specific release) you connect to port 8000 and datastore is http://localhost:8000/datastore Cheers Tim On Saturday, August 24, 2013 12:47:03 PM UTC+8, Vinny P wrote: > > On Fri, Aug 23, 2013 at 7:21 AM, Vijay Kumbhani > > > wrote: > >> How to view Google datastore locally? >> >> > > If you're talking about the development server, you can inspect the > contents of the local dev_appserver's datastore by going to the path > /_ah/admin. > > If you want to view the contents of your production datastore in your > local machine, you'll have to download the datastore's data. See > https://developers.google.com/appengine/docs/python/tools/uploadingdata#Python_Downloading_data_from_App_Engine > for > an explanation of how it's done (basically use appcfg's download_data > option). > > > - > -Vinny P > Technology & Media Advisor > Chicago, IL > > App Engine Code Samples: http://www.learntogoogleit.com > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] its blank
Dear Vinny, What I meant by it still doesn't work is when I run the program on the web there is nothing (blank). According to the tutorial it supposes to show box and sign in guest book. My tutorial is from https://developers.google.com/glass/overview. Thanks -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] how we can start Google app engine's web app via command line in windows
> > hi bro, > reply for thanks but i found another solution go to below link https://groups.google.com/d/msg/google-appengine/xqOyS2Fjc4U/CwCXkqo-GSQJ -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: how we can start Google app engine's web app via command line in windows
On Saturday, 24 August 2013 10:09:51 UTC+5:30, Vijay Kumbhani wrote: > > please, give me proper syntax to start app engine app via command line in > my pc > 1. we start google app engine app via commnd line * Open cmd with administrator mode 2. To enter type "Python" command * if python command not exits then to type below following command commmnad syntax: 'enter Python exe path', 'enter google app engine path', 'to check sdk update command', 'enter port', 'enter datastore port', 'to enter source code path' command : C:\Python27\python.exe C:\Program Files (x86)\Google\google_appengine\dev_appserver.py --skip_sdk_update_check=yes --port=8080 --admin_port=8000 D:\CloudWardbeta * if python command exits then type below folloeing command commmnad syntax: 'python', 'enter google app engine path', 'to check sdk update command', 'enter port', 'enter datastore port', 'to enter source code path' command : python C:\Program Files (x86)\Google\google_appengine\dev_appserver.py --skip_sdk_update_check=yes --port=8080 --admin_port=8000 D:\CloudWardbeta -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
