[google-appengine] Re: Weird Instance Scheduler

2012-08-22 Thread Mos
In addition here the failed-request report from Pingdom the last day (that's not acceptable!): al...@pingdom.comUP alert: krisentalk (www.krisentalk.de) is UPMi 3:166 KBkrisentalk al...@pingdom.comDOWN alert: krisentalk (www.krisentalk.de) is DOWN Mi 3:166 KBkrisentalk

Re: [google-appengine] Google App engine read quota exceeded suddenly

2012-08-22 Thread Rerngvit Yanggratoke
On Thu, Aug 23, 2012 at 12:20 AM, Joshua Woodward wrote: > On Wed, Aug 22, 2012 at 10:14 AM, Rerngvit Yanggratoke > wrote: > >> From what I understand, the memcache service is not reliable. In >> particular, it is not guaranteed that the data you store will be persistent >> forever. > > > What do

[google-appengine] Setting chunksize on datastore queries?

2012-08-22 Thread Phil McDonnell
Any best practices out there for setting chunksize on datastore queries? I have a query that looks through 80k Entities of a particular kind. I get a warning about setting my chunksize on query, but I'm not really sure what would be appropriate or even what the default is. Thanks, Phil -- You r

[google-appengine] Re: libgmp bug?

2012-08-22 Thread Richie Foreman
+1 I am also seeing this in my environment as well. On Tuesday, 21 August 2012 10:05:54 UTC-7, c h wrote: > using python27 this started showing in my error logs today: > > > 2012-08-21 > 08:22:06.683/base/python27_runtime/python27_lib/versions/third_party/pycrypto-2.6/Crypto/Util/number.py:5

[google-appengine] Anyone else having difficulty deploying to GAE in the last two days?

2012-08-22 Thread Waleed Abdulla
Usually when I deploy to GAE (using appcfg.py) it takes less than a minute. Occasionally, it might takes a couple of minutes. But in the last two days, it's been consistently taking 5 to 10 minutes each time! I'm deploying to our dev app, which has very little traffic. Sometimes it even fails after

Re: [google-appengine] Google App engine read quota exceeded suddenly

2012-08-22 Thread Kaustubh Joshi
mayb cloudsql solve your problem On Aug 22, 2012 10:50 PM, "Joshua Woodward" wrote: > On Wed, Aug 22, 2012 at 10:14 AM, Rerngvit Yanggratoke > wrote: > >> From what I understand, the memcache service is not reliable. In >> particular, it is not guaranteed that the data you store will be persiste

Re: [google-appengine] Re: GAE 1.7.1 SDK is now available for download

2012-08-22 Thread Bryce Cutt
Thanks. On Wednesday, August 22, 2012 1:01:50 PM UTC-7, Jason Collins wrote: > > Look at > google_appengine/google/appengine/ext/appstats/sample_appengine_config.py- > there's all sorts of good stuff in there. > > j > > On Wednesday, 22 August 2012 13:39:56 UTC-6, Bryce Cutt wrote: >> >> This i

Re: [google-appengine] Re: GAE 1.7.1 SDK is now available for download

2012-08-22 Thread Jason Collins
Look at google_appengine/google/appengine/ext/appstats/sample_appengine_config.py - there's all sorts of good stuff in there. j On Wednesday, 22 August 2012 13:39:56 UTC-6, Bryce Cutt wrote: > > This is great. Thanks GAE team! > > Jason, I see appstats_CALC_RPC_COSTS in the docs but I do not se

Re: [google-appengine] Re: Project too successful - due to Arctic Sea Ice Drama.

2012-08-22 Thread Jeff Schnitzer
On Wed, Aug 22, 2012 at 2:26 PM, noiv wrote: > > There are about new 3200 tiles/images every day. The problem seems not to be > a few users request same tile every minute or so. The most helpful stats would be: * How many tile requests per day total? * How many unique tile requests per day? *

Re: [google-appengine] Re: Project too successful - due to Arctic Sea Ice Drama.

2012-08-22 Thread Wilson MacGyver
others have made very good suggestions. I don't see google cloud storage for developers mentioned. So I'll toss it out there. Basically it's CDN with very good app engine integration. On Wed, Aug 22, 2012 at 2:26 PM, noiv wrote: > Thanks a lot for all the ideas and input. > > It's a custom domain

Re: [google-appengine] Re: GAE 1.7.1 SDK is now available for download

2012-08-22 Thread Bryce Cutt
This is great. Thanks GAE team! Jason, I see appstats_CALC_RPC_COSTS in the docs but I do not see appstats_DATASTORE_DETAILS documented anywhere. What does it do? - Bryce On Tuesday, August 21, 2012 3:39:40 PM UTC-7, Jason Collins wrote: > > The new improvements to appstats are AMAZING! Thank

Re: [google-appengine] Re: Alternate to Conversion API

2012-08-22 Thread Gianni
I suppose html to pdf is the feature of which will feel more the lack. The alternative free and most used in python is reportlab (perhaps it could be added to the libraries supported third-party libraries at this point) . But if conversion api still under discussion, I think that the problem of low

[google-appengine] Avalon, new translation and localization tool for GAE, looking for contributors

2012-08-22 Thread Brian McConnell
Hello, I wanted to let the App Engine community know about a new translation and localization tool that I developed at Gengo. The tool works in a manner similar to gettext, except it requests translations from cloud based translation services, such as Google Translate (machine), Microsoft (mach

Re: [google-appengine] Re: Project too successful - due to Arctic Sea Ice Drama.

2012-08-22 Thread noiv
Thanks a lot for all the ideas and input. It's a custom domain not server via appspot.com. There are about new 3200 tiles/images every day. The problem seems not to be a few users request same tile every minute or so. Maxcdn currently offers first TB for free and next 10 for 700$. But, since

[google-appengine] Re: Problem while Deploying to App Engine

2012-08-22 Thread SCR
I was able to modify the 'Network Connection' preferences in eclipse and resolve the problem. The URL used to deploy the application to Google App Engine was thro' ssl (https). In the corporate network I work, both http & https are mapped to the same port in the proxy server. So after changing

Re: [google-appengine] Change to blobstore/get_serving_url?

2012-08-22 Thread Frank VanZile
from http://docs.python.org/library/os.html putenv should exist. just comment out the putenv and try it. the hack to get _GetConnection not return an existing connection so it will create the correct connection needed for the get_serving_url call. On Tuesday, August 21, 2012 11:20:50 PM UT

Re: [google-appengine] Google App engine read quota exceeded suddenly

2012-08-22 Thread Joshua Woodward
On Wed, Aug 22, 2012 at 10:14 AM, Rerngvit Yanggratoke wrote: > From what I understand, the memcache service is not reliable. In > particular, it is not guaranteed that the data you store will be persistent > forever. What do you mean by "not reliable"? I hope you mean the memcache service itse

Re: [google-appengine] Google App engine read quota exceeded suddenly

2012-08-22 Thread Rerngvit Yanggratoke
>From what I understand, the memcache service is not reliable. In particular, it is not guaranteed that the data you store will be persistent forever. Your code have to handle that case. This is a typical usage of "cache" anyway. :) Regarding the limit, it is 1MB per entry as can be seen from here

[google-appengine] App Engine meetup in London tomorrow

2012-08-22 Thread Johan Euphrosine
Hi, We will be holding an App Engine meetup tomorrow in London at @Skillsmatter: http://www.meetup.com/LondonAppEngine/events/74818112/ Looking forward meeting british App Engine hackers over there :) -- Johan Euphrosine (proppy) Developer Programs Engineer Google Developer Relations -- You re

[google-appengine] Re: Alternate to Conversion API

2012-08-22 Thread Daniel Florey
Same problem here. We have invested a lot of time (=money) into Conversion API. So I am very frustrated and need to find a replacement. >From what I can tell App Engine has been using Princexml for the conversion. Unfortunately this will not run on App Engine and costs a lot of €€€$$$. So I'm basi

Re: [google-appengine] HardDeadlineExceededError - Production Issue

2012-08-22 Thread Mos
Loading request are faster the last 24h (back to around 40s instead of >60s). But there is still the issue that instances are started and stopped again and again without any reason. Can somebody from Google please check the last comment and reopen the following ticket: http://code.google.com/p/

Re: [google-appengine] Re: Project too successful - due to Arctic Sea Ice Drama.

2012-08-22 Thread Barry Hunter
> GAE has a built-in edge cache with undocumented behavior and no > guarantee of service. That's the first layer of defense. If you > already have Cache-Control set then this isn't good enough. Unless I missed something, you still pay for Outgoing bandwidth. So it wont help. It will not save any

Re: [google-appengine] Re: Project too successful - due to Arctic Sea Ice Drama.

2012-08-22 Thread Jeff Schnitzer
The general consensus here is right - use a cache. This is useful on any system that generates tiles, not just GAE. Hopefully your traffic tends to predominantly hit a core set of tiles. Make sure that you have a Cache-Control header with a reasonable max-age. Nothing will work right without th

Re: [google-appengine] Alternate to Conversion API

2012-08-22 Thread Jeff Schnitzer
Since it uses Swing, probably not. Jeff On Wed, Aug 22, 2012 at 7:24 AM, Aswath Satrasala wrote: > Anyone tried working with flying-saucer, > http://code.google.com/p/flying-saucer/ > > Will this work on Java Appengine > > -Aswath > > > On Tue, Aug 21, 2012 at 10:16 PM, Jeff Schnitzer > wrote:

Re: [google-appengine] Re: Project too successful - due to Arctic Sea Ice Drama.

2012-08-22 Thread Sameer Lodha
I would suggest Cloudflare as they have no limits on bandwidth utilization & the bandwidth is completely free. You can make do with there free plan. Setup is trivial as well. On Wed, Aug 22, 2012 at 6:50 PM, Richard Watson wrote: > Some options: > > 1) At the very least, ensure Google's Edge Cac

Re: [google-appengine] Re: Project too successful - due to Arctic Sea Ice Drama.

2012-08-22 Thread Richard Watson
Some options: 1) At the very least, ensure Google's Edge Cache is able to cache your images by adjusting cache control. Search this forum for some thoughts on how. 2) You could try Google's PageSpeed service, although it could take time to set up (if they accept you): https://developers.googl

Re: [google-appengine] Re: Project too successful - due to Arctic Sea Ice Drama.

2012-08-22 Thread Barry Hunter
Or just MaxCDN http://www.maxcdn.com/pricing Can get a Terabyte of free bandwidth. After that its $0.070 / GB. But often with cheap packages available. (I do use maxcdn, and the service is pretty good. I have had problems with large number of concurrent requests. ie they struggle, serving a pag

Re: [google-appengine] Re: Project too successful - due to Arctic Sea Ice Drama.

2012-08-22 Thread Rob Coops
That really depends on how you get your images... Assuming the images are accessible via http on the NASA servers I would begin by using that and let NASA deal with the traffic. Contact their web admin and inform them about the expected traffic and ask them if this is going to be a problem before

Re: [google-appengine] Re: Project too successful - due to Arctic Sea Ice Drama.

2012-08-22 Thread Barry Hunter
I would perhaps suggest trying a linux Amazon Micro instance sitting in front. Just a basic install of varnish should do the trick* http://harish11g.blogspot.co.uk/2012/03/varnish-page-cache-aws-configure.html (and make sure your application is serving headers that allow caching) Can get it free f

Re: [google-appengine] Alternate to Conversion API

2012-08-22 Thread Aswath Satrasala
Anyone tried working with flying-saucer, http://code.google.com/p/flying-saucer/ Will this work on Java Appengine -Aswath On Tue, Aug 21, 2012 at 10:16 PM, Jeff Schnitzer wrote: > We're planning to offload this to a service running on Heroku (we > convert the first page of a PDF to PNG). We ne

Re: [google-appengine] Re: Project too successful - due to Arctic Sea Ice Drama.

2012-08-22 Thread noiv
Thanks Rob, Richard, the image tiles are directly served from GAE and only outgoing bandwidth limits capacity. I'm going to reach out in Winter for sponsoring, but the question is how to survive next 8 weeks? If I understand you correctly there might be an option to put a provider with unlimit

Re: [google-appengine] Re: Datastore Indexes stuck. vacuum_indexes didn't fix it

2012-08-22 Thread Oleg Bashtenko
Bingo! That works now. Thanks guys for your help and useful information. My app is working perfectly now, and I can run advanced search queries on any combination of fields with only 66 indexes on that entity kind (this is acceptable for my purposes). Good luck to all your team! Best regards, O

Re: [google-appengine] Re: Project too successful - due to Arctic Sea Ice Drama.

2012-08-22 Thread Rob Coops
The big question for me is where are you serving these images from? If you are serving them directly from NASA servers or from an alternative source then you would most likely see very little traffic as most of it will be just URI's pointing to the images. There are a lot of hosting companies out t

[google-appengine] Re: Project too successful - due to Arctic Sea Ice Drama.

2012-08-22 Thread Richard Watson
Which resources are being hit the hardest? Outgoing bandwidth? On Wednesday, August 22, 2012 6:51:45 AM UTC+2, Torsten Becker wrote: > > Hi, > > since two years I’m running a blog at GAE focusing the Arctic and as an > unique feature a Google Map with daily high resolution Arctic satellite > im

[google-appengine] appengine.google.com - Error

2012-08-22 Thread Kevin Sanghvi
We are trying to log into appengine.google.com for our Premier Edition domain, but Firefox browser shows message "Firefox isn't redirected properly", same issue from Chrome/Opera/IE. Google App Engine service is Turned ON for the domain, as well as we tried disabling SSO On/Off. Please advic

[google-appengine] Re: Unable to Register for AppEngine Service

2012-08-22 Thread Kevin Sanghvi
We are also facing the same issue. - Tried clearing cookies/cache from the browser - Service is turned ON from Google Apps Control Panel - Disabled SSO for a while. Please help. Thanks, Kevin On Friday, 17 August 2012 01:49:23 UTC+5:30, codmajik wrote: > > i created a google apps account wi