[google-appengine] Memorystore for memcached

2022-04-28 Thread GregF
Appengine python2.7 standard environment. We're looking at switching from the built-in memcache to memorystore for memcached (M4M), as a precursor to migrating to Python3. 1. The M4M pricing doc (https://cloud.google.com/memorystore/docs/memcached/pricing) describes vCPUs, but gives go

[google-appengine] Entity IDs suddenly very long

2014-04-18 Thread GregF
I store entity IDs in an array as long ints, and I've just started getting errors because they are too long e.g. 5629499534213120. Has Appengine suddenly started producing very long IDs? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To

Re: [google-appengine] Entity IDs suddenly very long

2014-04-18 Thread GregF
Thanks - I did a long overdue upgrade of the SDK last week :( In case anyone else hits the same issue, I was using a custom ArrayProperty to store a set of entity IDs in another entity. To fix the problem, I followed these steps: 1. Ran a script to download the ID lists for all entities

[google-appengine] Re: Efficient way to store lists of smallish integers

2014-03-11 Thread GregF
I use a custom ArrayProperty: #-- # A lean integer list property # See https://developers.google.com/appengine/docs/python/ndb/subclassprop # ArrayProperty import logging class ArrayProperty(ndb.BlobProperty): def __init__(self,

[google-appengine] Custom domain going to Google on some networks

2014-03-11 Thread GregF
We have several custom domains (e.g. www.schoolinterviews.co.nz) mapped to our application. Starting this morning, many users (from one ISP?) are getting a Google page instead of our app.Others (including ourselves) are getting the app correctly, which seems to imply that the domain is being

[google-appengine] Re: Custom domains stopped to work

2014-03-11 Thread GregF
Yes - same issue here (NZ) on some networks. Great to hear I'm not the only one. HELP!!! On Wednesday, 12 March 2014 09:40:24 UTC+13, Tomas Adamek wrote: Hi there it seems like that today all my custom domain configured in my google apps account stopped to forward the traffic to app engine

[google-appengine] Re: Custom domain going to Google on some networks

2014-03-11 Thread GregF
I've created a production issue here: https://code.google.com/p/googleappengine/issues/detail?id=10687 - please star! On Wednesday, 12 March 2014 09:48:43 UTC+13, GregF wrote: We have several custom domains (e.g. www.schoolinterviews.co.nz) mapped to our application. Starting this morning

[google-appengine] Re: Custom domain going to Google on some networks

2014-03-11 Thread GregF
The problem was resolved for us about 12:30 NZ time. We had about 4 hours outage. +1 for a post-mortem. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to

Re: [google-appengine] A comparison between Digital Ocean $5 plan and App Engine B$ instance type.

2014-02-17 Thread GregF
As many people have said, it depends on your use case. In my case, I am an application developer, not a sysadmin - I like to spend my time making applications, not worrying about fine-tuning memcache, database replication, software upgrades, and load balancers. Appengine has been fantastic for

Re: [google-appengine] E-mail Quota Limit at 100 - Please help

2014-02-16 Thread GregF
Yes, but SendGrid is 5-10 times as expensive as Appengine, per email. If you are sending in volume, look at Amazon's SES. On Friday, 14 February 2014 15:10:48 UTC+13, Vinny P wrote: On Wed, Feb 12, 2014 at 9:23 AM, no-r...@jrsedu.com javascript: wrote: I have a paid app with billing

[google-appengine] Re: Precompilation error - Cannot deploy application (as of today)

2013-11-28 Thread GregF
Same thing here. I'm on SDK 1.7.4 because I need to support some older apps. 11:57 AM Host: appengine.google.com 11:57 AM Application: vig-sing; version: 1 11:57 AM Starting update of app: vig-sing, version: 1 11:57 AM Getting current resource limits. 11:58 AM Scanning files on local disk. 11:58

[google-appengine] Process problems - please help!

2013-06-27 Thread GregF
Suddenly three hours ago I started getting a lot of warnings: A problem was encountered with the process that handled this request,causing it to exit. This is likely to cause a new process to be used for the nex These requests all have latencies of seconds. This is occurring with app *

[google-appengine] Process warnings

2013-06-27 Thread GregF
My app started having terrible latency and logging the following warning: A problem was encountered with the process that handled this request,causing it to exit. This appears to be every second or third request. This started 3.5 hours ago, and was not related to any code changes. An

[google-appengine] Re: Process warnings

2013-06-27 Thread GregF
Just changed version number, updated and switched default version. The problem is still happening - latencies are through the roof (over a second when they are usually sub 100ms), even static files are taking 500ms. On Thursday, 27 June 2013 18:28:27 UTC+12, GregF wrote: My app started having

[google-appengine] Re: Latency problems

2013-06-27 Thread GregF
Same thing here - see my post further down the list. We have two virtually identical apps for NZ and Australia, and this affected only the NZ one. Latency (even for static resurces) went up by ten times, causing lots of timeouts and warnings that processes had a problem. It now seems to have

[google-appengine] Re: Latency problems

2013-06-27 Thread GregF
27 juni 2013 22:05:41 UTC+2 schreef GregF het volgende: Same thing here - see my post further down the list. We have two virtually identical apps for NZ and Australia, and this affected only the NZ one. Latency (even for static resurces) went up by ten times, causing lots of timeouts

[google-appengine] Re: Process warnings

2013-06-27 Thread GregF
The problem is still occurring, but to a lesser extent - latencies are now only 5 times normal. I have many more instances than normal, but don't seem to be being billed for them. On Thursday, 27 June 2013 18:28:27 UTC+12, GregF wrote: My app started having terrible latency and logging

[google-appengine] SDK 1.7.3 not detecting source file changes - ANNOYING!

2012-11-05 Thread GregF
I just updated to SDK 1.7.3 running on Linux. At the same time I switched to the SQLite datastore stub, suggested by the depreciation message. After this, edits to source (python) files are not always detected, and I have to stop and restart the SDK after every edit. Occasionally it starts

[google-appengine] Re: Get file size with Python

2012-09-30 Thread GregF
Appengine does not give you access to the filesystem. You will need to use either the datastore or the blobstore to store local information. Cheers! Greg. On Saturday, 29 September 2012 22:05:42 UTC+12, Phát Trần wrote: I try to get file size with os.path(asd.txt) But I cann't. Don't know

[google-appengine] Indexes not updating

2012-07-30 Thread GregF
One of my apps has stopped updating indexes when entities are added or updated. This affects all indexes, including implicit indexes not explicitly set up. Other apps are fine so it appears to be application specific, just posting here in case others have the same issue. -- You received this

[google-appengine] Re: Indexes not updating

2012-07-30 Thread GregF
Also affecting another app - two out of five - so may be more general. On Tuesday, 31 July 2012 12:57:06 UTC+12, GregF wrote: One of my apps has stopped updating indexes when entities are added or updated. This affects all indexes, including implicit indexes not explicitly set up. Other

[google-appengine] Re: Indexes not updating

2012-07-30 Thread GregF
This is fixed now, all new entities are indexed. Looks like eventual consistency took a very long time, but came through. Many thanks to whoever fixed it. On Tuesday, 31 July 2012 12:57:06 UTC+12, GregF wrote: One of my apps has stopped updating indexes when entities are added or updated

[google-appengine] Re: Help : Need to test PHP + Mysql using Quercus on GAE

2012-06-18 Thread GregF
You can't. Appengine supports python, Java and Go languages - not PHP. It has it's own datastore, not MySQL. On Wednesday, 13 June 2012 20:07:53 UTC+12, Ashish wrote: Hi -- I just want to create a very small application datadriven aplication with the Help of PHP, + Mysql. I know Quercus

[google-appengine] Re: Why Google AppEngine sucks

2009-09-29 Thread GregF
On Sep 29, 3:32 pm, Roy Smith roy.smith@googlemail.com wrote: Since I've never seen my app during maintenance, can you elaborate on the nice message bit?  Are all GAE apps disabled, or are they allowed to run with reduced functionality? If the latter, is there any systemic information

[google-appengine] Re: Why Google AppEngine sucks

2009-09-27 Thread GregF
I'm not seeing the same issues as you - I have more objects but you didn't specify how frequently you update, so maybe that's where the difference is. Dumb (of me if you have, of you if you haven't!) question - have you added Indexed=False to your model properties? This can make an enormous

[google-appengine] Re: Why Google AppEngine sucks

2009-09-25 Thread GregF
Having administered a small (4 machine) cluster for a minor web app, I appreciate what it takes to do the job properly. EC2 takes hardware out of the equation, but you still need to know your OS, middleware and database like the back of your hand, and you need to continuously manage it. Scaling

[google-appengine] Re: Why Google AppEngine sucks

2009-09-25 Thread GregF
On Sep 26, 7:51 am, Rob robert.osbo...@gmail.com wrote: Well,  unless it's a maintenance Tuesday when you appear on Oprah then you'll wish you were on EC2 and could roll out a couple of extra app servers :-) Touche! An apt point. The current frequent planned maintenance is a nuisance, but we

[google-appengine] Re: How to use Cookie and Session under App Engine/python

2009-09-11 Thread GregF
On Sep 11, 3:37 pm, BornInMeadowMuffins zhangb...@gmail.com wrote: I just want to know what is the exemplary usage of cookie and session, an easy and simple approach. See http://code.google.com/p/gmemsess/ for a very simple session class. It is a very small class, so you can see exactly how it

[google-appengine] Re: How to gracefully deal with the maintenance in 12 hours time

2009-09-01 Thread GregF
On Sep 1, 6:50 am, tijer troels...@gmail.com wrote: HOWEVER, there is a huge problem. I just did something similar for my app, with the result that it immediately gave me massive quota-fails. As soon as 100 of the capabilities.CapabilitySet('datastore_v3', ['write']).is_enabled() had been

[google-appengine] Re: How to gracefully deal with the maintenance in 12 hours time

2009-09-01 Thread GregF
On Sep 2, 8:49 am, GregF g.fawc...@gmail.com wrote: I am using CapabilitySet and am not seeing the same problem - currently it has been called 250 times. But thanks for your warning - I'll be watching it like a hawk. It's now well over a thousand calls with quota warnings, so it seems I don't

[google-appengine] Re: All Read Please: Geographical Request Latency

2009-08-16 Thread GregF
Queenstown New Zealand: 440-490ms. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send

[google-appengine] Re: Username as Application Identifier already taken, intended?

2009-07-28 Thread GregF
On Jul 28, 11:22 am, Cafebabe ullenb...@googlemail.com wrote: Right after Google App Engine started and was free for everybody I try to register an Application Identifier. I was surprised to find out that I could not take the name of my two Google accounts. I think you can't use ANY google

[google-appengine] Re: Information regarding 2 July 2009 outage

2009-07-17 Thread GregF
THAT is what we needed - thanks Chris for giving a detailed description of the cause, resolution and follow-up. No-one likes writing these things because they are basically detailing your own failures, so Chris (and Google) deserve kudos for releasing this. One of the frustrating things about

[google-appengine] Re: phpAdmin clone for Google's datastore

2009-07-17 Thread GregF
I modified the console from the development SDK so administrators can run ad-hoc code from their browser. This lets you do anything you want, even more powerful than phpAdmin. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google

[google-appengine] Re: Scheduled Maintenance timing

2009-06-08 Thread GregF
Remember that not everyone is in the same timezone. For us kiwis this outage is 11am, also not ideal (I'd prefer it in the small hours NZ time). Presumably Google schedule it for their quietest time worldwide. Lets hope that these maintenance periods get less frequent/shorter - overall I'm

[google-appengine] Re: Question about google.appengine.runtime.apiproxy_errors.CapabilityDisabledError

2009-06-08 Thread GregF
See http://groups.google.com/group/google-appengine/browse_thread/thread/fbe433cb1cbec6da/98fad6cd3870828d#98fad6cd3870828d - and star http://code.google.com/p/googleappengine/issues/detail?id=1116 Cheers! Greg. On Jun 9, 2:31 pm, bowman.jos...@gmail.com bowman.jos...@gmail.com wrote: Does

[google-appengine] Re: Error in code send Email

2009-05-23 Thread GregF
If this is using the SDK, it does not send messages by default - you even need to add an argument to appcfg.py to show the message body in the logs. If it is on production, then make sure you have supp...@example.com set up as an admin user. If you read the docs for the mail API, it tells you

[google-appengine] Re: Download or View latest deployed source of your own Google App Engine app?

2009-05-21 Thread GregF
For what seems like the millionth time... I'm sorry for your loss, but you've just learned a really important lesson - real programmers use version control and backups. Or put another way, if you don't value your code enough to look after it, then don't expect anyone else to care either. I'm

[google-appengine] Re: GQL join question

2009-04-06 Thread GregF
On Apr 7, 6:53 am, Marcel Overdijk marceloverd...@gmail.com wrote: - User1, 1 jan 2009, 1000 - User1, 1 feb 2009, 1100 - User1, 1 mar 2009, 1200 The avarage will be 1100 *** But maybe the user misses registering the meter reading on 1 feb: - User1, 1 jan 2009, 1000 - User1, 1 mar 2009,

[google-appengine] Re: Datastore timeouts - anyone else?

2009-03-31 Thread GregF
On Mar 31, 1:13 pm, WallyDD shaneb...@gmail.com wrote: I seem to be getting a few datastore timeouts. If I look at percentages it isn't really that much but it does clog up the log. The timeouts tend to correspond with the spikes in

[google-appengine] Re: Can C++ code be wrapped up on GAE?

2009-03-28 Thread GregF
As mentioned above, you can't run C++ on GAE. If you can easily convert your C++ to python (or java - it seems that will be supported soon), you can run it on GAE. This may be a better idea than it seems - I wouldn't expose a C++ app to the internet without doing rigorous security testing to make

[google-appengine] Re: Sending Email

2009-03-27 Thread GregF
Yes - but the address needs to be a developer. So for my app I set up a user called Support Support in Google Apps for my domain, and then invited that user to be a developer for my GAE app. I can now use that address as the sender in the mail API. Cheers! Greg. On Mar 28, 3:46 pm, Wiiboy

[google-appengine] Re: Accessing the datastore remotely with remote_api

2009-03-25 Thread GregF
It sounds like you are trying to use remote_api from GAE, rather than your local machine. GAE libraries have sockets locked down to prevent abuse, which may be the source of your problem. On GAE, the only network option you have is url_fetch.

[google-appengine] Re: open source app engine

2009-03-25 Thread GregF
Thanks for publicising this - it is excellent news and will make developers less nervous about dipping their toes into GAE. It is also testament to Google's corporate ethics that they are supporting this project - just imagine the storm of lawsuits that would land on anyone trying to do this

[google-appengine] Re: Manual Authentication

2009-03-25 Thread GregF
Ping the server for a random number (the salt), then hash the salt with the hash of the password and send that to the server. The server stores a hash of the password, and hashes that and the salt and compares it with the sent hash - if it matches, it's authenticated.

[google-appengine] Re: Lost source code --help retrieving

2009-03-17 Thread GregF
See first issue at... http://knol.google.com/k/marce/app-engine-community-faqs/vkzeph4si12v/1# Basically you can't get it back - real developers use a version control system. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the

[google-appengine] Re: Thanks GAE team

2009-03-10 Thread GregF
Seconded. Much appreciate the effort you put in during what I guess was a pretty stressful week. Cheers! Greg. On Mar 11, 8:36 am, cz czer...@gmail.com wrote: The datastore seems to be unusually zippy today, whatever you googly types did yesterday sure worked. Beautiful! thanks, - Claude

[google-appengine] Re: Google App Engine and TZINFO

2009-03-10 Thread GregF
On Mar 11, 6:06 am, mawcs mwilliam...@williamsonclan.us wrote: I'm having a helluva time trying to manage multiple user timezones in my Google App Engine application. I have wrangled with time display for years, and my solution is to store everything as a unix datestamp (time.time()). When the

[google-appengine] Re: App did not scale as expected?

2009-03-09 Thread GregF
Just checking that the problems didn't start exactly a week ago - appengine has been struggling between the scheduled maintenance last Monday till this Monday. Test again now, and see if it is working better - my app is flying now. Also check you can't use memcache to good effect, and get() and

[google-appengine] Re: Model

2009-03-08 Thread GregF
Yes you can, and as you suggest, it is a very good idea. Just create one file called my_models.py with the model definitions (say Cat and Dog), and in your other files just use from my_models import Cat. --~--~-~--~~~---~--~~ You received this message because you

[google-appengine] Re: a fundamental increase in App Engine transparency and locality is needed

2009-03-07 Thread GregF
Raw data is good - I didn't realise you could click through to the performance graphs on the status page. But currently it only shows the past performance, and leaves us guessing about the future. During the recent issue, I posted a complaint about lack of feedback, and Pete Koomen's response

[google-appengine] Re: Query latency is not resolved

2009-03-07 Thread GregF
On Mar 8, 4:21 am, Myroslav Opyr myros...@quintagroup.com wrote: Google Engineers know more, but don't share with us. From outside it appears as if some heavy apps launched in production mode on GAE (when additional paid quotas allowed that), and that brought whole GAE infrastructure to

[google-appengine] Re: a fundamental increase in App Engine transparency and locality is needed

2009-03-06 Thread GregF
Interesting. Our app has paying customers, so this week's latencies have been pretty stressful - but I don't agree with you. We have dedicated servers for our old apps, and use Appengine for new ones. When old customers call asking about problems, the world is on my shoulders - I have total

[google-appengine] Re: Query latency is not resolved

2009-03-06 Thread GregF
Don't take my word for it - that was just what I see happening. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To

[google-appengine] Re: Query latency is not resolved

2009-03-05 Thread GregF
I agree - and compared to last week, it's three or four times higher. I'm just hanging out for the next scheduled maintenance, when they reckon it will return to pre-upgrade levels. I've pared everything I can back for our app, and hoping we can limp through till then without losing customers. I

[google-appengine] Re: Datastore operations slow

2009-03-04 Thread GregF
On Mar 5, 8:19 am, Alex Popescu the.mindstorm.mailingl...@gmail.com wrote: Comparing the Datastore metrics for yesterday and today, I'd say that the Datastore is still having latency problems on most of the operations. Agreed - my app is still performing horribly. I'd also have to point out

[google-appengine] Re: Latency Issue - More Feedback!

2009-03-04 Thread GregF
Hi Pete - Thanks a million. We now know when we can expect an improvement, and a resolution. In our case I can now see that migration is going to be more pain than hanging in there. Can I strongly suggest you post the same text on google-appengine- downtime-notify. And can you also pass the

[google-appengine] Re: [CRITICAL] Datastore operations slow

2009-03-03 Thread GregF
Arg! It's started happening to my app - when trying to loop through the results of a query with about 20 members. for teacher in teacherList: File /base/python_lib/versions/1/google/appengine/ext/db/ __init__.py, line 1468, in next return

[google-appengine] Re: scheduled maintenance

2009-03-02 Thread GregF
My rant about the same thing here... http://groups.google.com/group/google-appengine/browse_thread/thread/2ce6fdeb3fe58605 --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this

[google-appengine] Re: GAE is Wrong

2009-02-28 Thread GregF
Good luck with that. AppDrop basically runs the GAE SDK on Amazon - you don't get any scalability, and I wouldn't rely on the SDK to run an app for any length of time. You can run several instances of your app, but they would all have their own datastore. You seem to have some beef with the new

[google-appengine] Re: Why can I pay a beta service? (Where are the ads?)

2009-02-28 Thread GregF
What exactly don't you like? I read through them, and they seem fair enough to me. On Mar 1, 1:30 am, KillIEbrowser davide.rogn...@gmail.com wrote: Yes, sorry :-) I'm looking for alternatives because I like Python but I don't like the Google's New Terms of Service :-( On Feb 27, 11:04 pm,

[google-appengine] Re: Ajax

2009-02-25 Thread GregF
On Feb 26, 2:40 am, PYD p...@pydelens.be wrote: server was negative. Then I remebered I read somewhere that Google Engine couldn't serve Ajax. AJAX is just javascript content. There are no specific limitations for AJAX on Appengine, except for the limitations on content generally: 1 GB

[google-appengine] Re: Should I migrate to App Engine?

2009-02-25 Thread GregF
Depends on the site. If it is likely to hit the big time, GAE will repay the pain of redeveloping (getting used to the datastore, mainly) many times over. And if you aren't a sysadmin, GAE will let you sleep at night. If it does crash (and I'm sure it will, occasionally) you can sit back and let

[google-appengine] Re: yet another self.redirect() question

2009-02-22 Thread GregF
On Feb 23, 8:30 am, thebrianschott schott.br...@gmail.com wrote: I must be using self.redirect() when something else should be used. When I use self.redirect() my python program stops even though I am trying to redirect back into my python program. I think you are confused about what