[google-appengine] Re: 30 seconds limitation

2011-01-19 Thread Simon Knott
Hi, It should be noted that the deadline for URLFetch can now be increased to 10 minutes for cron/task queues, as mentioned in the latest release notes: http://code.google.com/p/googleappengine/wiki/SdkReleaseNotes Simon On Jan 18, 7:24 pm, Michael Weinberg wrote: > Govindad, > > Your code runn

[google-appengine] Re: How to restart the app server/service

2011-01-26 Thread Simon Knott
Is the YouTubeReadonlyClient one of your classes? I'm assuming the YouTube API doesn't reside in a "sample.youtube" package. On Jan 25, 8:44 pm, midi wrote: > Here is a partial log > > 01-25 12:17PM 55.514 /serveTube_1?q=cruzadaxsl 500 11ms 0cpu_ms 0kb > Mozilla/5.0 (compatible; Googlebot/2.1; +

[google-appengine] High Replication - Large CPU spikes without Datastore Access

2011-02-08 Thread Simon Knott
I've already posted this on the Java GAE group, but maybe someone has seen this issue on a Python-hosted app. I'm carrying out some testing of my app against the HR-store, instead of the M/S datastore, and I've noticed that occasionally I'll get a request which has a massive CPU spike. These spik

Re: [google-appengine] High Replication - Large CPU spikes without Datastore Access

2011-02-08 Thread Simon Knott
Just to emphasise, I'm seeing these spikes on requests which don't hit the datastore at all, and I don't see the same spikes on the same app with the datastore set to M/S. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this gr

[google-appengine] Re: High Replication - Large CPU spikes without Datastore Access

2011-02-08 Thread Simon Knott
I've been getting these spikes since I started testing on the 3rd Feb. As I'm just testing to see if my app works on the HR datastore, at the moment, there is very low traffic. These spikes seem to occur when I haven't hit the app for a few hours, so I'd almost put them down to loading reque

[google-appengine] Re: a serious CPU eating datastore_v3.Put() Re: errors in updating entry in the datastore, through our own python script or through gae admin console

2011-02-09 Thread Simon Knott
Are you on the Master/Slave datastore or the High Replication datastore? If those puts are putting in the same kinds of entity, then those spikes look a little suspicious to me! -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to

[google-appengine] Re: Does the Always On feature incur cpu costs when instance is idle?

2011-02-11 Thread Simon Knott
That's really interesting Paul - I've noticed a very similar problem on instances which aren't "Always On" but haven't been recycled (reported at this Link ) I've noticed the following CPU costs to my app when it's left

[google-appengine] Re: Does the Always On feature incur cpu costs when instance is idle?

2011-02-14 Thread Simon Knott
Did you manage to test this any more Paul? I've just been stung with this again - 3 instances left inert for a couple of days. Three requests which should have consumed 8 seconds of CPU time consumed almost 200 seconds! On Feb 11, 11:41 pm, Paul Verhelst wrote: > Thanks Barry, that's exactly wh

[google-appengine] Re: unable to use in queue.xml

2011-02-17 Thread Simon Knott
What version of the SDK are you using? -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googl

[google-appengine] Re: High Replication or Master/Slave?

2011-03-01 Thread Simon Knott
What makes you think HR is slower than M/S? This is the case for Puts/Deletes, but for Gets and Querying it's faster and much more consistent. *Get Statistics* *HR - * http://code.google.com/status/appengine/detail/hr-datastore/2011/02/28#ae-trust-detail-hr-datastore-get-latency *MS - * http://

[google-appengine] Re: High Replication or Master/Slave?

2011-03-01 Thread Simon Knott
Sorry, a bad use of the word consistent. bFlood's interpretation of my meaning was correct! -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this g

[google-appengine] Re: High Replication or Master/Slave?

2011-03-01 Thread Simon Knott
I personally didn't have to worry as I cache a majority of the query results and then Get objects via their ID, which is strongly consistent. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appen

[google-appengine] Re: HR Vs. Master-Slave Comparison. Is it worth extra cost?

2011-03-02 Thread Simon Knott
HR instances definitely seem to last longer than M/S ones - I've had instances last for days on my HR app, which is only in development. However, that's highlighted a strange problem in that you seem to be "charged" for idle instances. The very rough idle "costs" are: 1hr idle = additional 20

Re: [google-appengine] Re: HR Vs. Master-Slave Comparison. Is it worth extra cost?

2011-03-02 Thread Simon Knott
I've was thinking about the "charging" of idle instances on my drive home and have realised that it really doesn't add up to very much - basically, you end up having ~8mins of idle CPU cost for an entire day, if you have 10 instances for your app, assuming that the idle CPU_ms cost doesn't fluct

Re: [google-appengine] Re: HR Vs. Master-Slave Comparison. Is it worth extra cost?

2011-03-02 Thread Simon Knott
Where are you getting the $0.45/GB? Looking in my billing settings, this is only $0.015/GB for HR storage. I'd also say that whilst the loading times appear to be increased, there are much, much less of them currently so I think that's a very minor "con". My M/S version of the app appears to

Re: [google-appengine] Re: HR Vs. Master-Slave Comparison. Is it worth extra cost?

2011-03-02 Thread Simon Knott
Ah yes, forgot that was a per-day charge - thanks for the clarification. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to

[google-appengine] Re: appcfg.cmd update doesnt ask for authentication

2011-03-03 Thread Simon Knott
At some point in time you have entered the username / password of a valid account. These credentials appear to be cached indefinitely somewhere in your user profile, although I can't remember where. -- You received this message because you are subscribed to the Google Groups "Google App Engin

Re: [google-appengine] Re: HR Vs. Master-Slave Comparison. Is it worth extra cost?

2011-03-03 Thread Simon Knott
The comments about "charges" for idle instances are based around the fact that if you leave an instance unused for any amount of time, the next request to that instance will have an elevated CPU_ms cost - you can request a static resource on an instance which has been left idle for 24hrs and the

Re: [google-appengine] Re: Huge cold start times, up to 75 seconds!

2011-03-04 Thread Simon Knott
I've experienced this today as well: 2011-03-04 00:20:13.826 /daySummary/get 200 33245ms 6798cpu_ms 12api_cpu_ms -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsu

[google-appengine] Re: Who do I ask to have a non-billable quota raised?

2011-03-04 Thread Simon Knott
For this kind of testing I think you're going to have to stump up the cash - I can't see why Google should give you additional free resources so that you don't look stupid in front of a client :) -- You received this message because you are subscribed to the Google Groups "Google App Engine" g

Re: RE: [google-appengine] Re: Who do I ask to have a non-billable quota raised?

2011-03-04 Thread Simon Knott
Ah sorry Brandon, I misunderstood. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegro

Re: [google-appengine] Re: Deleting Data Really Expensive!

2011-03-09 Thread Simon Knott
I've been given the impression from these forums that the datastore admin tool is so expensive for exactly the reason you've stated David - it loads each entity by key before deletion, whereas deleting purely on keys is much cheaper CPU-wise as you don't need to bother with the retrieval of the

[google-appengine] Re: _ah_SESSION Entities

2011-03-14 Thread Simon Knott
Hi, These entities aren't deleted automatically. There is a servlet called SessionCleanupServlet that can be scheduled, via a cron job, to clean-up expired sessions on a Java app - I don't know whether there's an equivalent in the Python API. Cheers, Simon -- You received this message becau

Re: RE: [google-appengine] Re: Scalability

2011-03-18 Thread Simon Knott
What caching is missing for HR? Is it not setting cache headers? -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-

Re: RE: [google-appengine] Re: Scalability

2011-03-18 Thread Simon Knott
I can't see this cookie being set for any static resources on my HR app - are you experiencing it as well as Brandon? -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. T

[google-appengine] Re: HR Issues (But Up time is great)

2011-03-21 Thread Simon Knott
Are you using Python or Java? My experience for a Java app is: 1) Caching seems to work fine for my app - how are you being forced to set headers? Do you have sessions enabled? 2) My dashboard only goes back 24hrs as well. 3) I can edit entities fine in the datastore - does this error happen wh

[google-appengine] Re: Gobo-tools

2011-03-21 Thread Simon Knott
What version of the Java SDK are you using? I believe this issue started cropping up in the development environment for SDK 1.4.2 - a potential workaround can be found in the comments on the issue at http://code.google.com/p/googleappengine/issues/detail?id=4678#c2 -- You received this messa

[google-appengine] Re: Prerelease SDK 1.4.3 now available for download

2011-03-21 Thread Simon Knott
Nice release! -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more opt

Re: RE: [google-appengine] Re: HR Issues (But Up time is great)

2011-03-21 Thread Simon Knott
Hi Brandon, The difference between our apps is that I'm using the Java SDK - I don't know whether that makes a difference. My request headers for static resources are as follows: 1. Accept: */* 2. Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.3 3. Accept-Encoding: gzip,deflat

Re: RE: [google-appengine] HR Issues (But Up time is great)

2011-03-22 Thread Simon Knott
I'm glad to hear it's now working for you! -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@g

Re: [google-appengine] Re: Prerelease SDK 1.4.3 now available for download

2011-03-22 Thread Simon Knott
I agree with Jeff - anyone who is used to developing with a servlet container realises that they are dealing with a multi-threaded environment and should already be coding with this in mind. I'm honestly really surprised that this support isn't there already - thankfully it's performed well eno

[google-appengine] Re: NoClassDefFoundError out of nowhere (HR, no change in app)

2011-03-25 Thread Simon Knott
What class is it not finding? My HR app is fine at the moment. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-ap

[google-appengine] Re: Our server is down!!!

2011-03-28 Thread Simon Knott
Why can't you up your quotas through the billing mechanism? Or are you saying you maxed out the quotas even with billing enabled? -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@google

[google-appengine] Re: Our server is down!!!

2011-03-28 Thread Simon Knott
Have you tried submitting a billing request for upping these quotas? I've seen quite a lot of people ask for specific non-billed quotas to be raised before and the Google team have been able to raise them. I think the form to use for a formal request is http://code.google.com/support/bin/reque

[google-appengine] Re: Branded Google Account Login

2011-03-28 Thread Simon Knott
Hi, If you use OpenId for authentication, rather than Google accounts, I believe you can specify a custom login page. See the bottom of the Federated Authentication section of http://code.google.com/appengine/articles/openid.html#fa for more information. Cheers, Simon -- You received this m

Re: [google-appengine] "Add new URL " with google apps not working

2011-03-28 Thread Simon Knott
Yep, I'm experiencing this as well. I just can't get a new subdomain to stick at all at the moment - it just reloads the page without any messages and doesn't add the new subdomain. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post

Re: [google-appengine] "Add new URL " with google apps not working

2011-03-28 Thread Simon Knott
Well I've just managed to get this to work, by just trying it again and again - suddenly it just worked. Very frustrating. I had similar problems deleting a subdomain on the weekend. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To po

[google-appengine] Re: Version Update Ritual

2011-03-30 Thread Simon Knott
Hi, I very rarely update the version number and have never run into server issues, unless I've changed the underlying structure of a serialized object which is cached in MemCache. What sort of 500 errors were you getting before? Cheers, Simon -- You received this message because you are sub

Re: [google-appengine] Re: Version Update Ritual

2011-03-30 Thread Simon Knott
Ha, I've no idea then :) Whenever I've had a server 500 error, it's usually been my fault and I've been able to see the appropriate logs. Just to reiterate though, I've been redeploying to the same version for a long time now (maybe 4-5 months) without any issues. -- You received this messag

[google-appengine] Re: Thank you appengine, this day would have not survived for us, if no appengine

2011-03-30 Thread Simon Knott
Wow, nice spike! Congratulations to you as well - obviously your app was designed to fit the platform, which is always nice to see. I love the fact that handling that much traffic only cost you $80 as well. Simon -- You received this message because you are subscribed to the Google Groups "G

[google-appengine] Re: SDK 1.4.3 has been released!

2011-03-30 Thread Simon Knott
Is there anyway to set the *threadsafe* setting using the YAML configuration for a Java app? I could see that the appengine-web.xml docs had been updated, but can't see a similar update to the YAML config page. -- You received this message because you are subscribed to the Google Groups "Go

[google-appengine] Re: SDK 1.4.3 has been released!

2011-03-31 Thread Simon Knott
When you say it worked, how did you get confirmation? Is there a message, or did it simply not throw an error? -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsu

[google-appengine] Re: SDK 1.4.3 has been released!

2011-03-31 Thread Simon Knott
Ah ignore my message, I've just tested it - in SDK 1.4.2 it throws an error and in SDK 1.4.3 it doesn't. Cheers for the info, I should really have guessed at that... -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group,

[google-appengine] Re: Change application identifier

2011-03-31 Thread Simon Knott
I believe the only way to do this is to create the new application and then migrate the data from the first one. Google may be able to create an alias, pointing from one to the other, although as far as I know they've only done this in the past for apps migrating from the Master/Slave datasto

[google-appengine] Re: Thank you appengine, this day would have not survived for us, if no appengine

2011-04-03 Thread Simon Knott
Looking at his image, it looks like the peak is as he said, just below 1500 requests a second. His image also shows 217 instances being used to serve up ~300 requests a second, so I'm guessing his 600 instances is realistic. Cheers, Simon -- You received this message because you are subscrib

[google-appengine] Re: A problem of application ID

2011-04-05 Thread Simon Knott
Hi, Once an application ID has been used it can't be used again, whether it has been deleted or not. See http://code.google.com/appengine/kb/adminconsole.html#delete_app for more information. Cheers, Simon -- You received this message because you are subscribed to the Google Groups "Google

Re: [google-appengine] 24 hours of data on charts

2011-04-05 Thread Simon Knott
I've just noticed that my HR apps have reverted to only showing 24hrs worth of data again. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this gro

[google-appengine] Re: How to read byte by byte from a Datastore Entity Object

2011-04-06 Thread Simon Knott
Hi, Have you thought about using the new FileService, which was released as "experimental" in the latest SDK? See http://code.google.com/appengine/docs/java/blobstore/overview.html#Writing_Files_to_the_Blobstore for more information. Cheers, Simon -- You received this message because you a

Re: [google-appengine] Scheduled Downtime Woes

2011-04-07 Thread Simon Knott
Hi, As Las has said, it's a global service - the "middle of the day" downtime for you was early morning downtime for me! I guess it would be better if the scheduled downtime was staggered, so that it impacted a different set of applications each time, but I'm guessing Google are constrained wi

Re: [google-appengine] Re: SDK 1.4.3 has been released!

2011-04-07 Thread Simon Knott
Hi, It all appears very good so far from my experience - I haven't personally noticed any drop-off in performance, only a massive decrease in the number of instances spun-up and therefore a large drop-off of warm-up requests. A big win! Cheers, Simon -- You received this message because you

Re: [google-appengine] Scheduled Downtime Woes

2011-04-07 Thread Simon Knott
On Thursday, April 7, 2011 9:41:55 AM UTC+1, Las wrote: > > > > 2011/4/7 Simon Knott > >> Hi, >> >> As Las has said, it's a global service - the "middle of the day" downtime >> for you was early morning downtime for me! I guess it would

Re: [google-appengine] Re: Scheduled Downtime Woes

2011-04-07 Thread Simon Knott
The next scheduled maintenance period is in ~2 weeks time apparently - Wednesday, 2011 April 20, 5pm (1700) PDT/ 12m () Thursday, 2011 April 21 GMT (from https://groups.google.com/d/msg/google-appengine-downtime-notify/sRTOF2ErN1E/_NU4r-DsUPYJ) -- You received this message because you are

Re: [google-appengine] Re: Scheduled Downtime Woes

2011-04-08 Thread Simon Knott
The 3x CPU cost is only for Puts/deletes though isn't it? It's not as if your CPU costs are suddenly going to triple by moving to HR - if a majority of your activity is reads, then the impact is mainly through the increased storage costs. -- You received this message because you are subscribe

Re: [google-appengine] Re: Scheduled Downtime Woes

2011-04-08 Thread Simon Knott
I've asked this question before, but haven't had any official answers. What's the expected behaviour of the following on an HR app: 1. Carry out a put and schedule a task in a transaction 2. Commit the transaction 3. In the task, read-by-key for the entity you put in the transaction Sho

Re: [google-appengine] Re: Scheduled Downtime Woes

2011-04-08 Thread Simon Knott
I've had experience which suggests otherwise :) I'm finding that very occasionally the entity returned by the read-by-key hasn't been updated yet. I've got around it by just re-queuing the task, and the second time around the entity is always in the updated state. I must admit that I was qui

Re: [google-appengine] Re: Scheduled Downtime Woes

2011-04-08 Thread Simon Knott
This is on High Replication. The only time I've seen the same problem on M/S is when I accidentally left the task enqueue out of the transaction. Once I added the enqueue into the transaction on M/S, the problem went away and I haven't seen any re-occurrence. -- You received this message bec

Re: [google-appengine] Re: Scheduled Downtime Woes

2011-04-10 Thread Simon Knott
I do have a caching strategy and I've looked into whether it could be causing this issue. However, I've confirmed that the entity retrieved is definitely coming from the datastore and is bypassing the cache. -- You received this message because you are subscribed to the Google Groups "Google

[google-appengine] Re: channel api multiple connect to the same channel

2011-04-14 Thread Simon Knott
Hi, I believe that the polling only happens in the local development environment - on the Production servers, it uses the persistent connection. Cheers, Simon -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send em

[google-appengine] Re: get_serving_url

2011-04-14 Thread Simon Knott
Hi, As far as I can you only need to have billing enabled for the Blobstore portion of the images API - you won't necessarily be charged anything since you get a free quota to burn through first. Cheers, Simon -- You received this message because you are subscribed to the Google Groups "Goog

[google-appengine] Re: Is Entity Id with Ancestor unique for auto-generated long ids?

2011-04-21 Thread Simon Knott
The long IDs generated for children are unique within that Entity Group, but can be identical across Entity Groups. This is possible because the *key* of the child contains the identifier of the parent - i.e. the entire key is unique within the datastore. In short, the examples you have given

[google-appengine] Re: Is Entity Id with Ancestor unique for auto-generated long ids?

2011-04-21 Thread Simon Knott
Hi, As mentioned, App Engine will use a separate counter - uniqueness is only guaranteed within the same entity group. Cheers, Simon -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@go

[google-appengine] How can i downgrade the size of "Total Stored Data"

2011-04-23 Thread Simon Knott
Deleting with the admin interface carries out a "soft" delete, which schedules a background "hard" delete. You'll have to be patient and wait for the job to run, before it will be reflected in your stats and quotas. Cheers, Simon -- You received this message because you are subscribed to the

RE: [google-appengine] Python VS Java

2011-07-04 Thread Simon Knott
How often do the instances get recycled Brandon? I know one person was saying that their instances were getting recycled every 9k requests. Given that one of the massive performance benefits of Java comes from JIT hotspot recompilation, this is completely lost if the instance is recycled. On

Re: [google-appengine] Worried about performance of an HTTP based game.

2011-07-15 Thread Simon Knott
The task queue option is a good one - task queue requests have 10 minutes to run, not 30 seconds. Combined with Brian's suggestion below, you shouldn't run into any issues. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this dis

[google-appengine] Re: Physics engines on GAE ?

2011-07-19 Thread Simon Knott
Isn't this a client-side library? GAE is a server-side hosting service. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/KxsrMO70GUEJ. To post to t

[google-appengine] Re: Απ: Physics engines on GAE ?

2011-07-19 Thread Simon Knott
In that case I'm afraid it might be a case of suck-it-and-see, as there are a number of whitelisted JRE classes which you are allowed to use. If the library uses any classes which are outside of this whitelist, then I'm afraid you might be out of luck unless you can code a workaround. -- You

[google-appengine] Re: File downloading to GAE Servers

2011-07-20 Thread Simon Knott
Hi, You can use the URL Fetch interface (http://code.google.com/appengine/docs/python/urlfetch/overview.html) to retrieve the file, and then store it in the datastore or Blobstore as Philip has suggested. If the file is less than 1MB, then you can use the datastore and not worry about the Blo

[google-appengine] Re: Data Center (CDN) Locations

2011-08-02 Thread Simon Knott
Hi, As far as I'm aware, the most accurate information the Google staff have divulged is that all data centres are located in North America somewhere. Cheers, Simon -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion

[google-appengine] Re: Request to assign an old name to an App Engine project

2011-08-05 Thread Simon Knott
Hi, I'm afraid you're out of luck - once used, a name can't be used again, even if it's deleted. Cheers, Simon -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/goog

[google-appengine] Re: Here's a strange one!

2011-08-05 Thread Simon Knott
Those session keys are actually slightly different - I don't know whether that was just a copy/paste error. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-ap

Re: [google-appengine] Here's a strange one!

2011-08-05 Thread Simon Knott
Ah sorry, sluggish Friday afternoon reading! Can you tell how long the session keys are being cached for? Those combined errors could have serious consequences for any GET requests! As you say, how it can possibly work is baffling. -- You received this message because you are subscribed to

[google-appengine] Re: Total Stored Data usage stays after removing all entities

2011-08-12 Thread Simon Knott
How long ago did you delete the data? I believe that all deletes are initially "soft" deletes, which are subsequently "hard" deleted at some point later in time. Once they've been "hard" deleted, the storage is then released. In my experience this can take 24hrs to be reflected in the datasto

[google-appengine] Re: Classloading still way too slow. Any recommended practices? (yes, I am using warmup requests already)

2011-08-16 Thread Simon Knott
Are these classes your own, or from third-party libraries? Do you deploy your own classes inside a JAR, or just within WEB-INF classes? -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://gro

[google-appengine] Re: Classloading still way too slow. Any recommended practices? (yes, I am using warmup requests already)

2011-08-16 Thread Simon Knott
Have you tried deploying the classes as a JAR? I only ask, because I seem to remember someone posting recently who was complaining that file reading on GAE appeared to be slow - maybe it's not the classloading which is actually taking the time, but reading the class files from disk (which seems

[google-appengine] Re: Cron job

2011-08-19 Thread Simon Knott
The answer to question 1 is 10 minutes. I don't know the answer to question 2 I'm afraid! -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/bBtdQKs

[google-appengine] Re: Classloading still way too slow. Any recommended practices? (yes, I am using warmup requests already)

2011-08-19 Thread Simon Knott
Wow, glad it worked so well! Time to go and Jar my classes up as well... -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/-WlJUmVddaYJ. To post t

[google-appengine] Re: Classloading still way too slow. Any recommended practices? (yes, I am using warmup requests already)

2011-08-20 Thread Simon Knott
Hi, I suspect the use-case where you want to override a class in another JAR is fairly infrequent, or at least it is in my experience. Maybe the deployment tool could just have an option on it to deploy everything as a JAR, if the benefits are really that great, or default it to this scenari

Re: [google-appengine] Re: Classloading still way too slow. Any recommended practices? (yes, I am using warmup requests already)

2011-08-22 Thread Simon Knott
I've just deployed one of my apps with the classes JARed and it's halved the loading request elapsed time for me, although it hasn't really touched the CPU_ms time. Admittedly it only has 53 classes in it, but a decrease of 5 to 2.5 seconds is a noticeable speed-up which I'm more than happy wit

[google-appengine] Re: GAE local webapp - datastore persistence too slow

2011-08-24 Thread Simon Knott
Is your app on GAE on the Master/Slave datastore or the HR datastore? The problem with the development server, in its default configuration, is that it emulates eventual consistency but it's quite extreme. Up to this point, I've never hit the delays that are pre-configured into the dev server

[google-appengine] Re: Our new performance tuning "best practices" document

2011-08-27 Thread Simon Knott
Hi, Thanks for taking the time to write up your thoughts - it's always really useful to learn from other peoples' experiences. I'm also glad to be a hero for a day :) Cheers, Simon -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To vi

[google-appengine] Re: Is Google killing GAE?

2011-09-04 Thread Simon Knott
Anders, you repeat this information again and again - I'm not really sure what your point is. Whilst the progress of CPUs is following Moore's law, the underlying network, storage and I/O-stack doesn't necessarily follow this curve. Even if it did, Google won't be updating their datastore hard

[google-appengine] Re: how to reindex a property that once set to indexed = false?

2011-09-04 Thread Simon Knott
Hi, You need to retrieve all objects that were written in this period out of the datastore and re-put them - single-property indexes are only written on putting the entity. If you can't work out which entities were written in this period, then you will need to retrieve all entities and re-put

[google-appengine] Re: Is Google killing GAE?

2011-09-05 Thread Simon Knott
I'm not sure I've seen any mention that the price won't be dropped at *all*in the future, just that they aren't planning any price drops in the near future. Pretty much every industry plays upon peoples' lack of knowledge! At the end of the day, companies who do their research will go for the

Re: [google-appengine] Keep it short: Who is forced to leave GAE?

2011-09-05 Thread Simon Knott
Hi Johan, The problem seems to be that a lot of people would like to be able to specify that there are no idle instances. i.e. Max idle instances is zero. These are small applications whose current QPS will not require more than one instance; in fact the owners would like to ensure that the

Re: [google-appengine] Keep it short: Who is forced to leave GAE?

2011-09-05 Thread Simon Knott
Hmm, the first one looks good. I was certain that someone mentioned that the scheduler / min-pending latency issue had been raised as well. I'll dig through the posts this evening to try and locate it. >From my own experience, I'm got the following setup for a Java H/R application: *Min idle

Re: [google-appengine] Keep it short: Who is forced to leave GAE?

2011-09-05 Thread Simon Knott
Hmm, got the min and max the wrong way round on the idle instances and pending latency settings! Also, the production issue I was referring to seems to be a bit more generic and is issue 5765 -- You received this message because

Re: [google-appengine] Keep it short: Who is forced to leave GAE?

2011-09-05 Thread Simon Knott
Thanks Johan. I'll raise an issue, if only to get someone to say "This is working as intended" or not! -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appe

Re: [google-appengine] Keep it short: Who is forced to leave GAE?

2011-09-05 Thread Simon Knott
I've raised issue 5787with further information. Thanks again for the prompt responses. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web vis

Re: [google-appengine] Re: Even the HR Datastore is (slightly) having performance issue now.

2011-09-06 Thread Simon Knott
I've attached graphs showing the daily stats for each of the HR operations for the last year, driven from the GAE Status stats. I'll grab the M/S datastore statistics, when I get the time, to give a comparison.

Re: [google-appengine] Re: the min instace time is 24 hours?

2011-09-06 Thread Simon Knott
Thanks for the description Jon, that clears up a lot of my misunderstanding! -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/Q5cRpciJ6V8J. To post

[google-appengine] Re: Wrong Total Storage Data

2011-09-08 Thread Simon Knott
The 0.67GB shows the total data which is used by your own data (the 100MB), plus single-property and custom indexes. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/

Re: [google-appengine] Re: Instances + Memcache + Users

2011-09-09 Thread Simon Knott
Robert, where did you get the 128MB limit from? Is this limit only in effect when the new billing comes in? I noticed in the recent IRC chat log that Ikai mentioned that they had noticed more applications hitting a 180MB soft limit, reduced from 200MB, with a 300MB hard limit. -- You receive

[google-appengine] Re: A SELECT query that returns 10 rows, twice as expensive as 5 rows?

2011-09-09 Thread Simon Knott
Hi, Did you read the FAQ that was linked? It's quite clear that if you fetch 10 entities, then this will be double the cost of fetching 5 entities. - *Read operations (Query, Entity Fetch)* Each of these operations will cost $0.07 per 100k operations. *"Under the new scheme, is it more

[google-appengine] Re: A SELECT query that returns 10 rows, twice as expensive as 5 rows?

2011-09-09 Thread Simon Knott
Under the section "Which datastore operations incur charges? " -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/JsDoXdGTA1kJ. To post to this group,

[google-appengine] Re: A SELECT query that returns 10 rows, twice as expensive as 5 rows?

2011-09-09 Thread Simon Knott
The very last example in the datastore pricing section gives a comparison between a keys-only query, with key fetches, versus a normal query and gives the cost of that query for 1000 entities. >From their maths, it can be seen that the cost of a query is actually the cost >of fetching the enti

Re: [google-appengine] Re: Disappearing posts

2011-09-10 Thread Simon Knott
Ditto, they were definitely there at one point! -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/8_Q3wHeCJygJ. To post to this group, send email to

Re: [google-appengine] Re: Why I think it's the time to leave GAE.

2011-09-10 Thread Simon Knott
At least your within the new daily limit of 28hrs for the free instance! -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/WAxArNusrP0J. To post to t

Re: [google-appengine] Re: Why I think it's the time to leave GAE.

2011-09-10 Thread Simon Knott
At least you're within the new limit of 28hrs for a free instance - http://googleappengine.blogspot.com/2011/09/few-adjustments-to-app-engines-upcoming.html -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web

[google-appengine] Re: High Replication -- Writes Way Higher Than Reads

2011-09-13 Thread Simon Knott
Have you read this thread - https://groups.google.com/d/msg/google-appengine/mjnSqQWOfqU/cgPVeHbrR8oJ? It explains what happens at the datastore when an entity is put, and how this converts into datastore writes. -- You received this message because you are subscribed to the Google Groups "Go

Re: [google-appengine] Marketplace for Google App Engine apps

2011-09-15 Thread Simon Knott
+1 -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/jve6DfGGTs0J. To post to this group, send email to google-appengine@googlegroups.com. To unsubsc

  1   2   3   >