[google-appengine] Logging messages don't appear in the logs anymore

2011-07-18 Thread Volker Schönefeld
Hey, We are using logging.* to log specific events, and then later analyze them offline. Usually at around 5 rps, which hasn't changed. For us, since july 15th, these logging.* requests are only logged occasionally. Instead of the usual 80-100mb of logs of severity 0, we only get about 15-30mb

[google-appengine] Strange Backend Behavior

2011-09-03 Thread Volker Schönefeld
Hey, we've accumulated a large dataset on our appengine (almost a terrabyte now), and we're struggling to delete it (mostly old data that is no longer needed). After years of trying this and that, I gave backends a shot, but the behavior is really strange. Essentially, I've got a little deleter

[google-appengine] Re: Backend confusion

2011-09-03 Thread Volker Schönefeld
I've had the same issues with the backend logservice. As soon as I use logservice anywhere in the code, no log messages will appear at all, except for service error 201 and instance startups. I've also posted a related post here: http://groups.google.com/group/google-appengine/browse_thread/thread

[google-appengine] Re: Strange Backend Behavior

2011-09-03 Thread Volker Schönefeld
Hey, thanks, that actually seemed to have helped. I still don't get any log messages, but I'm now using memcache to output some debug information into a handler running on the server, and it's actually deleting data. Thanks for the help! On 3 Sep., 17:32, Tim Hoffman wrote: > With this code you

[google-appengine] Abysmal Query Performance in Backend

2011-09-04 Thread Volker Schönefeld
Hey, Yesterday, I've had a service running to delete a huge (1 TB) backlog of data from our appengine instance. It was working well at around 100 entities/sec (has about a million entities). Today, however, it slowed down to around 0-1 entities/sec, using the same code. I tracked it down to qu

[google-appengine] Re: Abysmal Query Performance in Backend

2011-09-04 Thread Volker Schönefeld
Oh, I ment the dataset has 100 million entities, so it's far from being done. There is still around 850 GiB worth of data that wants to be deleted. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit h

Re: [google-appengine] Re: Abysmal Query Performance in Backend

2011-09-04 Thread Volker Schönefeld
Hey Alfred, thanks for the reply. I've got a couple more questions regarding the compaction, I hope you can answer a few: - When do those compaction events happen? - What is their frequency? - How can I tell if one happened? Thanks! Volker -- You received this message because you are subscr

[google-appengine] Backends CPU Usage

2011-09-04 Thread Volker Schönefeld
Since running a single B1 backend, the CPU usage of our instance has increased by an order of magnitude. Nothing else has changed. So my question is: In addition to the explicit backend cost, does the backend cpu usage count towards the CPU Time resource on the front page? Or is this "indirect"