RE: [google-appengine] How to force immediate log writes in Java?

2011-05-14 Thread Brandon Wirtz
http://code.google.com/intl/en/appengine/docs/java/runtime.html -Original Message- From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Mike Prince Sent: Saturday, May 14, 2011 11:29 PM To: Google App Engine Subject: [google-appengine] How to for

[google-appengine] How to force immediate log writes in Java?

2011-05-14 Thread Mike Prince
I have a servlet that works fine in development but crashes the server in production and I'm trying to figure out why. Since the log files seem to be flushed at the end of the HTTP request, and the server is crashing, nothing is written and I'm flying blind. I thought I heard mention of a way to

Re: [google-appengine] Numbers that don't quite add Up?

2011-05-14 Thread Stephen Johnson
Well, the Datastore Statistics don't add in any indexing, etc. whereas the quota details does add that in. On Sat, May 14, 2011 at 9:37 PM, Brandon Wirtz wrote: > This isn’t a big deal, but the numbers don’t sum what I’d have expected… > > > > Both of these are about 2.5x in billing what I think

[google-appengine] Numbers that don't quite add Up?

2011-05-14 Thread Brandon Wirtz
This isn't a big deal, but the numbers don't sum what I'd have expected. Both of these are about 2.5x in billing what I think I am doing in storage. Where does the Discrepancy come from? >From the Dashboard:290 MB on one app 1.56GB on the other High Replication Data $0.008/ GByte-d

Re: [google-appengine] Re: Possible to Defer Tasks to Backend

2011-05-14 Thread Greg Darke (Google)
Since backends and frontends are updated separately, the code in each may be different. Updating a frontend does not change the code that is running in a backend/vice versa. As for the syntax, I believe it should be: deferred.defer(deferred_fn_name, param1, param2, _target='backend-name') On 14 M

Re: [google-appengine] Understanding Security

2011-05-14 Thread Eric Kolotyluk
Woo-Hoo! Thanks, I can't wait to try that, but I'm don't working for the day. Cheers, Eric On 2011-05-14 10:15 AM, Erick Fleming wrote: Actually I was wrong I on the last point. If you use appengine_web.xml [1] to configure your static files as "excluded" then appengine won't move them to th

[google-appengine] Re: Possible to Defer Tasks to Backend

2011-05-14 Thread Aaron
Hi Greg, Thanks for the response. Just to be clear, the syntax to defer a task to a backend is the following? deferred.defer(deferred_fn_name, param1, param2, _target='http:// backend-name.app-id.appspot.com') Also, you mentioned that we should be sure that the backend has the same classes and c

RE: [google-appengine] HR applications and Cache Control/Pragma/Expires headers

2011-05-14 Thread Brandon Wirtz
Can I bribe somebody to do my apps? (I even moved to 1.5 hoping that'd auto fix them) My apps all return this: HTTP/1.1.200.OK(CR)(LF) Cache-Control:.no-cache,.must-revalidate(CR)(LF) Content-Type:.text/html;.charset=UTF-8(CR)(LF) Set-Cookie:.S=apphosting=JPio4yliHelJf10OZQQWDw;.path=/(CR)

Re: [google-appengine] Re: Possible to Defer Tasks to Backend

2011-05-14 Thread Greg Darke (Google)
That is correct, all tasks get the same host header as the request that created them. This means that if you access the url http://0.backend-name.app-id.appspot.com/ and it inserts a task, the task will execute against instance 0 of 'backend-name'. If you access the url http://backend-name.app-id.

Re: [google-appengine] Possible to Defer Tasks to Backend

2011-05-14 Thread Greg Darke (Google)
You should be able to send a deferred task to a backend. Some points to remember though: * You should ensure that any classes/etc you reference from the frontend must exist in the backend. * The deferred function should pass the 'target' parameter on to taskqueue * You must enable the deferred

Re: [google-appengine] Caching GeoModel requests?

2011-05-14 Thread Devraj Mukherjee
Appreciate that Brandon. On Sun, May 15, 2011 at 10:24 AM, Brandon Wirtz wrote: > Round. > > http://maps.google.com/?ie=UTF8&ll=47.595,-122.36&spn=.873914,.712402&t=h&z= > 15 > > 3 decimals of accuracy puts the boat near the center, but would you change > results if you > Were closer to the peer?

Re: [google-appengine] Caching GeoModel requests?

2011-05-14 Thread David Mora
you can shard by the biggest geocell and cache based on the smallest geocell. at then end GeoModel creates a hash based on geoboxes that you can easily play with On 14 May 2011 18:10, Devraj Mukherjee wrote: > Hi all, > > Our project http://safesharps.org.au uses GeoModel > (http://code.google.

RE: [google-appengine] Caching GeoModel requests?

2011-05-14 Thread Brandon Wirtz
Round. http://maps.google.com/?ie=UTF8&ll=47.595,-122.36&spn=.873914,.712402&t=h&z= 15 3 decimals of accuracy puts the boat near the center, but would you change results if you Were closer to the peer? http://maps.google.com/?ie=UTF8&ll=47.589,-122.37&spn=.873914,.712402&t=h&z= 15 Essentially

[google-appengine] Caching GeoModel requests?

2011-05-14 Thread Devraj Mukherjee
Hi all, Our project http://safesharps.org.au uses GeoModel (http://code.google.com/p/geomodel/). To boost performance we have been caching many of our query results using memcache, this is generally done by keeping an index of the search terms. Our app has Web / Mobile Web and upcoming mobile app

[google-appengine] Re: Possible to Defer Tasks to Backend

2011-05-14 Thread Aaron
A follow up to this question is if we can use the new pipeline API with backends. If we start a pipeline in a backend, will all future pipeline tasks be processed by the backend? On May 14, 2:41 pm, Aaron wrote: > Hi, > > The way my application is set up involves deferring a lot of long- > runni

RE: [google-appengine] Re: What's going on with my CPU times

2011-05-14 Thread Brandon Wirtz
Well Duh, You are generating a JPG, you said "send the bytes" but you are modifying, rendering, and compressing a JPG. That takes some CPU. My app sends jpgs and uses no CPU as it were because it really is "do I have this? Oh I do? Great here it is" Your app is "Hey Draw me a pretty picture" "U

[google-appengine] Re: What's going on with my CPU times

2011-05-14 Thread stevep
Thanks Brandon. Every image is unique, and is generated by users from the client. So statics limitations make it infeasible. Right now I think this has to do with the on/off again hits. I went into my Dashboard after a few individual calls, and saw I had gone from 3 resident instances: 3 resident

Re: [google-appengine] Re: Do HR-enabled apps get more than one memcached instance?

2011-05-14 Thread Sergey Schetinin
Thanks for the clarification. On 15 May 2011 00:47, Mike Wesner wrote: > Your app actually only runs out of one data center at once.  The > diagram was a little misleading.  If a data center goes down then your > app is served out of the other with a different memcache (empty) > > On May 14, 3:26

[google-appengine] Re: Do HR-enabled apps get more than one memcached instance?

2011-05-14 Thread Mike Wesner
Your app actually only runs out of one data center at once. The diagram was a little misleading. If a data center goes down then your app is served out of the other with a different memcache (empty) On May 14, 3:26 pm, Sergey Schetinin wrote: > I'm pretty sure the memcached clusters (if there a

[google-appengine] Possible to Defer Tasks to Backend

2011-05-14 Thread Aaron
Hi, The way my application is set up involves deferring a lot of long- running tasks, which I now would like to move to a backend. Is it possible to defer a task so that it is processed in a backend? Or, do I have to create handlers for every deferred task in order to take advantage of this feat

Re: [google-appengine] Re: 1.5 improvements Make me less scared of Pricing

2011-05-14 Thread Robert Kluin
If the data doesn't get updated, using the blobstore might be a good idea. As I recall, you can't update a blob. So if the data changes it may not be the best idea. Of course, it really all depends on the app / usage. I store serialized dicts / lists in text / blob properties quite often. It w

RE: [google-appengine] What's going on with my CPU times

2011-05-14 Thread Brandon Wirtz
Put it not in a blog. Consider using Static (depending what else you are doing) With out code it is hard to tell what you are doing but you may be using API cpu and not "CPU" Cpu Most of my CPU bill is API. -Original Message- From: google-appengine@googlegroups.com [mailto:google-appeng

Re: [google-appengine] Re: Do HR-enabled apps get more than one memcached instance?

2011-05-14 Thread Sergey Schetinin
I'm pretty sure the memcached clusters (if there are more than one) are not synchronized. First of all, that would be way too slow. Second, the talk I referenced specifically mentions that when the apps are being migrated from a DC, the memcache writes return success but are in fact noop, because s

[google-appengine] Re: Do HR-enabled apps get more than one memcached instance?

2011-05-14 Thread rekby
I thing HR-applications have more than one syncronised memcache - by me test save in HR-memcache in 3 times slower, than Master/Slave application. On May 14, 6:56 pm, Sergey Schetinin wrote: > So, I was watching the presentation on the HR datastore from the IO > 2011 (http://www.google.com/events

[google-appengine] Re: Tasks are not executing!

2011-05-14 Thread dloomer
I've been noticing this as well. Behavior is very similar to what I saw and reported on January 5, and which was subsequently resolved. http://groups.google.com/group/google-appengine/browse_thread/thread/7628e7474f792170/6ca1eb5f4058a9e8?lnk=gst On May 6, 8:51 pm, Nischal Shetty wrote: > Yeah

Re: [google-appengine] Understanding Security

2011-05-14 Thread Erick Fleming
Actually I was wrong I on the last point. If you use appengine_web.xml [1] to configure your static files as "excluded" then appengine won't move them to the "static" server. Therefore, you can use a statandard filtering mechanism for those files. [1] http://code.google.com/appengine/docs/ja

Re: [google-appengine] Understanding Security

2011-05-14 Thread Erick Fleming
> > If I understand what you are saying, I could make every URL map to a > servlet, and let the servlet return the specific static pages. > Yes. I generate my static content from simple templates, store them in the Datastore + Memcache, and serve them through a Servlet. There's a blog post by Ni

[google-appengine] What's going on with my CPU times

2011-05-14 Thread stevep
Can anyone help me understand these CPU times. I have an on-line handler function that basically does a get_by_id(), and sends out the bytes for a 150x100 pixel jpeg BLOB record value. A pretty straightforward image retrieval from the datastore. My CPU loads are all over the map. I am $9 paying f

[google-appengine] Do HR-enabled apps get more than one memcached instance?

2011-05-14 Thread Sergey Schetinin
So, I was watching the presentation on the HR datastore from the IO 2011 ( http://www.google.com/events/io/2011/sessions/more-9s-please-under-the-covers-of-the-high-replication-datastore.html ) and one thing caught my attention: the slides were showing the frontend instances running in more than o

Re: [google-appengine] Re: Google App Engine OAuth endpoints throwing 400 in production.

2011-05-14 Thread Will Merydith
Thanks for the reply Robert. I ended up spending several hours last night reading through the OAuth specs and SHA1 specs (in particular how to properly sign a request). I now have a much better understanding of the OAuth dance and the Google docs seem much more clear. My development partner and

[google-appengine] Re: Lot's of requests per user, aggressive caching or what?

2011-05-14 Thread Ricky Button
Thanks I'll check this out. Is there anything I can to do optimize bandwidth used. Each of those 50,000 requests are completely different entities and have different uris, (/api/articles/46452) On May 13, 10:10 pm, Gopal Patel wrote: > you can use in-instance caching. It may not be always up to

[google-appengine] Re: Datastore cost in new price

2011-05-14 Thread Strom
It's undecided but it will probably be billed per RPC. (The query is divided into multiple RPCs under the covers.) On May 14, 11:34 am, rekby wrote: > I want make full backup. > Do query "SELECT * FROM MyTable" bill as only one API call if I have some > thoutands/millions records? -- You receiv

RE: [google-appengine] Re: 1.5 improvements Make me less scared of Pricing

2011-05-14 Thread Brandon Wirtz
I don't know what I want instances to do.. I am finishing up a complete re-write of my code so that if I have to move to Java or GO that my code is perfect in Python and I can pay for a port, not a re-write. On the App I'm baking the code to make sure I didn't blow anything up on, I'm now cruisin

Re: [google-appengine] Re: 1.5 improvements Make me less scared of Pricing

2011-05-14 Thread Tim
I suspected that might be the case, but if I have a few minutes to spare sometime I might try it out. My startup and servicing costs is pretty minimal - I've got a one-page-webapp and most of my calls are just AJAX calls to load and update data, so it's typically just object to JSON and back ag

[google-appengine] Datastore cost in new price

2011-05-14 Thread rekby
I want make full backup. Do query "SELECT * FROM MyTable" bill as only one API call if I have some thoutands/millions records? -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegrou

RE: [google-appengine] How to find IP address to add to blacklist

2011-05-14 Thread Brandon Wirtz
I didn't try remming the line. I was just looking at my code and thinking . Oh maybe people don't see what I see :-) That code does the user agent which the other thread about blocking bots needs. I'm being helpful, just on the wrong thread :-) From: google-appengine@googlegroups.com [mailt

Re: [google-appengine] How to find IP address to add to blacklist

2011-05-14 Thread Nischal Shetty
I don't do that but I can still see the IPs. May be your lie works in my case :P On 14 May 2011 13:09, Brandon Wirtz wrote: > I lied, the stub code I start my projecta with has > >logging.debug('User-Agent = "%s", Referrer = "%s"', > self.request.user_agent, >

RE: [google-appengine] How to find IP address to add to blacklist

2011-05-14 Thread Brandon Wirtz
I lied, the stub code I start my projecta with has logging.debug('User-Agent = "%s", Referrer = "%s"', self.request.user_agent, self.request.referer) Which will give you this -Original Message- From: google-appengine@googlegroups.com [mailto:google