[appengine-java] how appengine app out of memory

2011-09-11 Thread Luke
let say our code is buggy and there is memory leak. but somehow the aplication still run well. when instance of server run out of memory. will appengine auto scale it for more memory ? would be good as temporary measurement to handle such situation right? -- You received this message because

[appengine-java] Re: how appengine app out of memory

2011-09-11 Thread de Witte
The instance will throw an exception and will be killed. The error will be visible in your logs. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To view this discussion on the web visit

[appengine-java] Re: URLFetch Http Method DELETE returns http response 400

2011-09-11 Thread dreamer
status 400. HTTPRequest Bad request ? try without DELETE - do some simple stuff. Make sure url is accessible. http://schoolk12.appspot.com/ On Sep 5, 9:40 am, Nischal nischalshett...@gmail.com wrote: Haven't tried it on production yet, but it isn't working in development... Let me try and

[appengine-java] Java OAuth API, example

2011-09-11 Thread de Witte
Hello, I'm trying to find any example for the OAuth API. The trunk for http://oauthexample.appspot.com/Welcome seems to be empty. http://code.google.com/p/googleappengine/source/browse/#svn%2Ftrunk%2Fjava%2Fdemos%2Foauth Are there any other examples? Can google upload the code of

[appengine-java] Re: URLFetch Http Method DELETE returns http response 400

2011-09-11 Thread Nischal
The URL is accessible. It's for the facebook graph api. Like I said, works when using Apache Http client but I need to make it work on appengine as well. This is for face4j https://github.com/nischal/face4j , an open source facebook graph api java library that I have created and maintain. --

[appengine-java] Re: Help: Memcache - not hitting at all

2011-09-11 Thread realdope
Here's rest of the code: public class Memcache { private static int EXPIRY = 60*60*24*30; private static final String POSTIDKEY=POSTID_; private static boolean has(String key) { return MemcacheServiceFactory.getMemcacheService().contains(key) get(key).length()0; }

[appengine-java] Re: Java OAuth API, example

2011-09-11 Thread Daniel Florey
As it is not related to GAE you should check the GData docs. You'll find all the good stuff there. On Sep 11, 1:56 pm, de Witte jcreator.xi...@gmail.com wrote: Hello, I'm trying to find any example for the OAuth API. The trunk forhttp://oauthexample.appspot.com/Welcomeseems to be empty.

[appengine-java] Re: Java OAuth API, example

2011-09-11 Thread Daniel Florey
...or are you interested in implementing an OAuth provider? Then of course it is a different story. On Sep 11, 11:12 pm, Daniel Florey daniel.flo...@gmail.com wrote: As it is not related to GAE you should check the GData docs. You'll find all the good stuff there. On Sep 11, 1:56 pm, de Witte

[appengine-java] Re: Retrieving keys involving corresponding entities in transaction

2011-09-11 Thread Nichole
Hi Mauricio, I think I need more information: What relationships do you have between your entities? For the Conversation/Comment example above I can derive something like this: === Conversation -- commentKey: Key status: String rank: Integer

[appengine-java] Re: Problem with URL paths in deployed version of Google App

2011-09-11 Thread Nichole
In addition to adding urls to your appengine-web.xml, if you intend app to be your application default root path, see: http://code.google.com/appengine/docs/java/config/appconfig.html#Changing_the_Root_Directory On Sep 9, 12:13 pm, jem...@gmail.com wrote: Static  file are dealt with

[appengine-java] Re: Delete Lots Of Data

2011-09-11 Thread Nichole
Can use low-level datastore and iterate over batches: binSize = 1000;// or smaller if needed 30 sec timeout DatastoreService datastore = DatastoreServiceFactory.getDatastoreService(); Keys only select and delete: javax.jdo.Query q = pm.newQuery(select key from +

[google-appengine] Re: Re-entrancy / deadlock bug with scheduler?

2011-09-11 Thread Pol
Still happening right now. I can repro pretty easily: schedule ~10 image processing tasks in a queue, and 1 to 3 often fail due to that re-entrancy bug. Then after they retry automatically and after a few times usually go through. 5 instances idle / running, no load on the app: only 1 user

[google-appengine] Re: Python library for uploading to AppEngine

2011-09-11 Thread Jan Zawadzki / Hapara
At the risk of asking the obvious, you mean other than appcfg.py? J On Sep 11, 4:48 pm, Emlyn emlynore...@gmail.com wrote: Is there a python library for uploading code to AppEngine? I'd like to build an App that can upload code to other apps, has anyone done this already? -- Emlyn

Re: [google-appengine] Re: Python library for uploading to AppEngine

2011-09-11 Thread Emlyn
Yep. Or, can you consume appcfg.py from inside your app? If you can, then that's the answer to my question. yes, in advance, I am a hopeless n00b, sob On 11 September 2011 15:47, Jan Zawadzki / Hapara jan.zawad...@hapara.com wrote: At the risk of asking the obvious, you mean other than

Re: [google-appengine] Re: Python library for uploading to AppEngine

2011-09-11 Thread Robert Kluin
It is just a Python script. Open it up and have a look at what it does. On Sun, Sep 11, 2011 at 01:37, Emlyn emlynore...@gmail.com wrote: Yep. Or, can you consume appcfg.py from inside your app? If you can, then that's the answer to my question. yes, in advance, I am a hopeless n00b, sob

Re: [google-appengine] Re: Google App engine NO LONGER FOR SMALL DEVELOPERS

2011-09-11 Thread romesh soni
Thanks Guys for your suggestions. If I switch to any GAE pricing model, it will not suit me. However, I have some shared hosting providers which are very cheap. I can switch some sites of mine which are on GAE. Clients here don't know about HRD, Cloud, distributed db. Any mysql db + small disk

Re: [google-appengine] Re: Python library for uploading to AppEngine

2011-09-11 Thread Tim Hoffman
HI As robert says it is just python. Also its using the remote_api. So all definately do-able. I run remote_api stuff inside zope to transparently access the datastore from within zope. Rgds Tim -- You received this message because you are subscribed to the Google Groups Google App

Re: [google-appengine] Re: Python library for uploading to AppEngine

2011-09-11 Thread Emlyn
On 11 September 2011 16:17, Robert Kluin robert.kl...@gmail.com wrote: It is just a Python script.  Open it up and have a look at what it does. It's not just a python script, it's a fair sized system. I had a quick look a while back and thought, hmm, this will take work. So before I get into

Re: [google-appengine] Re: Python library for uploading to AppEngine

2011-09-11 Thread Emlyn
My google-fu is failing. Do you have any specific links to more info on uploading code using remote_api? On 11 September 2011 16:58, Tim Hoffman zutes...@gmail.com wrote: HI As robert says it  is just python. Also its using the remote_api. So all definately do-able.  I run remote_api stuff

Re: [google-appengine] Re: The Amazing Story Of Appengine And The Two Orders Of Magnitude

2011-09-11 Thread Gerald Tan
I'm ok with that. Your next concern would be the Datastore Reads. I think you should be able to bring that down a lot by using memcache and/or combining your monitors into a few entities. I'm not familiar with python, but I believe you can use pickle to serialize an array of monitors into a

[google-appengine] Re: Suggestion: Please implement price threshold on GAE apps

2011-09-11 Thread Warwick Allison
But as always, it is easier say than done. Don't know if this idea can be implemented. Considering that is how the previous budget concept works (except on a daily basis), I doubt additional rocket science would be required. There may however be plenty of business reasons not to stop people

Re: [google-appengine] Re: The Amazing Story Of Appengine And The Two Orders Of Magnitude

2011-09-11 Thread Emlyn
On 11 September 2011 18:17, Gerald Tan woefulwab...@gmail.com wrote: I'm ok with that. cool Your next concern would be the Datastore Reads. I think you should be able to bring that down a lot by using memcache and/or combining your monitors into a few entities. I'm not familiar with python,

[google-appengine] New pricing scheme and concerns about abuse

2011-09-11 Thread Bay
Say someone does not like a person behind one of the small/medium sized apps on app store (lets say 2-3 instances continously each day). For the sake of argument, say that it is me, but it could just as easily apply to any of you guys out there. What will stop a person of ill intend to make

Re: [google-appengine] Re: Please add MIN idle instances and MAX total instances

2011-09-11 Thread Tim
A max-instances setting would, as you say, let you spread your capacity exceeded failures to some proportion of requests made during the busiest periods rather than to all requests at some time period at the end of the day/week/month, but it would also risk failing to serve some requests which,

Re: [google-appengine] Re: The Unofficial Google App Engine Price Change FAQ

2011-09-11 Thread Tim
On Saturday, 10 September 2011 19:30:13 UTC+1, Jeff Schnitzer wrote: Is this really true, that if you burst to 100 instances you won't get the 15-minute charges? Even if you have it set to automatic? I'd like to hear an official voice on this matter. See Jon McAlister's detailed

Re: [google-appengine] Re: Why I think it's the time to leave GAE.

2011-09-11 Thread de Witte
@ Gerald, You may end up loading a 32mb file from the blobstore. Just use multiple page entities for a single article entity. @ Keakon, Those reasons don't apply, seems you misunderstood the pattern, feel free to ask for more details. -- You received this message because you are subscribed to

[google-appengine] Re: Disappearing posts

2011-09-11 Thread Gary Frederick
On Saturday, September 10, 2011 6:22:05 PM UTC-5, Rob Smith wrote: Thanks for confirming that I wasn't just imagining it! I should have clarified someone in a different forum... -- You received this message because you are subscribed to the Google Groups Google App Engine group. To

[google-appengine] Re: New pricing scheme and concerns about abuse

2011-09-11 Thread Daniel Florey
Please star thishttp://code.google.com/p/googleappengine/issues/detail?id=5858issue. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/aUrt2tWUgD8J.

[google-appengine] Re: Google Bot Is Your Enemy

2011-09-11 Thread Roch Delsalle
Here is what I noticied : http://www.d-ro.ch/2011/09/appengine-cloudflare-crawlrate Anyway you shouldn't block Googlebot that would de-index you form google. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web

Re: [google-appengine] Re: Python library for uploading to AppEngine

2011-09-11 Thread Tim Hoffman
Hi Sorry no specific links. Have a read of appcfg.py in google/appengine/tools/appcfg.py , specifically the class AppVersionUpload. It uses remote_api rpc calls under the hood All of the appcfg functions that talk to a remote server do. If you wanted to build your own wrapper I would be

[google-appengine] Scheduler Question

2011-09-11 Thread JH
I have a question about the new scheduler. Before HRD the scheduler use to tear down instances very aggressively. Now it doesn't appear to. I have some hobby apps that may get no traffic at all for hours, however, the scheduler keeps 1 instance alive. It seems to me after 15 minutes of no

Re: [google-appengine] Scheduler Question

2011-09-11 Thread Joshua Smith
It's been pretty conclusively determined on these groups that those extra instances don't cost you anything, as long as you keep the idle instances slider over to the left in App Settings. It has also been stated by our google overlords that these freebie instances are more prevalent in the

[google-appengine] Re: Disappearing posts

2011-09-11 Thread Rob Smith
I was referring to the earlier messages, which confirmed that my messages had been there at one point. Thanks for clarifying though. On Sep 11, 12:56 pm, Gary Frederick g...@jsoft.com wrote: On Saturday, September 10, 2011 6:22:05 PM UTC-5, Rob Smith wrote: Thanks for confirming that I wasn't

Re: [google-appengine] Scheduler Question

2011-09-11 Thread Rishi Arora
To add to what Josh said, the billing rule states that front-end instances won't incur any idle charges after idling for 15 minutes, even if they stay running. On Sun, Sep 11, 2011 at 9:31 AM, Joshua Smith joshuaesm...@charter.netwrote: It's been pretty conclusively determined on these groups

[google-appengine] Re: Scheduler Question

2011-09-11 Thread JH
Great to know, sorry I missed those threads. Thanks, On Sep 11, 10:07 am, Rishi Arora rishi.ar...@ship-rack.com wrote: To add to what Josh said, the billing rule states that front-end instances won't incur any idle charges after idling for 15 minutes, even if they stay running. On Sun, Sep

[google-appengine] Min idle instances setting not working at all?

2011-09-11 Thread Pol-Online
Hi, Because we are about to launch our app very soon, I increased the number of idle instances from 1 to 5 yesterday and things looked correct in the Dashboard. Then this morning, in the Dashboard I see 2 idle instances and this: The spikes correspond to cron tasks running hourly I assume.

[google-appengine] Re: Min idle instances setting not working at all?

2011-09-11 Thread Pol
Oops looks like the image was stripped, you can see it here: http://oi52.tinypic.com/12349hi.jpg On Sep 11, 9:53 am, Pol-Online i...@pol-online.net wrote: Hi, Because we are about to launch our app very soon, I increased the number of idle instances from 1 to 5 yesterday and things looked

Re: [google-appengine] Re: Adding 5GB of Blobstore data to App Engine over 3 three days costs $61 by end of year?

2011-09-11 Thread Chris Collins
Jens, Your original calculation is correct - $61/year for 15 GB of blobstore data. The reason is, as you pointed out, that the data is counted both as blobstore data and stored data/datastore data. HTH, Chris On Fri, Sep 9, 2011 at 10:37 PM, Niklas Rosencrantz nikla...@gmail.comwrote: In

[google-appengine] Re: Please add MIN idle instances and MAX total instances

2011-09-11 Thread WeatherPhilip
On Sep 10, 4:51 pm, Barry Hunter barrybhun...@gmail.com wrote: On Sat, Sep 10, 2011 at 9:38 PM, WeatherPhilip It is 28 hours :) http://googleappengine.blogspot.com/2011/09/few-adjustments-to-app-en... Not reflected in the 'billing estimate's yet. Get 9 hours of backends free too. A

Re: [google-appengine] New pricing scheme and concerns about abuse

2011-09-11 Thread Waleed Abdulla
You're describing what's known as a denial of service attack. These attacks could happen to any Website on any platform. On GAE you're more protected, out of the box, than most other hosting solutions. 1. GAE automatically blocks IPs that it senses strange activity from. I've encountered this on

Re: [google-appengine] Re: Python library for uploading to AppEngine

2011-09-11 Thread Waleed Abdulla
I've done something close in the past where I have a GAE app that pulls Python script from another location and executes it. Not sure if that helps you, but here it is. Make sure the script is safe, though, because it'll be running against your own datastore. try:

Re: [google-appengine] New pricing scheme and concerns about abuse

2011-09-11 Thread Bay
I dont think you understand... The above specifically mentions - among other things - that 1) there are no programatic apis to the blacklist 2) the mechanisms to limit costs for a small app under a attack are much worse under the new billing system than under the old one... hence: -

[google-appengine] Re: Please add MIN idle instances and MAX total instances

2011-09-11 Thread Daniel Florey
After thinking about this for a while I think I would prefer to just have a min and max instances slider. I am running different apps on app engine and for the larger ones I'd like to have a min instances = 10 and max instances = unlimited to be able to scale up fast once heavy traffic occurs.

[google-appengine] Re: Adding 5GB of Blobstore data to App Engine over 3 three days costs $61 by end of year?

2011-09-11 Thread Strom
No it is not correct. Blobstore is not counted as datastore data. Have a quick look at your billing history page for confirmation. On Sep 11, 8:35 pm, Chris Collins xop...@gmail.com wrote: Jens, Your original calculation is correct - $61/year for 15 GB of blobstore data. The reason is, as

Re: [google-appengine] New pricing scheme and concerns about abuse

2011-09-11 Thread Gerald Tan
I believe you will be able to cap your daily total instance hours. If you use that and get DOSed, your app will continue to be responsive through the attack, but you may end up losing service when you reach your quota near the end of the billing day. If you cap Active Instance (that's the

RE: [google-appengine] Re: Google Bot Is Your Enemy

2011-09-11 Thread Brandon Wirtz
Your crawl rate changed because the Headers for serving changed from GAE to CF In a Week they will be back to normal. From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Roch Delsalle Sent: Sunday, September 11, 2011 5:02 AM To:

Re: [google-appengine] New pricing scheme and concerns about abuse

2011-09-11 Thread Bay
I believe you will be able to cap your daily total instance hours. -- please tell me how to do this... currently there is only a setting to control max *idle* instances. During dos they will *not* be idle... -- You received this message because you are subscribed to the Google Groups Google

Re: [google-appengine] New pricing scheme and concerns about abuse

2011-09-11 Thread Gerald Tan
Under Billing Settings. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/YKAkWttT-DYJ. To post to this group, send email to

[google-appengine] Re: Remote API: how to find out the app ID of the server??

2011-09-11 Thread andrew
Hi Fred, This week we planned to look at something very similar, so maybe we can share notes. I notice that if you enable datastore admin, there seems to be an option to export datastore to another appid. To be seen how it handles keys, namespaces, etc. That won't cover export to local

RE: [google-appengine] New pricing scheme and concerns about abuse

2011-09-11 Thread Brandon Wirtz
I serve Denied if IP matches X. You don't need Google For this. I do the same thing if User Agent = X This is a risk with any solution, from DreamHost to Amazon to RackSpace. I can ruin your day regardless of platform. From: google-appengine@googlegroups.com

[google-appengine] Is it possible to have multiple primary domains (not subdomains) running against a single app?

2011-09-11 Thread Jens Stoltenberg
I have a single app with multiple namespaces defined. I'd like to set up multiple domains a.com b.com c.com and have the app detect the domain and write the domain's data into its respective namespace. However, on the production admin panel, it only seems to allow you to configure a single

RE: [google-appengine] Is it possible to have multiple primary domains (not subdomains) running against a single app?

2011-09-11 Thread Brandon Wirtz
Google.com/a/YourDomain.com Deploy the App, and assign it to a subdomain (like www) From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Jens Stoltenberg Sent: Sunday, September 11, 2011 2:02 PM To: google-appengine@googlegroups.com Subject:

Re: [google-appengine] Re: Google Bot Is Your Enemy

2011-09-11 Thread Roch Delsalle
Ok, I agree that must have had an impact but how do you explain one month down to almost zero when my headers were sent by gae ? On Sun, Sep 11, 2011 at 9:13 PM, Brandon Wirtz drak...@digerat.com wrote: Your crawl rate changed because the Headers for serving changed from GAE to CF In a Week

Re: [google-appengine] Is it possible to have multiple primary domains (not subdomains) running against a single app?

2011-09-11 Thread Jens Stoltenberg
It worked. Thanks, man. Much easier than I expected :) On Sun, Sep 11, 2011 at 10:10 PM, Brandon Wirtz drak...@digerat.com wrote: Google.com/a/YourDomain.com Deploy the App, and assign it to a subdomain (like www) ** ** ** ** *From:* google-appengine@googlegroups.com [mailto:

RE: [google-appengine] Re: Google Bot Is Your Enemy

2011-09-11 Thread Brandon Wirtz
Without the Domain name, I don't. But a trick you can use to get deeper indexing on your pages is to change the server headers, IP address, and Expiration every week or so. But Google bot responds to Change with lets crawl everything when it finds less change, it reduces the crawl.

Re: [google-appengine] Re: How deployments influence instance hours?

2011-09-11 Thread Sergey Schetinin
Bump #2 On 7 September 2011 13:53, Sergey Schetinin mal...@gmail.com wrote: Bump On Sunday, 4 September 2011 14:20:31 UTC+3, Sergey Schetinin wrote: So when we deploy a new version, let's assume there was one instance running, it gets shut down, a new one is then started, how many

Re: [google-appengine] Instance Hours, Python Concurrency, and Regret

2011-09-11 Thread Jeff Schnitzer
The GIL (old or new) is not a problem for concurrency unless your application spends large quantities of time CPU-bound. As soon as you make an I/O request, some other thread will run. The GIL doesn't hurt. Jeff On Sat, Sep 10, 2011 at 4:04 PM, Steve unetright.thebas...@xoxy.net wrote: I (and

[google-appengine] Re: 1.5.4 SDK Prerelease

2011-09-11 Thread Daniel
Are there any Doc/Examples of using async Memcache calls ? Sounds interesting - Added API functionality for making calls to the Memcache API asynchronously. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send

Re: [google-appengine] Instance Hours, Python Concurrency, and Regret

2011-09-11 Thread Steve
On Sunday, September 11, 2011 3:27:43 PM UTC-7, Jeff Schnitzer wrote: The GIL (old or new) is not a problem for concurrency unless your application spends large quantities of time CPU-bound. As soon as you make an I/O request, some other thread will run. The GIL doesn't hurt. Jeff On my

Re: [google-appengine] Re: The Unofficial Google App Engine Price Change FAQ

2011-09-11 Thread Gregory D'alesandre
This is the official word: *You are only charged the 15 minute idle time for the number if idle instances up to your max idle instances.* So, if you have 200 instances spin up for 10 minutes and then all traffic stops and your max idle instances is set to 5. You would be charged for (200 *

Re: [google-appengine] Instance Hours, Python Concurrency, and Regret

2011-09-11 Thread Jeff Schnitzer
On Sun, Sep 11, 2011 at 6:31 PM, Steve unetright.thebas...@xoxy.net wrote: On my GET requests, I/O accounts for roughly half of the time to process the request.  When a user POSTs new data, my app does a fair amount of recalculations and I/O is only about 20% of the request processing time.  

Re: [google-appengine] Instance Hours, Python Concurrency, and Regret

2011-09-11 Thread Steve
The old 2.5/2.7 GIL hurts performance any time there is more than one thread that is doing python work. Maybe you'd like to read up on how the old GIL burns cpu time in excess signalling and failed lock acquisition: http://www.dabeaz.com/python/NewGIL.pdf -- You received this message because

[google-appengine] Datastore viewer not showing one of the properties for my model

2011-09-11 Thread Alexander Zylman
(apologies for not putting this in the python-specific forum - as far as I can tell, there isn't one, despite what the welcome message says) Hey guys, I have a model defined like so: class stickletUser(db.Model): author = db.UserProperty() email = db.EmailProperty() has_shared =

[google-appengine] About the mail api again, the surrounding services gae is proud of

2011-09-11 Thread Tapir
I found there are not exceptions thrown even the recipient email addresses don't exist at all. In my app, half new users didn't activate their accounts. I doubt they haven't received the activation mail. But how do I know if the new users have received the activation mail or not? Someone argued

Re: [google-appengine] About the mail api again, the surrounding services gae is proud of

2011-09-11 Thread milosh zorica
you can use a nifty old trick by placing an ''invisible'' image somewhere within a message so if a user reads a message, image file on your server gets accessed the simplest receipt verification technique though On Mon, Sep 12, 2011 at 2:16 AM, Tapir tapir@gmail.com wrote: I found there are

[google-appengine] Re: Datastore viewer not showing one of the properties for my model

2011-09-11 Thread Tim Hoffman
Hi The group is google-appengine-python Rgds Tim -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/bmtjKeHqQ9YJ. To post to this group, send email

[google-appengine] Re: Datastore viewer not showing one of the properties for my model

2011-09-11 Thread Alexander Zylman
Thanks. It doesn't show up in search results for groups, eve when I type in the exact name... -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit

[google-appengine] Re: Datastore viewer not showing one of the properties for my model

2011-09-11 Thread Tim Hoffman
Hey Your right. Not good . Here is the link to the group https://groups.google.com/forum/?hl=en#!forum/google-appengine-python -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit

Re: [google-appengine] About the mail api again, the surrounding services gae is proud of

2011-09-11 Thread Tim Hoffman
Hi That will only tell you they read it, if they have images enabled by default. I don't for instance in my email. If they don't read it with images enabled you can't tell if it was not delivered or just unread. I wouldn't expect exceptions to be raised from bogus email addresses unless they