[google-appengine] Re: Datastore operations are seriously expensive

2011-11-08 Thread Kenneth
I hear what you're saying, but at that rate I'm pretty much rewriting my application plus cost isn't even known. And I like the datastore. The problem as always is how the app was written. Users can update one field at a time on a data grid and save it back via ajax, so that's seriously not e

[google-appengine] Re: Install GAE 1.6 and Python 2.72 - illegal seek error

2011-11-08 Thread Droid
more on this crazy error: here is my web call in my python script: application = webapp.WSGIApplication([ ('/', Linker), ('/bill', Linker), ('/Linky', Linker), ('/Link', Linker), ('/sign', Linker) The only one that works is - ('/Linky', Linker), BUT they are all the same otherwise. N

[google-appengine] What kind of actions belong to Small Datastore Operations?

2011-11-08 Thread zhaiduo
Hi All, My little app became over quota on Small Datastore Operations recently. What the most confused me is what kind of actions belong to Small Datastore Operations? I can't figure it out. Can anyone give me the detail for this? Appreciate your help! -- You received this message because you a

[google-appengine] Re: What kind of actions belong to Small Datastore Operations?

2011-11-08 Thread Simon Knott
Hi, Someone asked this just earlier today - https://groups.google.com/d/msg/google-appengine/csrZsowdUmY/CACgb4jWCqUJ Cheers, Simon -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.

[google-appengine] Re: What kind of actions belong to Small Datastore Operations?

2011-11-08 Thread Gerald Tan
Most of the time, it's COUNT queries that is causing over-quota for small ops. It costs 1 small op per entity counted. You should use a counter entity instead, sharding it if necessary. The rest of the time it's using OFFSET + LIMIT queries. Each offset value costs 1 small small op. You should u

[google-appengine] Help with appstats values

2011-11-08 Thread Ice13ill
Hello, I use Java SDK with low-level api, but my question is related to the interpretation of the values in appstats page (CPU, API, RPC, Grand total times, etc) For example: 1. I run a query using low level api to get only the keys for some entities. 2. query with the list of keys to get the entit

Re: [google-appengine] Re: How can I preserve appId when moving from MS to HR datastore

2011-11-08 Thread Ronoaldo José de Lana Pereira
When deploing a new app versoin in HRD, I have an index with error and even when I delete it and try again it still ends up in error status. My appid is ofertaunica-hr. Should I fill a production issue? Thanks, -Ronoaldo -- You received this message because you are subscribed to the Google Gr

Re: [google-appengine] Re: How can I preserve appId when moving from MS to HR datastore

2011-11-08 Thread stephenp
It's not there. On the "Application Settings" page I have the following light-blue titled sections: Basics, Performance, Configured Services, Built-ins, Domain Setup, Disable Datastore Writes, and Disable or Delete Application. Nothing about migration. Maybe it hasn't been rolled out to everyon

[google-appengine] zipped packages and .pyc

2011-11-08 Thread andreas schmid
hi, if i have some packages as .zip files how is GAE dealing with the .pyc files. would it have a better performance if .pyc files are included in the .zip? thx -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send

[google-appengine] Sender ID Framework

2011-11-08 Thread Martin Waller
Hello, I seem to have a problem with hotmail treating email that I send from an app running on the Google App Engine as SPAM, even though it is not. I was wondering if anyone had setup a Sender ID Framework to work with the Google App Engine to solve this type of problem and whether it worked o

[google-appengine] Create a Facebook App on GAE in a minute, new release from CoderBuddy

2011-11-08 Thread Adrian Scott
Hi guys, We've just released a new starter app that helps you create a Facebook App in a minute on Google App Engine (on CoderBuddy, the free, social web IDE). We've written up quick, detailed instructions to help you with the configuration on Facebook's Dev site as well. You can check it all out

Re: [google-appengine] zipped packages and .pyc

2011-11-08 Thread Adrian Scott
No, best to take those out. -A -- Adrian Scott, Ph.D. CEO, Founder CoderBuddy http://www.coderbuddy.com/ <-- Create a Google App Engine app in a minute without installing anything On Tue, Nov 8, 2011 at 9:02 AM, andreas schmid wrote: > hi, > > if i have some packages as .zip files how is GA

[google-appengine] errors while calling backends

2011-11-08 Thread atarno
hi again, i'm still fighting the backends.:) i have some backend instances i try to call from the front end via task queue. i see in logs that the task is successfully created and the backend is called, but on the beckend side i always left with the following: /_ah/start 500 979ms 0kb instance=1

[google-appengine] GAE 1.6 can not find python2.7 in Mac OSX 10.7.2

2011-11-08 Thread Kai
GAE in my Mac OSX 10.7.2 system was updated to 1.6.0 by its auto-updater. In the GoogleAppEngineLauncher, I have changed the "Python Path" to "/usr/bin/python2.7" from the Preferences, the logs display that the GAE still run in python2.6. Here are the Logs: *** Running dev_appserver with the f

[google-appengine] GAE 1.6 can not import module jinja2

2011-11-08 Thread Kai
I am trying my first python2.7 GAE apps. Everything goes smoothly in the GAE python2.7 Getting Started guild, except the chapter Using Templates. http://code.google.com/appengine/docs/python/gettingstartedpython27/templates.html I have added the lines in my app.yaml: libraries: - name: jinja2

[google-appengine] Re: TaskQueues all fail to execute on devserver

2011-11-08 Thread Riley
This is a show-stopper for me. Can anyone point me towards a useful resource? At this point I'm looking for someone to pay for a solution (but I _am_ hoping for less than $12k a year for appengine premium support). -- You received this message because you are subscribed to the Google Groups "G

[google-appengine] Re: Install GAE 1.6 and Python 2.72 - illegal seek error

2011-11-08 Thread Droid
I am answering my own issue. I found this (not-nice line for MACs) line in my py code: Solved: reload(sys); sys.setdefaultencoding('utf-8') # DO NOT USE ON A MAC!! For some reason this reload is OK on Windows and the GAE but not on the Mac local version - errors it out. I do not know why MacBook

[google-appengine] Re: GAE 1.6 can not find python2.7 in Mac OSX 10.7.2

2011-11-08 Thread Droid
I installed the python 2.7.2 dmg today 0n MacBook Air Lion 10.7.2 - I just let it install itself. Then I checked in a terminal window >python -v Result fine, it showed python 2.72. Then I downloaded the GAE 1.6 dmg and let that install itself too. Result - All OK (I assume my new GAE is running o

[google-appengine] Re: "illegal seek" - error

2011-11-08 Thread Droid
I am answer my own question. I found this (not-nice line for MACs) line in my py code: reload(sys); sys.setdefaultencoding('utf-8') # DO NOT USE ON A MAC!! For some reason this reload is OK on Windows and the GAE but not on the Mac local version - errors it out. I do not know why MacBook Airs

[google-appengine] Re: Cannot Run GAE Apps on MacBook Air

2011-11-08 Thread Droid
Answering my own issue. I found this (not-nice line for MACs) line in my py code: reload(sys); sys.setdefaultencoding('utf-8') # DO NOT USE ON A MAC!! OK on Windows and the GAE but not on the Mac local version - errors it out. I do not know why MacBook Airs (Lion) do not like this. it was q

[google-appengine] Re: Sender ID Framework

2011-11-08 Thread pdknsk
You should've made a new thread about it. Anyway, SPF is already added automatically by Google for mails delivered by App Engine. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegr

[google-appengine] What happened to the promised reliability improvement for email delivery?

2011-11-08 Thread pdknsk
Google announced this in May. "We have added a few restrictions to the Mail API to improve the reliability and reputation of the service for all applications. First, emails must be sent from email accounts managed by Google (either Gmail, or a domain signed up for Google Apps). Second, we’ve reduc

[google-appengine] Re: 1.6.0 is now launched

2011-11-08 Thread Alexis
I've got a small "issue" with this release: the development server is writing many more entities to the local datastore (log entries?). As I have a hook on datastore write ops to log what is put and when, it's polluting my logs but that's not the point: My "issue" is that the local datastore file

[google-appengine] Re: delete entity using id

2011-11-08 Thread pdknsk
You have to use db.Key.from_path('Model',id) to construct the key. http://code.google.com/appengine/docs/python/datastore/keyclass.html#Key_from_path -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to goog

[google-appengine] Re: FilterOperator.IN

2011-11-08 Thread Cyrille Vincey
FilterOperator.EQUAL : => to use with single values arguments (like String, Integer, Long, ...) FilterOperator.IN : => to use with collections arguments (like Set, List, ...) => works like a "OR" clause over all the collection members in the SQL word. Hope this help. -- You received this messag

Re: [google-appengine] Re: How can I preserve appId when moving from MS to HR datastore

2011-11-08 Thread Ronoaldo José de Lana Pereira
Hi, I can't see that either... Even after I deploy a new alternate version of my app with the new SDK. Do I have to mark the new vesion as default? Att, -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web v

[google-appengine] Re: 1.6.0 is now launched

2011-11-08 Thread thstart
Just installed 1.6.0 SDK When running my app got the messages: WARNING 2011-11-08 09:33:04,487 rdbms_mysqldb.py:90] The rdbms API is not available because the MySQLdb library could not be loaded. Error: option --rdbms_sqlite_path not recognized What is wrong? -- You received this message b

Re: [google-appengine] Re: How can I preserve appId when moving from MS to HR datastore

2011-11-08 Thread Stacy Kerkela
Ronoaldo, You're right that hasn't been rolled out yet. Remain patient, and you'll see a message in the forums when it is available. Sorry for the misinformation. -- Stacy On Tue, Nov 8, 2011 at 9:22 AM, Ronoaldo José de Lana Pereira < rpere...@beneficiofacil.com.br> wrote: > Hi, > > I can't s

Re: [google-appengine] Re: How can I preserve appId when moving from MS to HR datastore

2011-11-08 Thread Ronoaldo José de Lana Pereira
Stacy, Thanks for the update. We can't wait to see this rolling out. Again, congrat's to the AppEngine Team for the big news leaving preview. -Ronoaldo -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web vi

[google-appengine] app.yaml skip_files blocks access to local resources

2011-11-08 Thread andreas schmid
hi, in my app i need local resources which i user only locally while developing and don't want to upload them on deploy. thats why i have this specific folder listed in skip_files. but since now (probably one of the latest SDK releases) this makes the SDK ignore those files, which is pretty unc

[google-appengine] Re: GAE 1.6 can not import module jinja2

2011-11-08 Thread NG
Same here -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/BDGGzz0ahFMJ. To post to this group, send email to google-appengine@googlegroups.com. To

[google-appengine] Flushing async requests on development server for unit testing

2011-11-08 Thread Lenny Rachitsky
I'm finding that unit testing async based requests is rather tricky, as the put() often doesn't finish by the time the unit test is run. Is there any way to do a system-wide flush of all async requests on the development server? The only other solution I have is to add if branch that waits for the

Re: [google-appengine] JDO equ. of python datastore operation 'Model.get_or_insert'

2011-11-08 Thread Amy Unruh
There's no direct equivalent. If you write a utility method you'll want to use a transaction-- that way you won't overwrite an existing entity if one with the given kind and key name already exists. -Amy On Tue, Nov 8, 2011 at 3:55 PM, _vjy wrote: > > What is JDO equ. of python datastore ope

Re: [google-appengine] GAE 1.6 can not import module jinja2

2011-11-08 Thread Matt Jibson
Have you installed jinja2 locally? Historically, the SDK has not included 3rd party libraries (PIL was the first example). They had to be installed on your own machine, and the SDK would be able to import them. On Tue, Nov 8, 2011 at 8:55 AM, Kai wrote: > I am trying my first python2.7 GAE apps.

Re: [google-appengine] Re: Datastore operations are seriously expensive

2011-11-08 Thread Rishi Arora
After managing my instances, I had a similar sticker shock with data store usage. However, the app stats utility, even though its really built around the old pricing model, was invaluable in telling me what my heavy hitters were in terms of data store ops. I implemented caching for my most import

Re: [google-appengine] nightmare: redirection from old MS app to new HR app

2011-11-08 Thread Amy Unruh
Alberto, It sounds like you are wanting to alias the app id, so that your URL can remain the same after the migration. What are your old (MS) and new app ids? On Mon, Nov 7, 2011 at 8:17 PM, Alberto Gualis wrote: > We are having a very serious issue in our company because we use > Google App E

Re: [google-appengine] Re: GAE 1.6 can not import module jinja2

2011-11-08 Thread Brian Quinlan
As Matt says, you need to install jinja2 on your local Python instance. This will be fixed in a future release. Cheers, Brian On Wed, Nov 9, 2011 at 7:45 AM, NG wrote: > Same here > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > T

Re: [google-appengine] GAE Python 2.7 - deferred failed in production but works in development

2011-11-08 Thread Brian Quinlan
Hi Samson, What do you have in the "handlers" section of your app.yaml? Cheers, Brian On Sat, Nov 5, 2011 at 4:52 AM, Samson wrote: > Hi, > > I am currently stuck with an issue that I can't fix.  I've just > upgraded my app to Python 2.7 using Django Nonrel.  I've tried posting > this question

[google-appengine] memcache quota limits

2011-11-08 Thread vlad
I would like to get a confirmation. It appears that under new billing memcache API limits are lifted for all apps. In effect memcache use is unlimited. Is that correct? -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussi

[google-appengine] Re: Datastore operations are seriously expensive

2011-11-08 Thread vlad
link does not work -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/JHLT-C_FgEwJ. To post to this group, send email to google-appengine@googlegroups

Re: [google-appengine] Re: Datastore operations are seriously expensive

2011-11-08 Thread Jeff Schnitzer
FWIW, your app would have been a problem under the old pricing model as well. The only difference WRT the datastore is that instead of being charged "datastore operations" you were charged a magic number of "api_cpu_ms" per operation. The pricing model is pretty much the same, it's just more expe

Re: [google-appengine] Re: Datastore operations are seriously expensive

2011-11-08 Thread Alfred Fuller
Here is an article that can help you reduce the # of composite indexes you use in some cases: http://code.google.com/appengine/articles/indexselection.html On Tue, Nov 8, 2011 at 4:16 PM, Jeff Schnitzer wrote: > FWIW, your app would have been a problem under the old pricing model > as well. The

[google-appengine] Re: GAE 1.6 can not import module jinja2

2011-11-08 Thread Kai
Thank you, Matt and Brian. Actually, I have not installed jinja2 in my system. I will try to fixed this minor issue and finish the tutorial guild. :) On Nov 9, 7:39 am, Brian Quinlan wrote: > As Matt says, you need to install jinja2 on your local Python instance. > > This will be fixed in a futur

[google-appengine] Re: What happened to the promised reliability improvement for email delivery?

2011-11-08 Thread Daniel
+1 On Nov 8, 11:37 am, pdknsk wrote: > Google announced this in May. > > "We have added a few restrictions to the Mail API to improve the > reliability and reputation of the service for all applications. First, > emails must be sent from email accounts managed by Google (either > Gmail, or a dom

[google-appengine] Re: GAE 1.6 can not find python2.7 in Mac OSX 10.7.2

2011-11-08 Thread Kai
Thank you for providing the information. I tried python 2.7.1 which is bundled with Lion. Although, this problem is not quite annoying because I can run dev_appserver.py command in terminal to avoid the warning message. On Nov 9, 12:18 am, Droid wrote: > I installed the python 2.7.2 dmg today 0n

Re: [google-appengine] Create a Facebook App on GAE in a minute, new release from CoderBuddy

2011-11-08 Thread Ikai Lan (Google)
Who pretty cool! Dude, on another note, what's up with the URL slug? "lose-your-facebook-app-virginity-create-one-i" Did you guys set a title and change it to something more safe-for-work? =) -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com | twitter.com/ikai On

Re: [google-appengine] Re: 1.6.0 is now launched

2011-11-08 Thread Amy Unruh
On Wed, Nov 9, 2011 at 4:40 AM, thstart wrote: > Just installed 1.6.0 SDK > > When running my app got the messages: > > WARNING 2011-11-08 09:33:04,487 rdbms_mysqldb.py:90] The rdbms API is not > available because the MySQLdb library could not be loaded. > > This is an ignorable warning-- it sh

[google-appengine] [Python-Concurrency] Memory issues

2011-11-08 Thread Kaan Soral
I started getting a lot of (, ResponseTooLargeError('The response from API call datastore_v3.RunQuery() was too large.',), ) errors from my crons These errors started after I switched to 2.7 and concurrency I am guessing now requests are not allowed a lot of memory, and these datastore calls are

[google-appengine] Removing Hourly Limits

2011-11-08 Thread Kaan Soral
I need to get rid of the hourly limits (datastore, urlfetch) for my app with appid: createnspread To get around them I slowed down my mapreduce but i came to a point that, even with scatters, some queues span 17000 depth, so i need the speed What should I do? My previous experience was to open

[google-appengine] Re: Removing Hourly Limits

2011-11-08 Thread Kaan Soral
hourly 2 million url fetch limit, what a ridiculous limit ... so 24*2 = 48 million, there is your scalability limit the only reason I use appengine is scalability and these hourly limits mess with my scalability On Nov 9, 3:31 am, Kaan Soral wrote: > I need to get rid of the hourly limits (dat

[google-appengine] Re: GAE 1.6 can not find python2.7 in Mac OSX 10.7.2

2011-11-08 Thread Kai
This issue has been opened here: http://code.google.com/p/google-appengine-mac-launcher/issues/detail?id=4 Hit the "Enter" key in the text field will solve this problem. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussi

Re: [google-appengine] [Python-Concurrency] Memory issues

2011-11-08 Thread Brian Quinlan
Hi Kaan, This is a bug in the Python 2.7 runtime that will be fixed with the 1.6.1 release. Cheers, Brian On Wed, Nov 9, 2011 at 12:19 PM, Kaan Soral wrote: > I started getting a lot of > ( 'google.appengine.runtime.apiproxy_errors.ResponseTooLargeError'>, > ResponseTooLargeError('The response

Re: [google-appengine] [Python-Concurrency] Memory issues

2011-11-08 Thread Brian Quinlan
Sorry, I forgot to add the obvious detail: This bug is triggered if the result of your datastore call is >1MB. Cheers, Brian On Wed, Nov 9, 2011 at 1:22 PM, Brian Quinlan wrote: > Hi Kaan, > > This is a bug in the Python 2.7 runtime that will be fixed with the > 1.6.1 release. > > Cheers, > Bri

[google-appengine] Order of index properties -- does it matter?

2011-11-08 Thread Lenny Rachitsky
Does the order of the index properties matter, when specifying them in query, and in the index definition file? -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsub

Re: [google-appengine] PHP Java Interoperability

2011-11-08 Thread Ikai Lan (Google)
Sean, You'd either use Python or Java to serve a URL, then use PHPCurl to retrieve the URL. Can you provide more details about the Java class? -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com | twitter.com/ikai On Thu, Nov 3, 2011 at 10:21 AM, Sean Dorman wrote: >

Re: [google-appengine] Re: How can I undelete (recover) deleted entities?

2011-11-08 Thread Ikai Lan (Google)
That's really an unfortunate situation. You always have to be careful with mass deletes. We won't be able to restore your application's data. 30gb is $7, which would have been a $3 increase (if I am remember the pricing correctly). It's worthwhile to use a slower, safer solution and not rush into t

Re: [google-appengine] memcache quota limits

2011-11-08 Thread Nick Johnson
Hi Vlad, Like all APIs, memcache has 'sanity limits', which can be lifted on an app-by-app basis if your app encounters them. Nothing has changed in this respect with the new billing. -Nick Johnson On Wed, Nov 9, 2011 at 11:07 AM, vlad wrote: > I would like to get a confirmation. It appears t

Re: [google-appengine] Flushing async requests on development server for unit testing

2011-11-08 Thread Nick Johnson
Hi Lenny, You should always wait for async requests to finish, including in production. If you don't explicitly wait yourself, the appserver will wait for them to complete before returning the response to the user anyway. -Nick Johnson On Wed, Nov 9, 2011 at 7:49 AM, Lenny Rachitsky wrote: > I

Re: [google-appengine] app.yaml skip_files blocks access to local resources

2011-11-08 Thread Nick Johnson
Hi Andreas, The appserver deliberately does its best to emulate the production environment; this includes prohibiting access to files your app will not have in production. If you want to access files that won't be available in production, you should probably write a separate script and run it out

[google-appengine] copying data from appengine datastore admin to my dev server. failed with status 401

2011-11-08 Thread Mariano Benitez
Hello, I am trying to copy data from my appengine to my dev server, instead of doing the normal bulk download/upload, I tried the datastore admin copy function. I've setup the dev server public ip so it can be seen from outside. When I try to run it from appengine, it fails with status 401, no

Re: [google-appengine] copying data from appengine datastore admin to my dev server. failed with status 401

2011-11-08 Thread Nick Johnson
This is unlikely to work, and you should never ever expose your dev_appserver publicly. Consider making a small reusable test dataset you can easily load, rather than relying on a complete dump of production data, which won't scale. -Nick On Wed, Nov 9, 2011 at 4:31 PM, Mariano Benitez wrote: >

Re: [google-appengine] Memcaching BlobProperty

2011-11-08 Thread Nick Johnson
Hi Melissa, It's likely your data is simply being evicted as not worth the memory it takes up - you can fit a lot of smaller memcache values in the space a blob takes up. Consider just setting the correct caching headers in your response, instead. This will result in frontends, proxies and browse

Re: [google-appengine] app.yaml skip_files blocks access to local resources

2011-11-08 Thread Ugorji
Run dev_appserver.py with parameter: --allow_skipped_files I think that should work. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/8tlRK_o7vJM

[google-appengine] new billing policy and fan-out

2011-11-08 Thread Herbert
I'm building a system with news feed style broadcasting. there won't be millions of users, probably just 100k and interesting feed would go to inbox of ~10k users. everyone's recommend the method to solve fan-out proposed by Brett, and i really like it, works something like this: class Feed(db.Mo

[google-appengine] Google Apps Stop Redirecting To WWW Custom Domains

2011-11-08 Thread James Gilliam
Why does this keep happening. For no apparent reason Google Apps stop redirecting the www subdomain to the custom domain. This is usually late and night and clears up. This is more than annoying. Why is this so hard for them? -- You received this message because you are subscribed to the Goo

[google-appengine] memcache statistics

2011-11-08 Thread James Gilliam
i have been watching memcache statistics and can't figure out when they reset. I have noticed they will sometimes go for days without resetting and then are reset. Any insights on this? Thanks -- You received this message because you are subscribed to the Google Groups "Google App Engine" gro