[google-appengine] Re: Calculating percentile
Hi, For percentile, you can calculate rank of an item using http://googleappengine.blogspot.com/2009/01/google-code-jams-ranking-library.html and use the total no. of items ranked to calculate percentile. Regards, Indraneel www.wikiaata.com On May 26, 4:04 am, Oliver Zheng goo...@oliverzheng.com wrote: Also, how would the calculation of frequency distribution be amortized as new values come in? On May 25, 3:25 pm, Oliver Zheng goo...@oliverzheng.com wrote: For aggregate functions like sum or average, it has been recommended that they be calculated at the time of saving each new or old entry. But how would one go about calculating percentile? Is it mathematically possible to spread out the calculation of percentiles over new entries as they come in? If not, I can think of only one other way, that is to enumerate through all entries in sorted order, 1000 by 1000 (since that's the limit), and grab the entries at the percentile I want. Of course, I'd still have to aggregate the count for each write as they come in. But this is probably impractical given a large dataset of 1M. Is calculating percentiles inherently infeasible on GAE? Thanks, Oliver --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Warning Your application is exceeding a quota.
My application is dmapp001, ucfdev, ucfdev2, ucfdev3 and ucfdev5. Please clear the warning Your application is exceeding a quota: Datastore Indices . --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Bulkloader and Unicode
Hi,
I am trying to write a bulkuploader for my model, but it is failing
due to one of the string having a unicode character
I created a uni function and used it as a converter, but still
failing.
What do I need to do to upload unicode characters in Bulkloader?
[ERROR ] [Thread-1] BulkLoaderThread: caught exception (type
'exceptions.Unic
odeDecodeError', UnicodeDecodeError('ascii', 'The Collection by Jean
Schnaak\xc2\xae', 43, 44, 'ordinal not in range(128)'),
traceback object at0x05A62C88)
def uni(s)
return unicode(s)
class Product(search.SearchableModel):
title = db.StringProperty(required=True)
desc = db.StringProperty(required=True)
class ProductLoader(bulkloader.Loader):
def __init__(self):
bulkloader.Loader.__init__(self, 'Product',
[('title', str),
('desc', uni)
])
Thanks in advance
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---
[google-appengine] Re: Warning Your application is exceeding a quota.
Me too. My app id are blitzg2100, cccwikig2100, djangog2100, g2100. Regards Tom Wu 2009/5/26 condor takayuki.a...@gmail.com My application is dmapp001, ucfdev, ucfdev2, ucfdev3 and ucfdev5. Please clear the warning Your application is exceeding a quota: Datastore Indices . --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Which database is required for small applications to store user names and passwords
Hi All, can any one suggest me which database I can use for my small application(to store user names ,passwords, very few other data.. ) I am using Python, Google Apps and guide me how to connect to database, I am very new to these technologies Please help me Thanks in advance --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Bulkloader and Unicode
Full Stacktrace
[ERROR ] [Thread-1] BulkLoaderThread: caught exception (type
'exceptions.Unic
odeDecodeError', UnicodeDecodeError('ascii', 'The ollection by Jean
Schnaak\xc2\xae', 43, 44, 'ordinal not in range(128)'),
traceback object at0x0486CC38)
Traceback (most recent call last):
File C:\Projects\pegasus\vendor\python
\google_appengine_v1.2.1\google\appengi
ne\tools\bulkloader.py, line 2137, in PerformWork
response = self.TransferItem(item)
File C:\Projects\pegasus\vendor\python
\google_appengine_v1.2.1\google\appengi
ne\tools\bulkloader.py, line 2249, in TransferItem
return self.request_manager.PostEntities(item)
File C:\Projects\pegasus\vendor\python
\google_appengine_v1.2.1\google\appengi
ne\tools\bulkloader.py, line 1547, in PostEntities
db.put(entities)
File C:\Projects\pegasus\vendor\python
\google_appengine_v1.2.1\google\appengi
ne\ext\db\__init__.py, line 1076, in put
keys = datastore.Put(entities)
File C:\Projects\pegasus\vendor\python
\google_appengine_v1.2.1\google\appengi
ne\api\datastore.py, line 155, in Put
req.entity_list().extend([e._ToPb() for e in entities])
File C:\Projects\pegasus\vendor\python
\google_appengine_v1.2.1\google\appengi
ne\api\datastore.py, line 487, in _ToPb
properties = datastore_types.ToPropertyPb(name, values)
File C:\Projects\pegasus\vendor\python
\google_appengine_v1.2.1\google\appengi
ne\api\datastore_types.py, line 1289, in ToPropertyPb
pbvalue = pack_prop(name, v, pb.mutable_value())
File C:\Projects\pegasus\vendor\python
\google_appengine_v1.2.1\google\appengi
ne\api\datastore_types.py, line 1123, in PackString
pbvalue.set_stringvalue(unicode(value).encode('utf-8'))
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc2 in position
43: ordinal
not in range(128)
[INFO] [1-1000] Error while sending batch.
[ERROR ] [Thread-1] BulkLoaderThread:
Traceback (most recent call last):
File C:\Projects\pegasus\vendor\python
\google_appengine_v1.2.1\google\appengi
ne\tools\bulkloader.py, line 1995, in run
self.PerformWork()
File C:\Projects\pegasus\vendor\python
\google_appengine_v1.2.1\google\appengi
ne\tools\bulkloader.py, line 2137, in PerformWork
response = self.TransferItem(item)
File C:\Projects\pegasus\vendor\python
\google_appengine_v1.2.1\google\appengi
ne\tools\bulkloader.py, line 2249, in TransferItem
return self.request_manager.PostEntities(item)
File C:\Projects\pegasus\vendor\python
\google_appengine_v1.2.1\google\appengi
ne\tools\bulkloader.py, line 1547, in PostEntities
db.put(entities)
File C:\Projects\pegasus\vendor\python
\google_appengine_v1.2.1\google\appengi
ne\ext\db\__init__.py, line 1076, in put
keys = datastore.Put(entities)
File C:\Projects\pegasus\vendor\python
\google_appengine_v1.2.1\google\appengi
ne\api\datastore.py, line 155, in Put
req.entity_list().extend([e._ToPb() for e in entities])
File C:\Projects\pegasus\vendor\python
\google_appengine_v1.2.1\google\appengi
ne\api\datastore.py, line 487, in _ToPb
properties = datastore_types.ToPropertyPb(name, values)
File C:\Projects\pegasus\vendor\python
\google_appengine_v1.2.1\google\appengi
ne\api\datastore_types.py, line 1289, in ToPropertyPb
pbvalue = pack_prop(name, v, pb.mutable_value())
File C:\Projects\pegasus\vendor\python
\google_appengine_v1.2.1\google\appengi
ne\api\datastore_types.py, line 1123, in PackString
pbvalue.set_stringvalue(unicode(value).encode('utf-8'))
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc2 in position
43: ordinal
not in range(128)
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---
[google-appengine] Re: Is there a max number of project files?
I think it's 1000 but you can use zipserve http://googleappengine.blogspot.com/2008/09/sdk-113-now-available-for-download.html Or store them in the DB On 26 mai, 01:40, ogterran jonathanh...@gmail.com wrote: Hi, Is there a max number of project files you can upload in Google App Engine? I have a lot of images for my site and I want to know if I can host all of them on GAE. I have more than 30k images. Thanks in advance Jon --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] createLoginUrl raises NotAllowed Error
I am new to Google App Engine. I was trying out some sample codes. I was using the code given in http://code.google.com/apis/gdata/articles/youtube_api_appengine.html#python-client-library-and-app-engine-authsub It works fine with GoogleAppEngineLauncher but when i used it through appspot, createLoginUrl(self.request.uri) raises NotAllowed Error. Then i tried changing app.yaml to look like this handlers: - url: /.* script: main.py login: admin It gives the following error: Error: Server Error The server encountered an error and could not complete your request. If the problem persists, please report your problem and mention this error message and query that caused it... Can someone help me please... thanks --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Java runtime confirmation email
I have the same problem. Eagerly waiting to test my application in the production environment. On May 22, 11:21 pm, boness ubon...@gmail.com wrote: Hi, I registered several times for appengine java runtime, but I still didn't receive any confirmation email. When should I expect to get it? cheers, Uri --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Problems with the logging system?
I just set up my app deployment today so I am not experienced with the Java app engine, but I also cannot see any logger.info() messages either. If you get it working, I'd like to know how you did it. On May 25, 5:31 am, Marcelo Alcantara mar...@gmail.com wrote: Do you mean in the class? I got a logger with the full class name and used logger.info(). Used it from the java.util.logging. The logging console is working fine for you? On Mon, May 25, 2009 at 4:50 AM, 风笑雪 kea...@gmail.com wrote: Have you set logging level? 2009/5/25 Marcelo Alcantara mar...@gmail.com Somebody knows if there is a problem with the logging system? I am trying to log but my messages never appear there. The requests just appear when I selected show requests only on the combo. If I mark the checkbox to show requests nothing appears. Very strange behaviour. Thanks. Marcelo -- Marcelo Alcantara Senior Developer/Architect mar...@gmail.com +55 11 81968823 --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Google App Engine platform leadership
Dear All, I’m a student at the University of Cambridge (UK) and I’m writing my dissertation on cloud computing platforms and how they facilitate innovation. One of my case studies is Google App Engine. Can anyone (preferably from Google) shortly answer a few questions for my research pls: 1. Is Google aiming at extending and customising Google Apps with Google App Engine, or is it more targeting at development and hosting of independent web applications? 2. Do you think Google App Engine can experience network effects (positive feedback) between users and applications, i.e. more users attract more application and vice versa? Perhaps the network effect can be exploit between Google Apps users and App Engine applications? 3. What are the benefits of App Engine to the Google’s core businesses? 4. What would you say to address developers’ fears about platform lock- in related to the BigTable database and Google specific APIs? 5. What was the reason to make Google App Engine open source? 6. Google is working on multi-tenancy for App Engine, will it be available in the Python or Java environments? 7. How important is App Engine in the internal development of Google applications (e.g. in Google Labs)? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] java.io.IOException while deploying application from eclipse
Hi , I'm trying to deploy an application through eclipse. I have used my gmail id only . It gives me the following error. java.io.IOException: Error posting to URL: http://appengine.google.com/api/appversion/create?app_id=roshni-basuversion=1; 400 Bad Request Invalid runtime or the current user is not authorized to use it. I did not get any mail saying i have been registered also. How do I solve this issue?? Regards Roshni --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Calculating percentile
Perfect. Thanks. I realized that for my needs, logarithmic scaling might suit better. In that case, to calculate frequency distribution, I can pretty much use a fixed number of buckets, since the maximum number is probably only 20 magnitudes larger than the smallest. Cheers, Oliver --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Problems with the logging system?
Have you done the doc said? http://code.google.com/intl/en/appengine/docs/java/runtime.html#Logging 2009/5/26 Rmac rony...@gmail.com I just set up my app deployment today so I am not experienced with the Java app engine, but I also cannot see any logger.info() messages either. If you get it working, I'd like to know how you did it. On May 25, 5:31 am, Marcelo Alcantara mar...@gmail.com wrote: Do you mean in the class? I got a logger with the full class name and used logger.info(). Used it from the java.util.logging. The logging console is working fine for you? On Mon, May 25, 2009 at 4:50 AM, 风笑雪 kea...@gmail.com wrote: Have you set logging level? 2009/5/25 Marcelo Alcantara mar...@gmail.com Somebody knows if there is a problem with the logging system? I am trying to log but my messages never appear there. The requests just appear when I selected show requests only on the combo. If I mark the checkbox to show requests nothing appears. Very strange behaviour. Thanks. Marcelo -- Marcelo Alcantara Senior Developer/Architect mar...@gmail.com +55 11 81968823 --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] App Engine is very slow for i-swim
Hi,
The Google App Engine is very slow from Norway at 17.00-20.00 (GMT+2).
Loading a page takes 13 seconds or so. In the morning 08-12 (GMT+2)
the App Engine is lightning fast. I can see that when the App Engine
is slow then it's not caching any imports anymore and my application
is reloaded for every request even if the requests are being done
right after another:
05-26 10:18AM 12.063 zipimporter('lib/cherrypy.zip', '')
05-26 10:18AM 12.090 zipimporter('lib/formencode.zip', '')
05-26 10:18AM 12.105 zipimporter('lib/genshi.zip', '')
05-26 10:18AM 23.106 62.16.134.161 - dbrattli [26/May/2009:17:18:23]
GET /exercises/calendar/ HTTP/1.1 200 42272 http://i-
swim.appspot.com/info/release_notes/ Mozilla
05-26 10:13AM 41.878 zipimporter('lib/cherrypy.zip', '')
05-26 10:13AM 41.904 zipimporter('lib/formencode.zip', '')
05-26 10:13AM 41.916 zipimporter('lib/genshi.zip', '')
05-26 10:13AM 52.120 62.16.134.161 - dbrattli [26/May/2009:17:13:52]
GET /info/release_notes/ HTTP/1.1 200 21137 http://i-
swim.appspot.com/info/release_notes/ Mozilla
My application (i-swim) is unusable for many (3-4) hours each day
because of this, and my users are compaining. Is there any way to fix
this?
-- Dag
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---
[google-appengine] Chat Time transcript: May 20th, 2009
Last Wednesday, the App Engine team held its latest Chat Time IRC office hour session. The next session will take place next Wednesday, June 3rd from 7:00-8:00 p.m. PDT in the #appengine channel on irc.freenode.net. A transcript of last week's session and a summary of the topics covered is provided below. -- - There are plans to add Java support for increasing the time limit for URLFetch requests before timeout to mirror the Python SDK [9:08] - Does it make sense to add a 95% metered billing option so applications aren't shut down if they hit a peak? Our current billing setup allows developers to easily increase their daily budgets when they expect higher traffic and then re-adjust, but there is no metered option. (File an issue if this is important to you.) [9:10-9:16] - XMPP API progress going good [9:11] - Local data viewer for Java coming with next SDK release [9:17] - Discussion on issue 1378, request for ability to specify content- encoding header [9:20, 9:25, 9:27] - There are no current plans to introduce a UUIDProperty, but developers can roll their own if it's important to them [9:29] - There's no way to delete applications currently, but if you need more applications, just post your request in the discussion group [9:32] - There is no way to retrieve more than 1,000 results with a single query but if you're trying to export your data from the datastore, you can use the built-in support (http://code.google.com/appengine/docs/ python/tools/uploadingdata.html#Downloading_Data_from_App_Engine) or build your own solution using remote_api [9:33, 9:37] - Q: Is having a single app that is used by 3-4 other services allowed by the TOS? A: It depends on the implementation. Building a service (e.g. stats) on App Engine that is then used by various other applications is fine, but using multiple application IDs to implement the functionality of a single application will violate TOS section 4.4. [9:36, 9:38] - Entities are memcached but queries are not, so it's best to optimize your application where possible to fetch entities directly by key [9:41, 9:44] - HTTPS is not supported for non-appspot.com domains because of a lack of support for SNI. With TLS 3.1, which is already available in the newest versions of Safari, Firefox, Internet Explorer, and Opera, widespread support for SNI is an eventuality, but until then it's unlikely to get HTTPS support for non-appspot.com domains. [9:48-9:49] -- [09:02am] scudder_google: Hi all, I'd like to start another installment of App Engine chat time, where Google engineers are on hand to answer your questions and listen to concerns [09:03am] nickjohnson: *tumbleweed* [09:03am] knoonan: Hi guys, for Ruby on App Engine, I think it would be very useful to have a page with a whitelist of gems (and plugins for Rails) which have been found to work on GAE/J. [09:05am] maxr_google: That sounds useful. I think I see ribrdb logged in here. [09:05am] scudder_google: knoonan: interesting idea, the best way to start might be to create your own list somewhere and allow others to collaborate with you on it [09:05am] maxr_google: He's done a lot of the GAE Ruby work. [09:05am] nickjohnson: knoonan: That seems like a good idea, but probably best on the appengine-jruby wiki? [09:05am] Wooble: Is there any truth to the rumor that henceforth people spamming the main GAE google group with requests to activate their Java accounts will be redirected to the Java group and moved to the back of the queue to be activated? [09:06am] bmckinlay: I have an issue with URLFetch on Java. My application contacts a web service that sometimes needs more time to respond to my queries than the ~4.5 seconds that app engine allows. In the Python SDK, there is an option to increase this limit. Any possibility of a similar option being added in Java? [09:06am] nickjohnson: Wooble: If there is, nobody's told me. ;) [09:06am] knoonan: Thanks guys, the App Engine JRuby wiki sounds like the place. [09:06am] schwardo_google: bmckinlay: it's definitely something that we plan to support. do you know if it's been filed in the issue tracker yet? [09:07am] ribrdb: only a couple of people can edit the wiki right now though. [09:07am] bmckinlay: schwardo_google: yes... http://code.google.com/p/googleappengine/issues/detail?id=1559 [09:07am] ribrdb: knoonan: do you know of a list of gems anywhere that do or do not work? [09:08am] knoonan: @ribrdb No, I don't know of an existing list. That's why I think it's time to start one...! [09:08am] schwardo_google: bmckinlay: ok great, i'll accept it to indicate that it's something we plan to support, and we'll rely on the # of stars to help prioritize it [09:09am] knoonan: ((I did a lightning talk at the Euruko conference in Barcelona, Spain, on May 10th, about App Engine. I hope I got some
[google-appengine] problem deleting/resetting indexes
hi there, i deployed my app yesterday. The python SDK did create indexes which were kind of redundant. One index got an error and didn't recover in the last 24 hours. tried: appcfg vacuum_indexes with an empty index.yaml no luck there - error message i got: 2009-05-26 12:26:54,562 WARNING appcfg.py:670 4 indexes were not deleted. Most likely this is because they no longer exist. no way to deploy a working version atm. can somebody from google please delete all indexes from that app? i even dont care about the data in the datastore. app id: purple-imageapp i am listed as an admin there. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Mixing Django Apps in a GAE Project
Hi, does anybody know if it's possible to pick any Django App in, for example, Google Code, and mix it with my GAE Django-based application (my projejct is currently using the django patch so it's Django 1.0 compatible). My main concerns are those Django Apps that have build scripts that try to install something on my python path (which of course has not the same content as GAE's Python runtime) and those that require non standard modules that are not included in GAE's Python runtime. If it's possible, what things should I change? (I'm assuming I'll at least have to change db models). Thanks in advance! --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Getting 404 when there are spaces in the URL
Hi Mick, For this app.yaml, it looks like requests under /static/images/... will be handled by main.py since it catches all requests that fall through to that -url pattern. I'm wondering if the /images url should be /static/images instead. Happy coding, Jeff On May 23, 7:43 pm, Mick mickler...@gmail.com wrote: Yep here it is... application: blah blah version: 4 runtime: python api_version: 1 handlers: - url: /portfolio static_dir: portfolio - url: /css static_dir: css - url: /scripts static_dir: scripts - url: /images static_dir: images - url: /images-global static_dir: images - url: .* script: main.py - url: /index\.html script: home.py On May 18, 4:51 pm, Jeff S (Google) j...@google.com wrote: Hi Mick, Could I see your app.yaml file? The regular expressions for the handler URLs would also need to specify that spaces are allowed so it could be an issue with the mapping in app.yaml. Thank you, Jeff On Thu, May 14, 2009 at 9:51 AM, Mick mickler...@gmail.com wrote: Hi, I have a static directory that contains folders with spaces in their names. Then I try to get to a resource in one of those folders, GAE gives me a 404. Is there anything I can do in app.yaml or the code to make this work? I would really love to keep spaces in folder names. Example Folder: /static/images/My Folder/image-001.jpg When I go tohttp://localhost:8080/static/images/My%20Folder/image-001.jpg , the image doesn't show up. INFO 2009-05-14 16:07:14,108 dev_appserver.py:2935] GET /static/ images/My%20Folder/image-001.jpg HTTP/1.1 404 Thanks in advance. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] appcfg.py unable to authenticate me!
Hello, I am trying to update my application code but every time appcfg.py aborts the updates because it is unable to authenticate me! I don't know whether this is related to IE-7.0 which is also unable to sign me in. But firfox is okay with that and that is how I was able to post this message. Any idea what is going wrong or how can I ask appcfg.py to authenticate me through firefox or I don't know. Please, help as I am unable to update the applications and this is very sad:( Thank you very much in advance. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Warning Your application is exceeding a quota.
Hi condor and Tom, I've reset the incorrect index count quota for these apps (none actually had over 100 indicies). A few of these also had indicies which were stuck in the building state so I've moved them to error. Apologies for the inconvenience. Thank you, Jeff On May 26, 2:10 am, Tom Wu service.g2...@gmail.com wrote: Me too. My app id are blitzg2100, cccwikig2100, djangog2100, g2100. Regards Tom Wu 2009/5/26 condor takayuki.a...@gmail.com My application is dmapp001, ucfdev, ucfdev2, ucfdev3 and ucfdev5. Please clear the warning Your application is exceeding a quota: Datastore Indices . --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Looking for input: would companies trust/choose a solution built running on appengine?
Dear appengine team community. We're considering to spend time and resources developing solutions/ software using appengine. One of the reasons we still have our doubts about investing into this way of working is that it could be difficult to convince companies to choose for solutions where an important part of their data is hosted at a third-party provider (google). Of course there are important advantages (less infrastructure cost, a small chance that they do a better job than google on the level of scalability, failover, ...) but currently it seems very hard for us to convince management of potential clients to trust a solution built upon and running in a typical appengine environment. Maybe, future developments might make it possible to install run components developed on appengine on a local system (e.g. bdbdatastore,... ) but if we would do this, it's probably better (read - easier to sell) to choose a traditional (software) stack... Do you have any material, papers, information, ideas,... which could help us finding out if it would be wise to invest in the approach where we would choose appengine as a platform to develop solutions. Our main question is would thirdparty companies trust/choose a solution built running on appengine [at google]). Thanks a lot for your input ideas. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Python: db.ReferenceProperty collection_name callable?
Hi Oliver, Great suggestion and I want to make sure I understand the proposal. It sounds like you would like the House model to have a parents back reference and also a children back reference? How would the children collection be given a collection name? Here's some sample code to make this easier to follow: from google.appengine.ext import db from google.appengine.ext.db import polymodel class House(db.Model): address = db.IntegerProperty() class Parent(polymodel.PolyModel): house = db.ReferenceProperty(House, collection_name='parents') class Child(Parent): pass h1 = House(address=5).put() Parent(house=h1).put() Child(house=h1).put() Parent(house=h1).put() h1 = db.get(h1) h1.parents.fetch(5) With the above code, the h1 House instance has 3 entities in its parents back reference, 2 Parent instances and 1 Child instance. Instead you would like only the 2 Parent classes to appear in h1.parents? If that's the case, then you can do something like this instead: class Parent(polymodel.PolyModel): house = db.ReferenceProperty(House, collection_name='parents') class Child(Parent): home = db.ReferenceProperty(House, collection_name='children') h1 = House(address=5).put() Parent(house=h1).put() Child(home=h1).put() Parent(house=h1).put() h1 = db.get(h1) h1.parents.fetch(5) h1.children.fetch(5) I'm guessing the above would be OK if it is acceptable that the Child's reference to House is called 'home' instead of the parent classes 'house'. Thank you, Jeff On May 22, 11:19 am, Oliver Zheng goo...@oliverzheng.com wrote: I'm trying to create a hierchy of kinds, the obvious reason of which is that kinds can share model fields. However, for ReferenceProperties, collection_name is fixed to when the model field is declared in the model class. If this is declared in the parent class, then all the children will have this collection name, which is likely inaccurate: class Parent(PolyModel): house = db.ReferenceProperty(House, collection_name='parents') class Child(Parent): pass House won't have a back reference to children in particular. And since for PolyModels, fields cannot be overriden by children classes, Child can't have its own house field. This problem could be solved if collection_name was callable, so that the children class could return its own collection name. Is there plans for this? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Tracking CPU, Bandwidth, and Storage use for a SaaS app.
Hi Brian, Agree this seems like a more general question. I'm not sure what you meant by member (track x for each member of a SaaS app). Are you looking for usage on all quotas for a single request? If I understand correctly I think this sounds like a great idea :-) Cheers, Jeff On May 24, 11:55 am, BrianJinwright br...@ifeets.com wrote: I posted this question in the python group but then realized I would probably get an answer quicker in the general group. Is there a way to track CPU, Bandwidth, and Storage for each member of a SaaS app built on Google App Engine? I've seen the quota.get_request_cpu_usage() function for CPU but I've also read that it doesn't track the GAE api calls. Thanks in advance. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: memcache in remote api
Hi Ben, Out of curiosity, what's your use case for accessing Memcache over remote_api? The main reason we didn't support it automatically is because there didn't seem to be any obvious reason why you'd want to use Memcache remotely. Also, note that a dedicated user can actually add support for extra services to remote_api relatively easily. :) -Nick Johnson On Mon, May 25, 2009 at 10:17 PM, Ben Nevile ben.nev...@gmail.com wrote: Just wanted to mention that I created a new issue requesting support for memcache in the remote api console. I searched but didn't find any existing similar requests. http://code.google.com/p/googleappengine/issues/detail?id=1596 Would be a big help. If this is of interest to you, please give 'er a star. Ben --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Cannot figure out remote_api
Hi John, The issue here is that the console example in the remote_api Article assumes you won't be attempting to import webob, django, etc, so doesn't set the paths for them. You can fix them by changing these two lines: --- sys.path.append(~/google_appengine) sys.path.append(~/google_appengine/lib/yaml/lib) --- to something like this: --- base_path = ~/google_appengine sys.path.append(base_path) sys.path.append(base_path + /lib/yaml/lib) sys.path.append(base_path + /lib/webob) sys.path.append(base_path + /lib/django) --- -Nick Johnson On Mon, May 25, 2009 at 2:03 PM, johntray john.tur...@gmail.com wrote: I have updated my app for remote_api, copied the appengine_console.py file from the documentation, updated the sys.path lines, and put that in my app's root directory. When I run appengine_console.py with my app id, I get the python prompt OK. BUT... When I try to import my main.py file, I get a python error, I get an error for the line where it imports webapp. from google.appengine.ext import webapp File C:\Program Files\Google\google_appengine\google\appengine\ext \webapp\__init__.py, line 68, in module import webob ImportError: No module named webob The app runs on the development server, of course, so I know that this missing webob module *does* exist. Can anyone help me figure out what I am doing wrong here? john --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: which approach to lists of references?
Hi Matt, I would not expect a ListProperty of ints to give you substantial extra capacity, unless your keys are exceptionally long. At 4000 items, you're running into the limit of the permitted number of index rows per entity anyway, rather than any size-based limit. -Nick Johnson On Mon, May 25, 2009 at 2:36 AM, Matt mmm...@gmail.com wrote: Hello. I'm writing an app in which I'm storing a list of keys in one of the models. I'm trying to figure out the best approach. The other approach I thought of was to store a list of integer values (storing the ID property). But since I am passing a custom key name (to allow a nice use of get_or_insert elsewhere in the app) I am not getting ID values. The reason I ask is b/c I tested on the development version and I was able to store 4,000 keys in a ListProperty(db.Key) item_list = ListProperty(db.Key). Can anyone shed some light on which would be faster and/or more space efficient for querying? k1 = Key(foo) MyModel.gql(WHERE item_list = :1, k1) vs using ListProperty(int) I like being able to use custom key names, but I'd much rather trade better peformance or storage efficiency for it. Thoughts would be much appreciated... --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Path from Key
Hey Colin, I've been using this: def key_to_path(model): key = model.key() output = [] while key: name = key.name() if name is None: output.append(key.id()) else: output.append(name) output.append(key.kind()) key = key.parent() output.reverse() return output 2009/5/26 Nick Johnson (Google) nick.john...@google.com: Hi Colin, You're correct - there's currently no built-in method to do this, and recursively (or iteratively, with a stack) calling key.parent() is your best option. -Nick Johnson On Mon, May 25, 2009 at 3:17 AM, hawkett hawk...@gmail.com wrote: Hi, There is a method Key.from_path() - which lets you supply the path to construct the key. Is there a way to retrieve the path from a key object? i.e. Key.path()? If not, is there a way to determine the path from the key? Is recursively calling Key.parent() until you get 'None' the only way to do this? It would be nice to make a single call to get a list of the keys to the parent. Thanks, Colin -- It is better to be wrong than to be vague. — Freeman Dyson --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Watermarking with Image Composite
Hi Mick,
Have you tried this on appspot? There's a known bug in the
dev_appserver whereby it ignores transparency for image.composite, but
it should work fine in production.
-Nick Johnson
On Sat, May 23, 2009 at 7:41 PM, Mick mickler...@gmail.com wrote:
Hello,
I'm trying to create a watermark on an image by using the app engine
images composite function. However the function doesn't seem to
respect the transparency in my overlay image, which is just a
copyright symbol. It fills the transparent area with white so the
final output looks like this http://bayimg.com/image/eaaagaacb.jpg. I
have tried all sorts of combinations for opacity and image types but
nothing seems to work right. Please advise.
[code]
def post(self):
im = avatar = self.request.get(image)
image = images.Image(im)
result = urlfetch.Fetch('http://upload.wikimedia.org/wikipedia/
commons/5/58/Red_copyright.png')
copyright = result.content
new_image = images.composite([
(im, 0 ,0, 1.0, images.TOP_LEFT),
(copyright, 0 ,0, 0.5, images.CENTER_CENTER)],
image.width,
image.height,
0,
images.PNG)
self.response.headers['Content-Type'] = image/png
self.response.out.write(new_image)
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---
[google-appengine] Re: alternative to multiple updates in single transaction
Hi hawkett, Currently, you only have a couple of options: You can set the reference to None instead of to the object itself, and then code your app to recognise the two situations as identical, or you can use two transactions: The first to create the entity, and the second to set the key. -Nick Johnson On Sat, May 23, 2009 at 11:48 AM, hawkett hawk...@gmail.com wrote: Hi, I have a situation where I need an entity to store a reference to itself, in much the same way as the value of the 'parent' field for the root of an entity group stores it's own key. As with entity groups, its not all records that point to themselves, but some do, and in my use case it means much the same thing - the root of the tree. The problem is that I also need to create such a record inside a transaction, and transactions have the constraint that you can't update the same record twice. I need to update the record twice - the first time to get the key value generated, and the second time to set that key as the value of the self reference. The most obvious solution is to use a key_name to generate a key without writing to the database, however I will be writing many thousands of these entities, and coming up with my own unique naming process when GAE already has one doesn't seem right. So I guess the first question is whether there is an approach I am missing here. The second would be to find out whether any of the following are likely to make it into GAE anytime soon - 1. Default to self for SelfReference - i.e. pretty much what happens with the 'parent' attribute class Story(db.Model): title = db.StringProperty() selfRef = db.SelfReferenceProperty(default=__self__) 2. A 'self' value when creating a Model instance class Story(db.Model): title = db.StringProperty() selfRef = db.SelfReferenceProperty() s=Story(title=Some title, selfRef=__self__) s.put() 3. Access to the keyFactory key = db.generateKey() s=Story(key_name=key, title=Some title, author=some author) s.selfRef = s.key() s.put() 4. The ability to update the same entity multiple times in the same transaction Thanks, Colin --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: What's the difference among key, id, and key name?
Hi Oliver, Doing a get() for a specific key is definitely much faster than doing a query, even if that query only returns one entity. As an example, take a look at the System Status page for gets: http://code.google.com/status/appengine/detail/datastore/2009/05/26#ae-trust-detail-datastore-get-latency and the one for queries: http://code.google.com/status/appengine/detail/datastore/2009/05/26#ae-trust-detail-datastore-query-latency . Gets average 20-40ms, while queries average 150-200ms. -Nick Johnson On Fri, May 22, 2009 at 10:51 AM, Oliver Zheng goo...@oliverzheng.com wrote: Hi Jason, On May 12, 5:12 pm, Jason (Google) apija...@google.com wrote: [...] thereby improving the performance of your application [...] What is the extent of this? I suppose you mean that if you know the key, you can construct an object and save it to datastore by overwriting it, without first querying for that object. But beyond that, is there performance improvement to querying with a key instead of another field that is also indexed? Thanks, Oliver --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Problems with the logging system?
As I said, I only focus on Python, maybe you need ask to this group: http://groups.google.com/group/google-appengine-java 2009/5/27 Rmac rony...@gmail.com Yes, I have done all that was indicated in the documentation. Are you saying you have successfully used Java logging and seen output on GAE's console? On May 26, 12:27 pm, 风笑雪 kea...@gmail.com wrote: Have you done the doc said? http://code.google.com/intl/en/appengine/docs/java/runtime.html#Logging 2009/5/26 Rmac rony...@gmail.com I just set up my app deployment today so I am not experienced with the Java app engine, but I also cannot see any logger.info() messages either. If you get it working, I'd like to know how you did it. On May 25, 5:31 am, Marcelo Alcantara mar...@gmail.com wrote: Do you mean in the class? I got a logger with the full class name and used logger.info(). Used it from the java.util.logging. The logging console is working fine for you? On Mon, May 25, 2009 at 4:50 AM, 风笑雪 kea...@gmail.com wrote: Have you set logging level? 2009/5/25 Marcelo Alcantara mar...@gmail.com Somebody knows if there is a problem with the logging system? I am trying to log but my messages never appear there. The requests just appear when I selected show requests only on the combo. If I mark the checkbox to show requests nothing appears. Very strange behaviour. Thanks. Marcelo -- Marcelo Alcantara Senior Developer/Architect mar...@gmail.com +55 11 81968823 --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Mixing Django Apps in a GAE Project
In general, no read up in the Google group for App-Engine-Patch to get a feel for where it's at! On May 26, 12:50 pm, david da...@altasoftware.com wrote: Hi, does anybody know if it's possible to pick any Django App in, for example, Google Code, and mix it with my GAE Django-based application (my projejct is currently using the django patch so it's Django 1.0 compatible). My main concerns are those Django Apps that have build scripts that try to install something on my python path (which of course has not the same content as GAE's Python runtime) and those that require non standard modules that are not included in GAE's Python runtime. If it's possible, what things should I change? (I'm assuming I'll at least have to change db models). Thanks in advance! --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Problems with the logging system?
I was responding to the original poster who indicated the question was for Java GAE. I finally determined that the default logging level in logging.properties needed to be INFO level to work with log4j (which I am using). On May 26, 7:26 pm, 风笑雪 kea...@gmail.com wrote: As I said, I only focus on Python, maybe you need ask to this group:http://groups.google.com/group/google-appengine-java 2009/5/27 Rmac rony...@gmail.com Yes, I have done all that was indicated in the documentation. Are you saying you have successfully used Java logging and seen output on GAE's console? On May 26, 12:27 pm, 风笑雪 kea...@gmail.com wrote: Have you done the doc said? http://code.google.com/intl/en/appengine/docs/java/runtime.html#Logging 2009/5/26 Rmac rony...@gmail.com I just set up my app deployment today so I am not experienced with the Java app engine, but I also cannot see any logger.info() messages either. If you get it working, I'd like to know how you did it. On May 25, 5:31 am, Marcelo Alcantara mar...@gmail.com wrote: Do you mean in the class? I got a logger with the full class name and used logger.info(). Used it from the java.util.logging. The logging console is working fine for you? On Mon, May 25, 2009 at 4:50 AM, 风笑雪 kea...@gmail.com wrote: Have you set logging level? 2009/5/25 Marcelo Alcantara mar...@gmail.com Somebody knows if there is a problem with the logging system? I am trying to log but my messages never appear there. The requests just appear when I selected show requests only on the combo. If I mark the checkbox to show requests nothing appears. Very strange behaviour. Thanks. Marcelo -- Marcelo Alcantara Senior Developer/Architect mar...@gmail.com +55 11 81968823 --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Need help with making additational html pages
Hi, how can I add more html pages with my app? I am just using google app engine. I already got the first page working. Now I need to add additonal pages. for example the url / is root meaning the main page. I want to add /home url which will direct the request to home.html I want the url to be /home and not /home/home.html. How can I do this? in the app.yaml I tried to add the static_files code followed up upload files. this shows nothing for the url /home. any ideas how to add html files that uses a url we specified? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Proximity Search using Latitude and Longitude in the Datastore
Try searching the archives for mutiny and/or geohash. both work. 2009/5/26 dannyr danny...@gmail.com: I'm trying to implement a proximity search of records based on my Latitude and Longitude columns. The code I'm trying to replicate can be found in: http://www.mmccann.com/using-latitude-an-longitude-to-do-proximity-searches/ Any idea of the best way to approach this in Google App Engine? Thanks. -- Barry - www.nearby.org.uk - www.geograph.org.uk - --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] MemoryError when trying to pickle an object
I'm getting a MemoryError exception when I try and pickle an object. The traceback is: value = pickle.dumps(value) File /base/python_dist/lib/python2.5/pickle.py, line 1359, in dumps Pickler(file, protocol).dump(obj) File /base/python_dist/lib/python2.5/pickle.py, line 218, in dump self.save(obj) File /base/python_dist/lib/python2.5/pickle.py, line 280, in save f(self, obj) # Call unbound method with explicit self File /base/python_dist/lib/python2.5/pickle.py, line 643, in save_dict self._batch_setitems(obj.iteritems()) File /base/python_dist/lib/python2.5/pickle.py, line 657, in _batch_setitems save(v) File /base/python_dist/lib/python2.5/pickle.py, line 280, in save f(self, obj) # Call unbound method with explicit self File /base/python_dist/lib/python2.5/pickle.py, line 482, in save_string self.write(STRING + repr(obj) + '\n') MemoryError I admit that the value is probably quite large -- maybe 2 or 3 megabytes, but this behavior seems a little excessive. Is there some sort of limit that I should know about? Thanks Philip --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: MemoryError when trying to pickle an object
If it has references it could be following that chain, and pickling lots of other things too ? Also google may have put the hard 1mb limit into pickle as well just so you don't get yourself into troub;e remember you can't put anything bigger than 1m into the datastore or memcache, so pickling anything bigger is probably not a lot of use in most cases Rgds T On May 27, 11:31 am, WeatherPhilip philip-goo...@gladstonefamily.net wrote: I'm getting a MemoryError exception when I try and pickle an object. The traceback is: value = pickle.dumps(value) File /base/python_dist/lib/python2.5/pickle.py, line 1359, in dumps Pickler(file, protocol).dump(obj) File /base/python_dist/lib/python2.5/pickle.py, line 218, in dump self.save(obj) File /base/python_dist/lib/python2.5/pickle.py, line 280, in save f(self, obj) # Call unbound method with explicit self File /base/python_dist/lib/python2.5/pickle.py, line 643, in save_dict self._batch_setitems(obj.iteritems()) File /base/python_dist/lib/python2.5/pickle.py, line 657, in _batch_setitems save(v) File /base/python_dist/lib/python2.5/pickle.py, line 280, in save f(self, obj) # Call unbound method with explicit self File /base/python_dist/lib/python2.5/pickle.py, line 482, in save_string self.write(STRING + repr(obj) + '\n') MemoryError I admit that the value is probably quite large -- maybe 2 or 3 megabytes, but this behavior seems a little excessive. Is there some sort of limit that I should know about? Thanks Philip --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
