[google-appengine] Re: Help: can you help validate MyApp / Datastore / Bigtable / GFS?

On Wed, Oct 8, 2008 at 4:22 PM, pr3d4t0r <[EMAIL PROTECTED]> wrote: > > On Oct 7, 4:45 am, "David Symonds" <[EMAIL PROTECTED]> wrote: >> Users of Bigtable don't always communicate through the BT master; they >> usually go straight to the tablet server once they know which one they >> need to talk

[google-appengine] Re: Definition of "Google's Infrastructure"

Regarding "Should we design our system so that if the datacenters where an app is deployed are vaporized, then the app keeps serving? No, this is a much thornier issue." does this mean that an app's data is stored in one and only one data center with no off-site backups? I could understand that t

[google-appengine] Re: Why Google App Engine is broken and what Google must do to fix it.

Not all applications' data can be modeled such that that each piece of data belongs to one and only one user. On Oct 7, 10:24 pm, "Ian Lewis" <[EMAIL PROTECTED]> wrote: > The documentation says that an entity group could be as large as a single > user's data. It seems to me that to avoid the prob

[google-appengine] Re: Why Google App Engine is broken and what Google must do to fix it.

The documentation says that an entity group could be as large as a single user's data. It seems to me that to avoid the problem you are describing that it would be a good idea to do so. I have a feeling that the number of cases where you would need to update more than one user's data in a single tr

[google-appengine] Re: Help: can you help validate MyApp / Datastore / Bigtable / GFS?

On Oct 7, 4:45 am, "David Symonds" <[EMAIL PROTECTED]> wrote: > Users of Bigtable don't always communicate through the BT master; they > usually go straight to the tablet server once they know which one they > need to talk to. Thanks Dave. This, for now, is a high-level architectural view. Do y

[google-appengine] Re: Definition of "Google's Infrastructure"

Regarding the CDN case is markedly different from the datastore case, since you're just dealing with immutable blobs. This is not the thorny issue. Regarding the EC2 availability zone case, these are not spread across continents. Quoting from http://developer.amazonwebservices.com/connect/entry.

[google-appengine] Re: Definition of "Google's Infrastructure"

EC2 has availability zones. SSDS will be doing something similar. CDNs and SDNs often operate on the concept of replicating content close to various edges in order to reduce latency/improve throughput. Short of fixes on that scale, one must engage in data sync'g in some form or another. All kind

[google-appengine] Re: What is an acceptable average request time?

Your best reference for that is likely: http://code.google.com/appengine/articles/quotas.html Also notable is that you need to make sure you do not consume more than 300ms of cpu-time per request (time spent waiting on API calls is not counted in this specific threshold). On Oct 7, 5:10 pm, Ami

[google-appengine] Re: www [mydomain.org] Already used, please remove previous mapping first.

This did not resolved my problem. I have disabled all services then tried, received same error. On Oct 7, 1:24 am, "Marzia Niccolai" <[EMAIL PROTECTED]> wrote: > Hi, > > The issue here is that, by default, Google Apps has assigned www to sites, > and you have to disable this before mapping www

[google-appengine] Re: Datastore Timeouts Must Die

Hi Alex, sorry for the frustrations this is causing. The first thing I would check for here is to verify that these writes are not failing due to entity group contention. (documentation on entity groups: http://code.google.com/appengine/docs/datastore/keysandentitygroups.html#Entity_Groups_Ancesto

[google-appengine] Re: Definition of "Google's Infrastructure"

Should we allow control over where the app is serving from? Sure, that sounds very reasonable, and is notably important for certain legal reasons amongst our European customers. Should we design our system so that if the datacenters where an app is deployed are vaporized, then the app keeps servi

[google-appengine] Re: reading a file

the static files and the source code are not stored on the same server of Google's. so you can not do things as you said, if you really want to do this,try use the urllib. 在 2008-10-8，上午8:48， manuelaraoz 写道： > > Hey! > I'm really confused! > > I have this line of code: > > fin = open("static/t

[google-appengine] Re: Simple Graphics App

On Tue, Oct 7, 2008 at 9:32 PM, codingJoe <[EMAIL PROTECTED]> wrote: > > I'm new to Google Code and I'm looking for expert advice on the best > structure and libraries to build a simple graphics app on GAE. > > In my app, I want to give the user the ability to move slider bars to > control variabl

[google-appengine] Re: reading a file

GAE's filesystem is read-only, why do you need to open that file? On Tue, Oct 7, 2008 at 6:48 PM, manuelaraoz <[EMAIL PROTECTED]> wrote: > > Hey! > I'm really confused! > > I have this line of code: > > fin = open("static/text/data.txt",'r') > > > when running with dev_appserver everything is ok

[google-appengine] Re: reading a file

ahhh hit send too fast, by read-only I'm trying to say paths and files aren't exactly there, you don't have the ability to see the underlaying filesystem. On Tue, Oct 7, 2008 at 10:19 PM, Jorge Vargas <[EMAIL PROTECTED]> wrote: > GAE's filesystem is read-only, why do you need to open that file? >

[google-appengine] Datastore timeout error

Hello, I'm developing a quiz application now and I have a problem with datastore. Most of the time, application saves the data into the datastore, but sometimes, I get an exception. Exception in request: Traceback (most recent call last): File "/base/data/home/apps/django/core/handlers/base.py

[google-appengine] reading a file

Hey! I'm really confused! I have this line of code: fin = open("static/text/data.txt",'r') when running with dev_appserver everything is ok but when I deploy the application, it fails, stating: Traceback (most recent call last): File "/base/python_lib/versions/1/google/appengine/ext/webapp/

[google-appengine] app_id is not valid in appgallery

Hi! I'm trying submit my app to appgallery, but I'm getting the error "The app_id you entered is not valid or application is not functioning. Please enter a valid app_id.". Anyone has this problem? The app is http://orkuturl.appspot.com/. Thanks. -- Thiago Coutinho - http://thiago.bunghole.c

[google-appengine] Re: Can We use Unicode in Custom Tags?

> @Try prefixing your string with 'u' in PostA.render(): > > return u"%s" % > (p.id,p.id,p.title) I have *Already* try this.but it does not work. > @If this doesn't help, it's probably a bug in Django 0.96 templates. > Try switching to 1.0, it has a lot of Unicode-related fixes: > http://docs.djan

[google-appengine] Re: Why Google App Engine is broken and what Google must do to fix it.

Assuming you can actually work around all of the limitation simultaneously, considering the more things you work around the close you come to the CPU time quota. It also is not completely accurate to state that the limitations are there to make apps safe and scalable. For example transactions be

[google-appengine] Simple Graphics App

I'm new to Google Code and I'm looking for expert advice on the best structure and libraries to build a simple graphics app on GAE. In my app, I want to give the user the ability to move slider bars to control variables and drag simple custom icons onto a chart. The following example illustrate

[google-appengine] Re: What is an acceptable average request time?

Amir Michail wrote: > I think what's required here is a tool to give developers get a > reasonable idea whether it would be feasible to port their app to the > google app engine with its present quotas/deadlines. I beleive the warnings about the average request time occur when a request takes mor

[google-appengine] Re: What is an acceptable average request time?

On Oct 7, 6:51 pm, "David Symonds" <[EMAIL PROTECTED]> wrote: > On Wed, Oct 8, 2008 at 8:36 AM, Amir Michail <[EMAIL PROTECTED]> wrote: > > I mean what sort of request times should one aim for to avoid having > > the app shut down for hours? > > As short as possible. It will depend on the amount o

[google-appengine] error in the configuration documentation?

Documentation and the introductory video state that to start the dev web server you have to run this: dev_appserver.py [options] . In Ubuntu actually you have to run : $ python dev_appserver.py [options] I found this ambiguous especially for people who are coming from other backgrounds not py

[google-appengine] Re: Why Google App Engine is broken and what Google must do to fix it.

Davew said it way back at the top - appengine's killer feature is scalability. That is what sets it apart from the other cloud systems out there, and it is also the root cause of most complaints (except the quotas, which will disappear when you get to pay for the service). For the application I'm

[google-appengine] Re: What is an acceptable average request time?

On Wed, Oct 8, 2008 at 8:36 AM, Amir Michail <[EMAIL PROTECTED]> wrote: > I mean what sort of request times should one aim for to avoid having > the app shut down for hours? As short as possible. It will depend on the amount of traffic: if it's very few requests, they can take several seconds; i

[google-appengine] Re: Model.put() Best Practice

> > Maybe in production, it is different > > Anyone can confirm to this ? In my app, putting 10-20 entities in one go is 2-3 times faster than putting them one by one. You can also get some benchmarks from http://www.cloudstatus.com/ --~--~-~--~~~---~--~~ You rece

[google-appengine] Re: Can I use key or id in gql?

>From http://code.google.com/appengine/docs/datastore/keysandentitygroups.html: Key names and IDs cannot be used like property values in queries. However, you can use a named key, then store the name as a property. You could do something similar with numeric IDs by storing the object to assign th

[google-appengine] Re: Can We use Unicode in Custom Tags?

If this doesn't help, it's probably a bug in Django 0.96 templates. Try switching to 1.0, it has a lot of Unicode-related fixes: http://docs.djangoproject.com/en/dev/ref/unicode/ On Oct 8, 10:06 am, Alexander Kojevnikov <[EMAIL PROTECTED]> wrote: > Try prefixing your string with 'u' in PostA.rend

[google-appengine] Re: Can We use Unicode in Custom Tags?

Try prefixing your string with 'u' in PostA.render(): return u"%s" % (p.id,p.id,p.title) On Oct 8, 1:18 am, Gmail <[EMAIL PROTECTED]> wrote: > Current I Try to Use django's Custom Tags, > It is usful,I like it. > > but when i try to render something Unicode , > I got UnicodeDecodeError. > > This

[google-appengine] Re: Datastore Timeouts Must Die

As an example, of how frequently datastore write timeouts are happening on app engine, here are the last 20 entries in my production error log, showing 20 timeouts in 15 minutes! I'm hoping the Google team will break their silence about this and at least acknowledge the problem. Developers: plea

[google-appengine] Re: What is an acceptable average request time?

On Oct 7, 5:28 pm, "David Symonds" <[EMAIL PROTECTED]> wrote: > On Wed, Oct 8, 2008 at 8:17 AM, Amir Michail <[EMAIL PROTECTED]> wrote: > > Anyone know what sort of request times are acceptable? > > Acceptable to whom? > > Dave. I mean what sort of request times should one aim for to avoid having

[google-appengine] Re: What is an acceptable average request time?

On Wed, Oct 8, 2008 at 8:17 AM, Amir Michail <[EMAIL PROTECTED]> wrote: > Anyone know what sort of request times are acceptable? Acceptable to whom? Dave. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google A

[google-appengine] What is an acceptable average request time?

Hi, Anyone know what sort of request times are acceptable? Amir --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To

[google-appengine] Re: Definition of "Google's Infrastructure"

Reliability/redundancy is important. However don't overlook the fact that performance for international users is greatly affected by your server's location, considering latency/packet loss, etc. And there are markets outside the US. ;-) On Oct 7, 3:39 pm, "Andrew Badera" <[EMAIL PROTECTED]> wro

[google-appengine] Re: Definition of "Google's Infrastructure"

So you want to be assured that if all the Google data centers in the U.S. (over 12) go down (I wonder the probability of this), your GAE application will still be up? On Oct 7, 11:35 am, "Andrew Badera" <[EMAIL PROTECTED]> wrote: > Ahh ... availability and assurance? That's half the point of the

[google-appengine] Re: TypeError: 'NoneType' object is unsubscriptable

Marzia, I added a few Index. NoneType errors have reduced. Still I get those errors every once in a while. Data-Store timeouts are happening 50% of the time. Even for queries where the result set is really small. I am retrieving only 20 entities per request, but even that is causing time-out erro

[google-appengine] Re: Some problems with database filling

For every record you need to create a new LjShort. When you put() a record it gets a key and this record gets rewritten with all the records class Feed(webapp.RequestHandler): def get(self): feed = feedparser.parse('someRSSlink') for i in feed.entries: ljfeed = LjShort

[google-appengine] Re: Definition of "Google's Infrastructure"

That's the point of the cloud -- if you're going to make your resources external, remote, you need to provide a means for assuring uptime. For some people, different geophysical locations are required for their service. Obviously GAE beta shouldn't see a true NEED for this while still in beta, but

[google-appengine] Re: GAE Obfuscator?

> See "Software patent debate" > http://en.wikipedia.org/wiki/Software_patent_debate "google algorithm" on Patent Search http://www.google.com/patents?spell=1&q=google+algorithm&btnG=Search+Patents The first, US Pat. 6594692 - Filed Apr 29, 1996 "Methods for transacting electronic commerce" http

[google-appengine] Definition of "Google's Infrastructure"

What exactly does the term Google's Infrastructure imply? Once deployed does an application get deployed to regional (ie international) data centers? If not, from what general geographical area are the applications being served from? (US only?) And are there plans to allow an application to be dep

[google-appengine] Re: Definition of "Google's Infrastructure"

Honestly, why would anyone need to deploy their GAE applications to international data centers? On Oct 7, 10:48 am, dleifker <[EMAIL PROTECTED]> wrote: > What exactly does the term Google's Infrastructure imply? Once > deployed does an application get deployed to regional (ie > international) dat

[google-appengine] Re: Definition of "Google's Infrastructure"

Ahh ... availability and assurance? That's half the point of the cloud. On Tue, Oct 7, 2008 at 2:34 PM, Sal <[EMAIL PROTECTED]> wrote: > > Honestly, why would anyone need to deploy their GAE applications to > international data centers? > > On Oct 7, 10:48 am, dleifker <[EMAIL PROTECTED]> wrote:

[google-appengine] Re: Please provide interactive sql-like queries, even inefficient ones

on a different note, a number of the shell and console applications posted to the group can be embedded in your app, as an admin-only handler. you can then use them to do interactive datastore maintennance, similar to a traditional sql shell: http://shell.appspot.com/ http://con.appspot.com/ --~-

[google-appengine] Re: Authenticated RPC from gadget to appengine service?

I'm facing the same problem. I'm looking for client authentication in GAE application using Google credentials. As I understand users API doesn't provide such interfaces. I also looked at OAuth and AuthSub module. You're right, they're for another purpose. So the problem can be solved "unofficial

[google-appengine] A fault-tolerant open source counter

I've extended my implementation of a sharded, memcached counter to allow more graceful handling of failed shard puts because of timeout, capability disabling, etc. The idea is to use memcache as a buffer for failed put data, which gets re-added to the next successful put. Longer writeup here: h

[google-appengine] Re: Model.put() Best Practice

> If you check the SDK, I think there is no real difference between > put(entity) or put(entities). > > I don't think put(entities) will be a lot faster. > > Maybe in production, it is different I think in production it is different. See the comment by ryan (google datastore lead) on using multip

[google-appengine] Re: Please provide interactive sql-like queries, even inefficient ones

On Tue, Oct 7, 2008 at 1:00 PM, Jon McAlister <[EMAIL PROTECTED]> wrote: > > Neat idea. Most of the other proposals in the Issue Tracker seem to > relate to letting full application code run longer or in the > background in some way, whereas your proposal is to only allow > processing as specified

[google-appengine] Re: Please provide interactive sql-like queries, even inefficient ones

Neat idea. Most of the other proposals in the Issue Tracker seem to relate to letting full application code run longer or in the background in some way, whereas your proposal is to only allow processing as specified in a strict language. The admin would submit their query string, and we would run

[google-appengine] Re: Idle and appengine, in Linux

Hi, You need to run App Engine programs using the dev_appserver, it can not be run through the command line. If you are interested in a command line like environment with App Engine, you can run your own instance of the shell app, or try it online. Shell: http://shell.appspot.com Source code: ht

[google-appengine] Re: Model.put() Best Practice

Hi Peter, On Tue, Oct 7, 2008 at 9:49 PM, Peter Recore <[EMAIL PROTECTED]> wrote: > You really want > to know how many simultaneous requests can be served, which is very > different. > This is what I need to be confirmed. Thanks. > This video should give you some ideas on how to properly load

[google-appengine] Re: Programmatically retrieve quotas

Hi, Currently we do not have an API to query quota usage, but if you think it would be of use, please star the issue: http://code.google.com/p/googleappengine/issues/detail?id=655 -Marzia On Tue, Oct 7, 2008 at 4:53 AM, nickcharb <[EMAIL PROTECTED]> wrote: > > Hello, > > Is there a way to obtai

[google-appengine] Can I use key or id in gql?

Hello. Can I use key or id of data in gql? I want to use like below. class TopicCmt(db.Model): topic = db.ReferenceProperty(Topic, required=True) owner = db.ReferenceProperty(User, required=True) user_name = db.StringProperty(required=True) def list(req): except_lis

[google-appengine] Programmatically retrieve quotas

Hello, Is there a way to obtain GAE quotas (such as space used) from within GAE rather than manually through the dashboard? I'd like to measure my usage within the app and make make decisions such as delete old entries if my space usage is close to the quota. Thanks, Nick --~--~-~--~--

[google-appengine] Re: Encrypted Paypal Forms and supported python encryption libraries

Hmmm... that would probably run into CPU usage timeouts. >From the pyDES page: "The code below is not written for speed or performance, so not for those needing a fast des implementation, but rather a handy portable solution ideal for small usage. It takes my AMD2000+ machine 1 second per 2.5 ki

[google-appengine] Re: Model.put() Best Practice

Feris, I don't think your benchmark is testing what you really want to know. You are testing how many puts *one request* can do. You really want to know how many simultaneous requests can be served, which is very different. This video should give you some ideas on how to properly load test a ap

[google-appengine] Re: Model.put() Best Practice

Hi Sylvain, On Tue, Oct 7, 2008 at 7:17 PM, Sylvain <[EMAIL PROTECTED]> wrote: > If you check the SDK, I think there is no real difference between > put(entity) or put(entities). > > I don't think put(entities) will be a lot faster. > Thanks for the info, I'm not quite good at Python right now so

[google-appengine] Can We use Unicode in Custom Tags?

Current I Try to Use django's Custom Tags, It is usful,I like it. but when i try to render something Unicode , I got UnicodeDecodeError. This is my Tag: class PostA(template.Node): def render(self, context): p=context['p'] return "%s" % (p.id,p.

[google-appengine] Re: GAE Obfuscator?

On Mon, Oct 6, 2008 at 3:30 PM, Davide Rognoni <[EMAIL PROTECTED]> wrote: > > A good obfuscator do not make a code more slow or bugged (see > JavaScript obfuscators) > link? seriously a javascript compressor is not an obfuscators, see http://en.wikipedia.org/wiki/Minify that has a serious advant

[google-appengine] Re: Why Google App Engine is broken and what Google must do to fix it.

On Mon, Oct 6, 2008 at 9:20 AM, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: > > Jorge, > > One thing you have to remember it is not what Guido or the engineers > want. If Google App Engine is to succeed it is what the customers > want. If it is designed as you have stated it will never recoup wha

[google-appengine] Re: Model.put() Best Practice

If you check the SDK, I think there is no real difference between put(entity) or put(entities). I don't think put(entities) will be a lot faster. Maybe in production, it is different On 7 oct, 12:34, "Feris Thia" <[EMAIL PROTECTED]> wrote: > Hi, > > I've spinned off this topic from the other t

[google-appengine] Re: Help: can you help validate MyApp / Datastore / Bigtable / GFS?

On Tue, Oct 7, 2008 at 6:10 PM, pr3d4t0r <[EMAIL PROTECTED]> wrote: > Can you please help me validate these assumptions and/or recommend > corrections? This is for a publication about Google App Engine that > I'm working on and I'd like to gather the opinions of people who know > better than me.

[google-appengine] Re: Eclipse auto-completion for response/request objects...

I have the same problem.. On Oct 7, 7:38 am, Drew <[EMAIL PROTECTED]> wrote: > After looking through this group I found this wonderful guide for > setting up Eclipse to work with GAE/Python using Pydev: > > http://code.google.com/appengine/articles/eclipse.html > > However, after following the in

[google-appengine] Model.put() Best Practice

Hi, I've spinned off this topic from the other thread ( http://groups.google.com/group/google-appengine/browse_thread/thread/4803d360fa62b5ea ). >From

[google-appengine] Re: Using naked domains (like http://example.com)

Hi Jeff, Can a Google Code GAE Issue be created for this so we can track it (instead of doing searches in google groups)? On Sep 10, 3:09 am, "Jeff S (Google)" <[EMAIL PROTECTED]> wrote: > Hi all, > > One question that we see a lot on the group is about setting up an app > to serve from anake

[google-appengine] Help: can you help validate MyApp / Datastore / Bigtable / GFS?

Greetings. This is the logical view of the Datastore in relationship to Bigtable and other components of the infrastructure, as seen from the application's point of view: http://eugeneciurana.com/personal/images/figure-6-1.png Can you please help me validate these assumptions and/or recommend c