[google-appengine] Re: --clear_datastore

Hi It will always say it can;t be found when you startup if you specify --datastore_path . And it won't create one until you actually stick some data in it. Rgds T -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, s

RE: [google-appengine] Cache headers not working w/ billing enabled

I didn't know this was supposed to work... My app does the same thing... Edge Caching doesn't seem to be happening. This implies it should... https://groups.google.com/group/google-appengine/browse_thread/thread/f10804 5013a2345c?pli=1 but my app does the same thing yours does, and http://www.se

[google-appengine] Re: --clear_datastore

Oh, good to know. Thanks! Was still linked to the phantom datastore though some how. On Feb 2, 6:16 pm, Tim Hoffman wrote: > Hi > > It will always say it can;t be found when you startup if you specify > --datastore_path . > And it won't create one until you actually stick some data in it. > > R

[google-appengine] Re: High Replication - How to download data via remote_api

@Nick I didn't put the s~ and still doesn't work. @Calvin. Tried it, and still doesn't work. The server logs say "ApplicationError: 1 app s~app_id cannot access app app_id's data" On Feb 2, 3:46 pm, Nickolas Daskalou wrote: > The "s~" also plays havoc when trying to add a HR app to a Google Apps

[google-appengine] "Beauty On the Outside, High Replication on the Inside" The conclusion?

Hello, This morning i have read the last article from appengine blog. "Beauty On the Outside, High Replication on the Inside" (http://goo.gl/45CxM) I don't have understood the conclusion, with datastore HR the latency is doubled. 400ms is really a reasonable latency? It is a good choice to migra

[google-appengine] Re: "Beauty On the Outside, High Replication on the Inside" The conclusion?

Hi Sahid In the article most of the parts of the application the latencies went down. The only area that went up was one that had a larger amount of writes. And if you think about it a High Replication Store will be more expensive for writes. You should look at your transaction mix to see if y

RE: [google-appengine] "Beauty On the Outside, High Replication on the Inside" The conclusion?

I don't think so. I don't know why they aren't running a caching mechanism in front of this. I can't imagine that a museum has a lot of data that changes. I may be the wrong person to ask since I believe in Cache everything, cache some more, and assume 80% of users all want 5% of your con

[google-appengine] response time vs cpu_ms

I'm trying to determine what is CPU Quota and how it is measured. I wrote a simple app which loads CPU doing some Datastore writes and then looked at results: /worker 200 14107ms 367870cpu_ms 359470api_cpu_ms The application responded after about 15 seconds, so 14107ms is probably response time.

RE: [google-appengine] response time vs cpu_ms

Each operation has a CPU Cost, and that cost is not related to real time. the CPU time is based on a single CPU at some clock speed (don't remember what). Because 12 cores could work on your request at twice the CPU you speed of the billable cpu, you can run up 24s of CPU in 1s of real time. And I

[google-appengine] Re: Signing jar files from the app

Signing: for instance updating a .jar file in the Blob Store with some tool offered or supported by Google. I hope it is clearer now. Thanks. On Feb 2, 4:43 am, devGS wrote: > Is it possible to sign a .jar file within GAEJ? If not, such future > will be very useful and welcomed. > Thanks. -- Yo

Re: RE: [google-appengine] response time vs cpu_ms

All right, here is a test app (written in python, imports stripped): class TheTest(db.Model): id = db.IntegerProperty() name = db.StringProperty(); class TestHandler(webapp.RequestHandler): def get(self): start_api = quota.get_request_api_cpu_usage() start = quota.get_

Re: [google-appengine] "Beauty On the Outside, High Replication on the Inside" The conclusion?

> It is a good choice to migrate in datastore HR? Depends on your priorities. Seems like the biggest reason to switch for the Art project, is there should be absolutely no downtime due to scheduled maintainence. On 2 February 2011 12:20, Brandon Wirtz wrote: > > That said I don’t know how th

Re: RE: [google-appengine] response time vs cpu_ms

Well, as for the time it takes to add a million entries, once you use app engine for a while you'll get use to using the map/reduce library to perform these types of tasks. As for the cost assuming your 12 entries per second you end up with: Cost ($) / Hour (CPU) = .1 Seconds / Hour = 3600 So, cos

[google-appengine] www.googleartproject.com keeps bugging out

http://www.googleartproject.com/ Keeps returning error messages, saying to post about it here -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this

[google-appengine] Re: wild match in url-pattern

So you agree that the google documentation give here: http://code.google.com/appengine/docs/java/mail/receiving.html is wrong and misleading! On Jan 28, 3:25 pm, yuvi wrote: > Hi, > > There are only 2 * options > /dirName/*  or  *.fileType  you can see many examples for that. > > On Jan 28, 1:40 

[google-appengine] Re: How to configure a entity field to be unique?

No solution folks? Any idea? How do you configure your unique fields? How can I use the email property to be part of the "Key". If is generated by* IDENTITY strategy*, do I need to interfere? Could someone just post some working code with a Key, and some unique fields? -- You received this mes

[google-appengine] Re: How to configure a entity field to be unique?

In Java please. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more o

[google-appengine] Issue Parsing incoming mail from Hotmail is Back!!

I am once again getting error in GAE SDK 1.4: java.io.IOException: Truncated quoted printable data when I do part.getContent(); Incomming Mails from Google and Yahoo work. I only see the issue from Hotmail. This code given here: http://code.google.com/p/appengine-springmvc3-starter-app/ does n

Re: [google-appengine] Re: How to configure a entity field to be unique?

Since email addresses can change it isn't a good idea to use them in an entity's id. On Feb 2, 2011 12:41 PM, "dudu" wrote: > No solution folks? Any idea? > How do you configure your unique fields? > > How can I use the email property to be part of the "Key". > If is generated by* IDENTITY strateg

Re: [google-appengine] Cache headers not working w/ billing enabled

Hi Brandon, Have you tried setting 'cache-control: public; max-age=300'? Note 'public.' Robert On Wed, Feb 2, 2011 at 03:43, Brandon Wirtz wrote: > I didn't know this was supposed to work... My app does the same thing... > Edge Caching doesn't seem to be happening. > > This implies i

Re: [google-appengine] Any advice on recommended DataStore equivalent to these type(s) of table?

Hi Loren, Think about how you will be querying and presenting / reporting on the information, that will help you structure your data. If you be frequently displaying a large report listing or querying all plant names and their UOM + pricing information, you might want to denormalize the data (ie

[google-appengine] Inconsistent cascading persistence-by-reachability behavior with JDO, App Engine, Data Nucleus, JUnit

I'm experimenting with App Engine, using JDO and DataNucleus for persistence. I have a simple domain that includes several unidirectional relationships. The question comes with nesting those relationships: * Civilization -(1-1)-> Clan * Civilization -(1-1)-> Land * Civilization -(1-1)-

[google-appengine] domain problem with app

I'm trying to point one domain to my app aplication following the instructions, but when i try to acces by the url throw me this error: Error: Forbidden Your client does not have permission to get URL / from this server. anyone with this problem? Thanks in advance. -- You received this message

[google-appengine] can't access my dashboard at appengine.google.com/a/mydomain.com

Hi. I was using appengine for some time, I had one application. Then I suspended it. It was about one or two months ago. I was accessing dashboard using this link: appengine.google.com/a/ mydomain.com but now it redirects me to appengine.google.com and I do not see my suspended application there o

[google-appengine] Problem deleting data with Datastore Admin

Hi, Sorry if this is common knowledge, but I did search a bit. I'm trying to delete a datastore from Datastore Admin. The datastore looks like this: Entity Kind # Entities Avg. Size/EntityTotal Size favIcon 204,235 4 KBytes848 MBytes My quota for the data

[google-appengine] Re: Can't attach error messages to individual fields in clean()

One more thing, if I just throw a validation error, that works fine, but it doesn't put the error message on both of the fields. raise forms.ValidationError(u"You need to pick a start date and time in the future.") -- You received this message because you are subscribed to the Google Groups "

[google-appengine] Can't attach error messages to individual fields in clean()

I'm trying to follow the example at the bottom of django form *reference*. I have to fields, start and an end date and I want to validate that the start date comes after the end date. However when I try to do this part: msg = u"Must

Re: [google-appengine] Design Question

Hi Ravi, If you are ordering on something, you'll hit a problem with exploding indexes. You would wind up with additional indexes on (allKey, the order prop), (allKey, allKey, the order prop), , (allKey, allKey, allKey, the order prop), and (allKey, allKey, allKey, allKey, the order prop). That

[google-appengine] Static files exceeding 10MB

Hello I have several video clips that is to be deployed to my web app that exceeds 10MB. I can not deploy the war file as it says some files exceed the 10MB threshold. Is there a way to bypass this or do I need to use a blobstore? Correct me if I am wrong, but my understanding is that in order

Re: [google-appengine] Re: How to configure a entity field to be unique?

No but to implement a unique constraint, I find key_names are usually the easiest way. But you're right, the email can change so he might need to add a second kind used to track the uniqueness of that field. On Wed, Feb 2, 2011 at 12:58, Jeff Schwartz wrote: > Since email addresses can ch

Re: [google-appengine] BadRequestError: Too many indexed properties

Each property generates 2 indexes, an ASC and DESC index. Do you have a list property that can have over 2000 entries? -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_e

Re: [google-appengine] Re: How to configure a entity field to be unique?

Search both this group and search the appengine-java group. You are not the first person to ask about unique fields, someone has probably posted working Java code in the past. Robert On Wed, Feb 2, 2011 at 12:41, dudu wrote: > In Java please. > > -- > You received this message because you

Re: [google-appengine] Problem deleting data with Datastore Admin

The datastore admin needs to add some entities to function. You might try deleting some entities using a handler, the remote api, or simply using the datastore viewer then see if you can kickoff the delete job. Robert On Wed, Feb 2, 2011 at 10:25, Ilkka Huotari wrote: > Hi, > > Sorry if

[google-appengine] Re: Problem deleting data with Datastore Admin

I was using the web interface. Does this look like a bug to you? Should I create an issue into the tracker? Ilkka On Feb 2, 9:39 pm, Robert Kluin wrote: > The datastore admin needs to add some entities to function.  You might > try deleting some entities using a handler, the remote api, or simpl

[google-appengine] Re: Problem deleting data with Datastore Admin

I was able to delete the entries one by one (or one screen at a time) but of course it's not very feasible. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscri

Re: [google-appengine] Re: Problem deleting data with Datastore Admin

After you've deleted some entities you might try kicking the bulk delete off again. Turn the entities / page up to 200 and delete 4 or 5 page fulls, then try to start the bulk delete again. On Wed, Feb 2, 2011 at 14:43, Ilkka Huotari wrote: > I was able to delete the entries one by one (or o

[google-appengine] Re: Problem deleting data with Datastore Admin

Ok. I did delete about 10 screens of 200 entries but the bulk delete still gave me the same error. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from t

[google-appengine] Re: Problem deleting data with Datastore Admin

Ok, I did make a new issue for this, we'll see if I did something I will regret in the future. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this

RE: [google-appengine] Cache headers not working w/ billing enabled

Just made the change... I'll check back to see if it helps. It doesn't appear I can set the cache header for files served from static... Am I missing something some where? -Original Message- From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of

Re: [google-appengine] "Beauty On the Outside, High Replication on the Inside" The conclusion?

I've seen some of the things they are doing in the art project, and I suspect we can drive down those latencies even more with the "eventually consistent" flag for batch gets for mass numbers of root entities, given the rarity of changes in museum collections. Eventually consistent reads are genera

Re: RE: [google-appengine] response time vs cpu_ms

The reason you don't think about this cost in a VPS is because you have *already* paid for the CPU; you're just using idle CPU cycles and disk access. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine T

Re: [google-appengine] Re: Considering using Google Accounts for authentication. Good idea?

Jeff, i think I have to explain better my self. If you check against the UserService if the user is logged in ( http://code.google.com/appengine/docs/java/javadoc/com/google/appengine/api/users/UserService.html#isUserLoggedIn%28%29 ) here you will have the trouble that I said to you, when the u

[google-appengine] Re: Considering using Google Accounts for authentication. Good idea?

Yes you are absolutely correct. With google auth I do not need to maintain a login page as user is redirected to googles login page when authentication is needed. But my problem remains the same. Users come to my site and then are forwarded to the google login page asking for their google credentia

[google-appengine] Please enable gzip for Apple-PubSub

There is a bug report for this already, but it's wrongly labeled as "Component-Urlfetch" and doesn't seem to get attention. GET /feed HTTP/1.1" 200 11203 - "Apple-PubSub/65.20,gzip(gfe)" GET /feed HTTP/1.1" 200 2849 - "Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.13) Gecko/20101203 Fir

Re: [google-appengine] Re: Problem deleting data with Datastore Admin

Deleting an item doesn't immediately delete it. It is just marked as deleted. You'll need to wait a while before space is actually freed up. On Wed, Feb 2, 2011 at 1:24 PM, Ilkka Huotari wrote: > Ok, I did make a new issue for this, we'll see if I did something I > will regret in the future. > >

Re: [google-appengine] Re: Considering using Google Accounts for authentication. Good idea?

Hi Nacho, On Wed, Feb 2, 2011 at 3:55 PM, nacho wrote: > Jeff, i think I have to explain better my self. > > If you check against the UserService if the user is logged in ( > http://code.google.com/appengine/docs/java/javadoc/com/google/appengine/api/users/UserService.html#isUserLoggedIn%28%29)

Re: [google-appengine] Re: Considering using Google Accounts for authentication. Good idea?

I can understand and relate to users' suspicions and concerns regarding privacy and security. What I intend to do is to explain the whole process to them before they are directed to Google Accounts login. On Wed, Feb 2, 2011 at 4:05 PM, Sandeep Arneja wrote: > Yes you are absolutely correct. Wit

Re: [google-appengine] Re: How to configure a entity field to be unique?

If the user changes their email address then all entities using it as their part of their key would have to be deleted from the datastore (you can not update an entities ID) and then saved again using their new email address. That's doable but very expensive and IMHO something to be avoided at all

RE: [google-appengine] Cache headers not working w/ billing enabled

Didn't see any change after setting to public. -Original Message- From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Brandon Wirtz Sent: Wednesday, February 02, 2011 12:48 PM To: google-appengine@googlegroups.com Subject: RE: [google-appengine]

Re: [google-appengine] Re: Can't attach error messages to individual fields in clean()

You don't tell which version of the django forms you use. You link to a django 1.0 form page but django 0.96 does it a bit different. In your form subclass define the following functions and raise the same raise forms.ValidationError(u"You need to pick a start date and time in the future.") if nee

Re: [google-appengine] Re: How to configure a entity field to be unique?

That sounds like an edge case to me that you'd be overengineering for unless you had a specific use case. How often have you changed your email address? I think the last time I changed mine was when Gmail launched in ... 2003? 2004? The only exception is if you are building something business relat

[google-appengine] Re: Static files exceeding 10MB

I had a similar problem serving external static content from my appspot... maybe my solution would work for you: http://goo.gl/jSqzW You could use this to serve your videos from any external server, or even SVN. You would still be limited to serving 32MB because of the URL fetch limits... if you

[google-appengine] faster machine learning on appengine (nlp bayes)

Hi, The app we built is facing some scalability issues and i'm thinking there must be another way so i'm asking for help. Basically we fetch the several rss's and classify each article using bayes algorithm. The problem is that if a given article has too many words/features then the task will

Re: [google-appengine] Cache headers not working w/ billing enabled

Hey guys, A few things about the cache-control headers: - We do not guarantee your responses will be cached. We make a best effort to do caching, but at best, this is an optimization. In the worst case scenario all requests will continue to reach your app - You *may* hit a different edge cache t

[google-appengine] Re: faster machine learning on appengine (nlp bayes)

If the key_name for each classified word was the actual word then you could do a batch get for all the words in an article. Is there a reason it can't be? Also it seems like the work of fetching the classifications could be split up Map/Reduce style. Chop an article into chunks that can be

[google-appengine] Re: faster machine learning on appengine (nlp bayes)

Not sure. Words are in portuguese so they have accented chars like "graça" and "évora" - could these be keys? The whole process is more or less like this: a cronjob fetches an rss, and creates a task for each article - inserting the article and marking it as unprocessed. Then there's another cr

RE: [google-appengine] Cache headers not working w/ billing enabled

I'm game to tweak things especially to see how it changes the results. How Long a cache would you say something needs to be set to have the caching trigger? I'm not worried about performance at this point, but I'm curious to see this work. Is it possible to set the cache headers for things

[google-appengine] Re: faster machine learning on appengine (nlp bayes)

I've never tried to use unicode as a key name. Could possibly use the base64 of the word as the key name? There are some great Google IO talks on ways to do map reduce/batch processing. This is the first one I found: http://www.google.com/events/io/2010/sessions/batch-data-processing-app-engin

[google-appengine] Re: faster machine learning on appengine (nlp bayes)

I'll try both suggestions and see how it goes. Thanks for the input :) -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to

Re: [google-appengine] Re: faster machine learning on appengine (nlp bayes)

Hi Sofia, Another option would be to use the Google Prediction API, which will do all this for you! -Nick Johnson On Thu, Feb 3, 2011 at 1:33 PM, sofia wrote: > I'll try both suggestions and see how it goes. Thanks for the input :) > > -- > You received this message because you are subscribed

[google-appengine] Re: faster machine learning on appengine (nlp bayes)

@Calvin I've tried using unicode as key_names. It works fine with mine. @Nick Interesting On Feb 3, 11:53 am, "Nick Johnson (Google)" wrote: > Hi Sofia, > > Another option would be to use the Google Prediction API, which will do all > this for you! > > -Nick Johnson > > On Thu, Feb 3, 2011 at 1:

Re: [google-appengine] Re: Can't attach error messages to individual fields in clean()

Thanks, that worked great. Good point about the 1.0 vs 0.96. I tried to find the 0.96 docs but it looks like they aren't on the django project's site anymore. Do you know if they are still up somewhere? I guess I could probably just get them out of django's source control too. -- You received

Re: [google-appengine] Re: Can't attach error messages to individual fields in clean()

It worked great with one caveat. When I raise an error I can only attach it to one form field. Say I wanted to attach the error message to both the start and end date field. Is there a way to do that? It looks like one of the fields gets "cleaned" before the other one, so what ever one gets cl

[google-appengine] MapReduce: Mutation Pool question

Hi, So i'm playing around with the map reduce and just faced this problem (more of a unknown actually) The one i ran takes about 40GB worth of entities and deletes them (i'm not using the datastore admin since i actually need to speed the process by sharding more and increasing the process rat