[google-appengine] Stop a nuclear disaster
Hi Google App Engine,Our government is churning out one hazardous bill after another. This time it is a bill called the Civil Liability for Nuclear Damage, and it's coming up for a vote in a couple of days. The bill lets U.S. corporations off the hook for any nuclear accidents they cause on Indian soil. They'd only have to pay a meagre amount, and Indian taxpayers would be stuck paying crores for the nuclear clean up and to compensate the victims. Without any public debate, the Prime Minister is appeasing American interests and ignoring our safety. Greenpeace is launching a petition asking the PM to hold a public consultation before introducing the bill. I have already signed this petition. Can you join me? http://www.greenpeace.org/india/stop-the-vote Thanks! pra...@gmail.com You are receiving this email because someone you know sent it to you from the Greenpeace site. Greenpeace retains no information about individuals contacted through its site, and will not send you further messages without your consent -- although your friends could, of course, send you another message. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Uploading with the bulkloader.py
Well, I am assuming this was a typo in your original e-mail (since the error does not seem to suggest you are actually running this command) but: --url=http://bulkmove.latest.railsturbinetest.appspot.com/ Should be: --url=http://bulkmove.latest.railsturbinetest.appspot.com/remote_api On Sat, Mar 13, 2010 at 3:55 AM, Josh Moore wrote: > Hi I am trying to download all of the datastore objects in my application > with the bulkloader and then upload them into a different application. > > I use this command to download: > bulkloader.py --dump --app_id=jsm277 --url= > http://bulkmove.latest.jsm277.appspot.com/remote_api--filename=test_download_data > > and I get this output: > > /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py:64: > DeprecationWarning: the sha module is deprecated; use the hashlib module > instead > import sha > /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/dev_appserver_login.py:33: > DeprecationWarning: the md5 module is deprecated; use hashlib instead > import md5 > [INFO] Logging to bulkloader-log-20100313.160710 > [INFO] Throttling transfers: > [INFO] Bandwidth: 25 bytes/second > [INFO] HTTP connections: 8/second > [INFO] Entities inserted/fetched/modified: 20/second > [INFO] Opening database: bulkloader-progress-20100313.160710.sql3 > [INFO] Opening database: bulkloader-results-20100313.160710.sql3 > [INFO] Connecting to bulkmove.latest.jsm277.appspot.com/remote_api > [INFO] Downloading kinds: [u'Blogs', u'Posts', u'Blog', u'Person', > u'Post', u'_ah_SESSION'] > ..[INFO] _ah_SESSION: No descending index on __key__, performing > serial download > > > [INFO] Have 21307 entities, 0 previously transferred > [INFO] 21307 entities (7414423 bytes) transferred in 1063.4 seconds > > > Then I use this command to upload to my new application: > > bulkloader.py --restore --url= > http://bulkmove.latest.railsturbinetest.appspot.com/--filename=test_download_data > --app_id=railsturbinetest > > And this is the output that I am getting: > Josh-Moores-MacBook:datadownload joshmoore$ bulkloader.py --restore --url= > http://bulkmove.latest.railsturbinetest.appspot.com/--filename=test_download_data > --app_id=railsturbinetest > ~/Documents/code/new_rails_turbine/ > /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py:64: > DeprecationWarning: the sha module is deprecated; use the hashlib module > instead > import sha > /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/dev_appserver_login.py:33: > DeprecationWarning: the md5 module is deprecated; use hashlib instead > import md5 > [INFO] Logging to bulkloader-log-20100313.164108 > [INFO] Throttling transfers: > [INFO] Bandwidth: 25 bytes/second > [INFO] HTTP connections: 8/second > [INFO] Entities inserted/fetched/modified: 20/second > [INFO] Opening database: bulkloader-progress-20100313.164108.sql3 > [INFO] Connecting to bulkmove.latest.railsturbinetest.appspot.com/ > Traceback (most recent call last): > File "/usr/local/bin/bulkloader.py", line 68, in >run_file(__file__, globals()) > File "/usr/local/bin/bulkloader.py", line 64, in run_file >execfile(script_path, globals_) > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", > line 4031, in >sys.exit(main(sys.argv)) > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", > line 4027, in main >return _PerformBulkload(arg_dict) > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", > line 3880, in _PerformBulkload >return_code = app.Run() > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", > line 3170, in Run >kinds = self.RunPostAuthentication() > File > "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", > line 3278,
Re: [google-appengine] Can't access my old application.
If you used a "Google Apps for your domain" account you need to go to: https://appengine.google.com/a/ Robert On Mar 13, 2010, at 14:45, wizardwatson wrote: I just came back from not really messing with GAE for nearly a year, and an old app that I installed has become inaccessible from the control panel. I go to the control panel and it only offers to me the option to create a new application. Well where is my old one? Its still accessible by the appname.appspot.com but I have no dashboard for it. Am I just lost and don't know where the dashboard app is? Isn't this it? http://appengine.google.com/ Any help? I'd like to just delete the old one, or at least overwrite it, but I don't understand how the app is no longer associated with my account for some reason. Is there no support anywhere for technical issues like this? -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google- appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en . -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Clarification on how we can use our 10 sites
Oh, if they let you request more, then that's perfect. Thanks! On Mar 13, 2010, at 4:07 PM, Andy Freeman wrote: >> Thanks. That's weird that you can only have 10 apps per phone number. >> They should let you buy more if you need em! > > They've given people more than 10 upon demonstration of "need", and > the acceptable reasons have been pretty lame (IMHO). > > In other words, why not just ask as you expand? > > On Mar 13, 12:56 pm, Blake Caldwell wrote: >> Thanks. That's weird that you can only have 10 apps per phone number. >> They should let you buy more if you need em! >> >> --- >> Sent from my iPhone >> >> On Mar 13, 2010, at 3:49 PM, pythono wrote: >> >> >> >>> I'm not a google employee or anything, but I think the TOS specifies >>> that your apps can't "work together" in such a way to get around >>> quotas. For example you can't have a specific app that does all your >>> url-fetching for the rest of your apps. So, I think you're ok. >> >>> Also, it says you can sign up for one account per valid mobile phone >>> #, so as long as you have more than one you would probably be ok. >> >>> On Mar 13, 2:03 pm, Blake wrote: I know we can't shard our app into 10 small sites just to get around quotas, but what about creating different versions of our site for different languages, data providers, etc? >> I'm making an Amazon affiliate site, and will eventually create a version for Japan, Canada, Europe, etc. And, I'd like to take my engine, extract out Amazon.com from it, and plug in other affiliate networks. Each of these combinations will be a new App Engine site, even though they reuse 95% of my code, because it'd be way too complex to keep it together. >> Are these valid use cases for our 10 sites? >> And, if I need more than 10, is there any problem with my signing up for another account for another 10 sites? >> Thanks!! >> - Blake >> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "Google App Engine" group. >>> To post to this group, send email to google- >>> appeng...@googlegroups.com. >>> To unsubscribe from this group, send email to >>> google-appengine+unsubscr...@googlegroups.com >>> . >>> For more options, visit this group >>> athttp://groups.google.com/group/google-appengine?hl=en >>> .- Hide quoted text - >> >> - Show quoted text - > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appeng...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Clarification on how we can use our 10 sites
> Thanks. That's weird that you can only have 10 apps per phone number. > They should let you buy more if you need em! They've given people more than 10 upon demonstration of "need", and the acceptable reasons have been pretty lame (IMHO). In other words, why not just ask as you expand? On Mar 13, 12:56 pm, Blake Caldwell wrote: > Thanks. That's weird that you can only have 10 apps per phone number. > They should let you buy more if you need em! > > --- > Sent from my iPhone > > On Mar 13, 2010, at 3:49 PM, pythono wrote: > > > > > I'm not a google employee or anything, but I think the TOS specifies > > that your apps can't "work together" in such a way to get around > > quotas. For example you can't have a specific app that does all your > > url-fetching for the rest of your apps. So, I think you're ok. > > > Also, it says you can sign up for one account per valid mobile phone > > #, so as long as you have more than one you would probably be ok. > > > On Mar 13, 2:03 pm, Blake wrote: > >> I know we can't shard our app into 10 small sites just to get around > >> quotas, but what about creating different versions of our site for > >> different languages, data providers, etc? > > >> I'm making an Amazon affiliate site, and will eventually create a > >> version for Japan, Canada, Europe, etc. And, I'd like to take my > >> engine, extract out Amazon.com from it, and plug in other affiliate > >> networks. Each of these combinations will be a new App Engine site, > >> even though they reuse 95% of my code, because it'd be way too > >> complex > >> to keep it together. > > >> Are these valid use cases for our 10 sites? > > >> And, if I need more than 10, is there any problem with my signing up > >> for another account for another 10 sites? > > >> Thanks!! > > >> - Blake > > > -- > > You received this message because you are subscribed to the Google > > Groups "Google App Engine" group. > > To post to this group, send email to google- > > appeng...@googlegroups.com. > > To unsubscribe from this group, send email to > > google-appengine+unsubscr...@googlegroups.com > > . > > For more options, visit this group > > athttp://groups.google.com/group/google-appengine?hl=en > > .- Hide quoted text - > > - Show quoted text - -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Clarification on how we can use our 10 sites
Thanks. That's weird that you can only have 10 apps per phone number. They should let you buy more if you need em! --- Sent from my iPhone On Mar 13, 2010, at 3:49 PM, pythono wrote: > I'm not a google employee or anything, but I think the TOS specifies > that your apps can't "work together" in such a way to get around > quotas. For example you can't have a specific app that does all your > url-fetching for the rest of your apps. So, I think you're ok. > > Also, it says you can sign up for one account per valid mobile phone > #, so as long as you have more than one you would probably be ok. > > > > On Mar 13, 2:03 pm, Blake wrote: >> I know we can't shard our app into 10 small sites just to get around >> quotas, but what about creating different versions of our site for >> different languages, data providers, etc? >> >> I'm making an Amazon affiliate site, and will eventually create a >> version for Japan, Canada, Europe, etc. And, I'd like to take my >> engine, extract out Amazon.com from it, and plug in other affiliate >> networks. Each of these combinations will be a new App Engine site, >> even though they reuse 95% of my code, because it'd be way too >> complex >> to keep it together. >> >> Are these valid use cases for our 10 sites? >> >> And, if I need more than 10, is there any problem with my signing up >> for another account for another 10 sites? >> >> Thanks!! >> >> - Blake > > -- > You received this message because you are subscribed to the Google > Groups "Google App Engine" group. > To post to this group, send email to google- > appeng...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com > . > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en > . > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Clarification on how we can use our 10 sites
I'm not a google employee or anything, but I think the TOS specifies that your apps can't "work together" in such a way to get around quotas. For example you can't have a specific app that does all your url-fetching for the rest of your apps. So, I think you're ok. Also, it says you can sign up for one account per valid mobile phone #, so as long as you have more than one you would probably be ok. On Mar 13, 2:03 pm, Blake wrote: > I know we can't shard our app into 10 small sites just to get around > quotas, but what about creating different versions of our site for > different languages, data providers, etc? > > I'm making an Amazon affiliate site, and will eventually create a > version for Japan, Canada, Europe, etc. And, I'd like to take my > engine, extract out Amazon.com from it, and plug in other affiliate > networks. Each of these combinations will be a new App Engine site, > even though they reuse 95% of my code, because it'd be way too complex > to keep it together. > > Are these valid use cases for our 10 sites? > > And, if I need more than 10, is there any problem with my signing up > for another account for another 10 sites? > > Thanks!! > > - Blake -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: decision making
What do you mean "take decision"? Are you trying to decide whether a user is a student, faculty or admin? With the accounts api, you can only distinguish between admins and users with (python) users.is_current_user_admin(). For what you want, you would have to save each user in the datastore, and have a property that specifies the user type (faculty, student or admin). On Mar 13, 1:20 pm, Jeevan wrote: > hello all, > am developing app called cloud based teaching system. > Initially it accepts the google account user name and password for the > user. > I am thinking of provide 3 different level of authentication. > 1)Student > 2)Faculty > 3)Admin > > Admin can add faculty and remove faculty and can do all maintaince > stufss. > Faculty can add and remove students,blogs,docs,groups. > Student can only view blogs and docs. > Now is it possible to take decision based on their email id's. > > if yes then how to do it. > > am doing this as ma final year engineering project. > please support me. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Can't access my old application.
I just came back from not really messing with GAE for nearly a year, and an old app that I installed has become inaccessible from the control panel. I go to the control panel and it only offers to me the option to create a new application. Well where is my old one? Its still accessible by the appname.appspot.com but I have no dashboard for it. Am I just lost and don't know where the dashboard app is? Isn't this it? http://appengine.google.com/ Any help? I'd like to just delete the old one, or at least overwrite it, but I don't understand how the app is no longer associated with my account for some reason. Is there no support anywhere for technical issues like this? -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Datastore contention
Error rate on my app is way way too high for the past 16 hours. Getting tons of: "too much contention on these datastore entities. please try again". Appengine status page does show "Anamoly" for datastore. AppEngine team, please let know what's going on there. Any estimates on fix for this issue would help -Vivek Puri -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Clarification on how we can use our 10 sites
I know we can't shard our app into 10 small sites just to get around quotas, but what about creating different versions of our site for different languages, data providers, etc? I'm making an Amazon affiliate site, and will eventually create a version for Japan, Canada, Europe, etc. And, I'd like to take my engine, extract out Amazon.com from it, and plug in other affiliate networks. Each of these combinations will be a new App Engine site, even though they reuse 95% of my code, because it'd be way too complex to keep it together. Are these valid use cases for our 10 sites? And, if I need more than 10, is there any problem with my signing up for another account for another 10 sites? Thanks!! - Blake -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Invitation emails not sent durng the last days
Hey there, I may be having the same problem. People have tried to invite me, but I don't see the invites in my mailbox. On Mar 12, 10:59 am, dflorey wrote: > Hi, > I've experienced that invitation emails to invite developers to a App > Engine application is not working properly in the last days. > Only few invitation emails get sent, many get lost. It all worked fine > since ~4-5 days ago. > Anyone else? > > Daniel -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] decision making
hello all, am developing app called cloud based teaching system. Initially it accepts the google account user name and password for the user. I am thinking of provide 3 different level of authentication. 1)Student 2)Faculty 3)Admin Admin can add faculty and remove faculty and can do all maintaince stufss. Faculty can add and remove students,blogs,docs,groups. Student can only view blogs and docs. Now is it possible to take decision based on their email id's. if yes then how to do it. am doing this as ma final year engineering project. please support me. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Need help with a query...
Yuchh
Ignore this. That will teach me for posting whilst half asleep.
Complete rubbish
T
On Mar 13, 11:50 pm, Tim Hoffman wrote:
> Hi
>
> You could try this.
>
> Create a composite string field of all three values padded with 0's
> for the numerics so that they will sort alphabetically
>
> for instance a new field (composite_field) date + foo + bar
>
> where date 20100221 (MMDD)
> foo is 2
> bar is 00041
>
> So your field value will be
>
> 20100221200041
>
> Now you can use multiple inequality filters on the same field
>
> For instance
> assuming the date we want is > 01 jan 2010
> and we want foo > 0
> and bar < 42
>
> Query q = new Query("MyKind")
> .addFilter("composite_field", GREATER_THAN,
> '201001010') Which sorts the date > 01 Jan 2010 and foo >
> 1
> .addFilter("composite_field", LESS_THAN,
> '2010010142'); which gets you the less than 42
>
> It might work for you.
>
> Cheers
>
> T
>
> On Mar 13, 7:53 pm, Patrick Twohig wrote:
>
>
>
> > So, the business requirements of my application need a query which needs to
> > search for a property (let's call it "foo") and a date property such that it
> > will filter out all objects older than a certain date. I guess in GAE/J
> > this would be something like
>
> > Query q = new Query("MyKind")
> > .addFilter("foo", GREATER_THAN, 0)
> > .addFilter("bar", LESS_THAN, 42)
> > .addFilter("date", GREATER_THAN, someDate);
>
> > But, I'm guessing that wouldn't work because it's got inequality filters on
> > multiple properties. Would there be a way to get a similar result without
> > loading a huge amount of entities into memory and filtering them out
> > manually?
>
> > --
> > Patrick H. Twohig.
>
> > Namazu Studios
> > P.O. Box 34161
> > San Diego, CA 92163-4161
--
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Need help with a query...
Hi
You could try this.
Create a composite string field of all three values padded with 0's
for the numerics so that they will sort alphabetically
for instance a new field (composite_field) date + foo + bar
where date 20100221 (MMDD)
foo is 2
bar is 00041
So your field value will be
20100221200041
Now you can use multiple inequality filters on the same field
For instance
assuming the date we want is > 01 jan 2010
and we want foo > 0
and bar < 42
Query q = new Query("MyKind")
.addFilter("composite_field", GREATER_THAN,
'201001010') Which sorts the date > 01 Jan 2010 and foo >
1
.addFilter("composite_field", LESS_THAN,
'2010010142'); which gets you the less than 42
It might work for you.
Cheers
T
On Mar 13, 7:53 pm, Patrick Twohig wrote:
> So, the business requirements of my application need a query which needs to
> search for a property (let's call it "foo") and a date property such that it
> will filter out all objects older than a certain date. I guess in GAE/J
> this would be something like
>
> Query q = new Query("MyKind")
> .addFilter("foo", GREATER_THAN, 0)
> .addFilter("bar", LESS_THAN, 42)
> .addFilter("date", GREATER_THAN, someDate);
>
> But, I'm guessing that wouldn't work because it's got inequality filters on
> multiple properties. Would there be a way to get a similar result without
> loading a huge amount of entities into memory and filtering them out
> manually?
>
> --
> Patrick H. Twohig.
>
> Namazu Studios
> P.O. Box 34161
> San Diego, CA 92163-4161
--
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Weird issue when updating on windows
When updating my app in windows, either through the GoogleAppEngine GUI or the appcfg.py console command, I will end up getting errors when visiting my page because modules would be missing. When updating the exact same folder on my mac (the goole app engine project is within my dropbox), I everything seems to be uploaded so no weird errors about missing modules. Does anyone have any idea what could be wrong? -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Need help with a query...
So, the business requirements of my application need a query which needs to
search for a property (let's call it "foo") and a date property such that it
will filter out all objects older than a certain date. I guess in GAE/J
this would be something like
Query q = new Query("MyKind")
.addFilter("foo", GREATER_THAN, 0)
.addFilter("bar", LESS_THAN, 42)
.addFilter("date", GREATER_THAN, someDate);
But, I'm guessing that wouldn't work because it's got inequality filters on
multiple properties. Would there be a way to get a similar result without
loading a huge amount of entities into memory and filtering them out
manually?
--
Patrick H. Twohig.
Namazu Studios
P.O. Box 34161
San Diego, CA 92163-4161
--
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: GAE/J Performance (Slowness)
Scratch one cause off of the list. I found out that the client would always send each request without credentials, the server would kick back a 401 and then the client would resubmit with credentials every time! It was nuts, two requests for each useful request :( Since doing that the app has been performing much better. On Fri, Mar 12, 2010 at 11:55 PM, Tim Hoffman wrote: > Hi > > Have you checked that startup times on a lightly used system are not > inflating your response times ? > > T > > On Mar 13, 3:05 pm, Patrick Twohig wrote: > > Hi, > > > > I asked once before, but I'm getting some painfully slow requests in my > > app. Even on queries that I am certain only fetch a few entities, (5-10 > max > > under absolutely worst case circumstances). I also take advantage of > memory > > caching wherever possible, and I have confirmed (via logging) that I'm > > pulling from the cache. Some requests are taking upwards of 2-3 seconds. > > And given that my app right now is mostly a web service and not running > in a > > browser, there's quite a few things that are perplexing me. SO I have a > few > > questions: > > > >- I'm running JAX-RS (Jersey), a little Groovy, low level API (no JDO > or > >JPA), and Guice (yep, I'm a Google fanboy). I have identified where > Groovy > >is being slow, and came up with a workaround for that, so I'm not too > >concerned. > >- What's a reasonable number of entities I should fetch from the > >datastore per request? I currently fetch at least one per request to > >validate a user's login credentials, so no matter what I'm fetching at > least > >one per request. Adding up the numbers in my head, I don't think that > >- Even with aggressive caching, (all of my data objects get put in > >memcache), it still behaves rather slowly? What is the penalty > speed-wise > >for using a transaction? I can't use caching with a transaction > obviously > >because I can't be guaranteed any consistency of data. If I start a > >transaction and and commit it or roll it back and perform no > operations in > >it, what is the penalty? I'm certain this happens in my app, albeit > very > >infrequently. > >- What's up with queries? They just tend to be really really slow. > >- I know loading requests are a problem, but I'm not hitting many of > >those according to the logs, so I can rule those out as being a > contributing > >factor (unless there's something I don't know). I also don't use > JSPs, most > >of it is static. > >- How much of a performance difference does a bulk fetch/put cost > versus > >a bunch of individual ones? I haven't seen much of a difference, but > maybe > >I'm doing it wrong. > >- There are zero use cases in my application where more than two users > >write to the same entity group, except for a counter for which I use > >sharding offloaded to the task queue. Is there a penalty for many > users > >reading from a single entity group at the same time? > > > > Thanks, > > > > -- > > Patrick H. Twohig. > > > > Namazu Studios > > P.O. Box 34161 > > San Diego, CA 92163-4161 > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appeng...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com > . > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > -- Patrick H. Twohig. Namazu Studios P.O. Box 34161 San Diego, CA 92163-4161 -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Uploading with the bulkloader.py
Hi I am trying to download all of the datastore objects in my application with the bulkloader and then upload them into a different application. I use this command to download: bulkloader.py --dump --app_id=jsm277 --url=http://bulkmove.latest.jsm277.appspot.com/remote_api --filename=test_download_data and I get this output: /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py:64: DeprecationWarning: the sha module is deprecated; use the hashlib module instead import sha /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/dev_appserver_login.py:33: DeprecationWarning: the md5 module is deprecated; use hashlib instead import md5 [INFO] Logging to bulkloader-log-20100313.160710 [INFO] Throttling transfers: [INFO] Bandwidth: 25 bytes/second [INFO] HTTP connections: 8/second [INFO] Entities inserted/fetched/modified: 20/second [INFO] Opening database: bulkloader-progress-20100313.160710.sql3 [INFO] Opening database: bulkloader-results-20100313.160710.sql3 [INFO] Connecting to bulkmove.latest.jsm277.appspot.com/remote_api [INFO] Downloading kinds: [u'Blogs', u'Posts', u'Blog', u'Person', u'Post', u'_ah_SESSION'] ..[INFO] _ah_SESSION: No descending index on __key__, performing serial download [INFO] Have 21307 entities, 0 previously transferred [INFO] 21307 entities (7414423 bytes) transferred in 1063.4 seconds Then I use this command to upload to my new application: bulkloader.py --restore --url=http://bulkmove.latest.railsturbinetest.appspot.com/ --filename=test_download_data --app_id=railsturbinetest And this is the output that I am getting: Josh-Moores-MacBook:datadownload joshmoore$ bulkloader.py --restore --url=http://bulkmove.latest.railsturbinetest.appspot.com/ --filename=test_download_data --app_id=railsturbinetest ~/Documents/code/new_rails_turbine/ /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/remote_api/remote_api_stub.py:64: DeprecationWarning: the sha module is deprecated; use the hashlib module instead import sha /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/dev_appserver_login.py:33: DeprecationWarning: the md5 module is deprecated; use hashlib instead import md5 [INFO] Logging to bulkloader-log-20100313.164108 [INFO] Throttling transfers: [INFO] Bandwidth: 25 bytes/second [INFO] HTTP connections: 8/second [INFO] Entities inserted/fetched/modified: 20/second [INFO] Opening database: bulkloader-progress-20100313.164108.sql3 [INFO] Connecting to bulkmove.latest.railsturbinetest.appspot.com/ Traceback (most recent call last): File "/usr/local/bin/bulkloader.py", line 68, in run_file(__file__, globals()) File "/usr/local/bin/bulkloader.py", line 64, in run_file execfile(script_path, globals_) File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 4031, in sys.exit(main(sys.argv)) File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 4027, in main return _PerformBulkload(arg_dict) File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 3880, in _PerformBulkload return_code = app.Run() File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 3170, in Run kinds = self.RunPostAuthentication() File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 3278, in RunPostAuthentication self.request_manager.IncrementId(list(ancestor_path), kind, high_id) File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 1215, in IncrementId start, end = datastore.AllocateIds(model_key, 1) File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Conten
