[google-appengine] a query log?
I'm somewhat new to App Engine, and attempting to streamline my app's datastore load. With a LAMP app, I'm usually able to access or generate a database query log to assist in this process -- a list of all queries run on the database for a given http request, along with how long each took and other helpful metadata. Is there a good way to access or create something similar for App Engine queries? The closest I've found is Appstats -- but while Appstats will provide information sorted by http-request, I haven't found a way to make it display a database query log. Any help would be appreciated. Thanks, =Tim= -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: a query log?
Thanks for the suggestion. I've already been keeping a close watch on my app's indexes file, and was hoping for something that would reveal more detail. It's true that a verbose query log isn't as important on GAE as it is on a relational db. Still, I bet it would be real useful for finding redundant or repeated queries, or just for getting a better understanding of how GAE works under the hood. Maybe I'll try to hack one together... =T= On Oct 6, 2010, at 11:12 PM, Grant wrote: > Hi > > I do not think there is a query log, but you can use the fact that the > datastore only every queries an index to simulate one... > > http://code.google.com/appengine/docs/python/datastore/queriesandindexes.html > > There is an implicit index on all (actually most) properties on any > entity and those indexes are used when you query a single property on > an entity e.g. [FROM person WHERE age = 18] > > To do a more complex query e.g. [FROM person WHERE country_code = 'ZA' > AND age > 18] you need an explicit index for that query. > > These explicit indexes are automatically generated when you make a > request on the local dev server... > http://code.google.com/appengine/docs/python/config/indexconfig.html#Automatic_and_Manual_Indexes > (python) > http://code.google.com/appengine/docs/java/config/indexconfig.html#Using_Automatic_Index_Configuration > (java) > > If you clear out your indexes file on a dev machine and then hit the > URL you are interested in it will automatically generate any indexes > required for that request. The contents of the index file would then > act as a rudimentary query log especially when taken next to your > Appstats from your production instance. > > Grant > > > > > > > > On Oct 7, 12:22 am, Tim Jones wrote: >> I'm somewhat new to App Engine, and attempting to streamline my app's >> datastore load. >> >> With a LAMP app, I'm usually able to access or generate a database query log >> to assist in this process -- a list of all queries run on the database for a >> given http request, along with how long each took and other helpful metadata. >> >> Is there a good way to access or create something similar for App Engine >> queries? The closest I've found is Appstats -- but while Appstats will >> provide information sorted by http-request, I haven't found a way to make it >> display a database query log. >> >> Any help would be appreciated. Thanks, >> >> =Tim= > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appeng...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Google Apps / Domain verification
I'm trying to setup a new domain name for my GAE app by adding a domain alias to my Google Apps account. I've verified the new domain through a CNAME, but now Google Apps is asking me to setup email for the domain by changing MX records. I don't want to setup email for this domain, I just want to host my GAE app on it. Any ideas on how I can add this domain to Google Apps without dealing with MX records? When I setup my GA account's primary domain, the CNAME was sufficient. I'm not sure why adding a Domain Alias seems to require this extra step. =T= -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Google Apps / Domain verification
Then I'm not sure what I need to do to setup this domain name. When I try to add my new domain to my GAE app, it says "Sorry, you've reached a login page for a domain that isn't using Google Apps." And when I go to my Google Apps "Domain Settings" page, the status of my new domain just says "MX records setup validation in progress... " Any suggestions on what my next step should be? =T= On Oct 12, 2010, at 3:10 PM, Robert Kluin wrote: > You do not need to enable gmail on your domain or setup the MX records. > > > > Robert > > > > > > On Tue, Oct 12, 2010 at 17:20, Tim Jones wrote: >> I'm trying to setup a new domain name for my GAE app by adding a domain >> alias to my Google Apps account. I've verified the new domain through a >> CNAME, but now Google Apps is asking me to setup email for the domain by >> changing MX records. >> >> I don't want to setup email for this domain, I just want to host my GAE app >> on it. Any ideas on how I can add this domain to Google Apps without dealing >> with MX records? >> >> When I setup my GA account's primary domain, the CNAME was sufficient. I'm >> not sure why adding a Domain Alias seems to require this extra step. >> >> =T= >> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To post to this group, send email to google-appeng...@googlegroups.com. >> To unsubscribe from this group, send email to >> google-appengine+unsubscr...@googlegroups.com. >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> >> > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appeng...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] app update problem?
My "appcfg.py update" commands are hanging, with a loop of "Checking if new version is ready to serve. / Will check again in 60 seconds." I'm not sure if anyone else is seeing this problem, or if it's related to the blobstore problem others have reported, or if it's just something specific to me. =Tim= -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] building index.yaml
Any thoughts or recommendations for efficiently creating complex index.yaml files? My app has a search page that uses six different filter criteria. I'd like to make sure GAE is indexing all possible permutations. I've thought of only three ways to do this: 1. Using the dev server, manually run all possible search permutations, so that all the necessary indexes are auto-generated. 2. Manually write the index parameters into index.yaml 3. Write some kind of program to auto-generate the index.yaml parameters based on the search parameters. #1 and #2 are prohibitively tedious. Has anyone tried #3? Does anyone have other suggestions? It seems like a problem others must run into relatively often. =T= ------ Tim Jones Activism & Technology Manager Electronic Frontier Foundation -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] building index.yaml
Ah, that sounds like a good solution. Thanks. =T= On Oct 20, 2010, at 12:32 PM, Robert Kluin wrote: > Hey Tim, > It is probably not very elegant, but I guess I have used a > combination of 1 and 3. I put together scripts to request all > combinations of the fields and let the SDK generate the indexes it > wants. I have done this using windmill (like selenium) script to fill > in and submit forms, which we do during test anyway. And, I have also > done it with a script used for testing queries. > > > Robert > > > > > > > > > On Wed, Oct 20, 2010 at 14:26, Tim Jones wrote: >> Any thoughts or recommendations for efficiently creating complex index.yaml >> files? >> >> My app has a search page that uses six different filter criteria. I'd like >> to make sure GAE is indexing all possible permutations. I've thought of only >> three ways to do this: >> >> 1. Using the dev server, manually run all possible search permutations, so >> that all the necessary indexes are auto-generated. >> >> 2. Manually write the index parameters into index.yaml >> >> 3. Write some kind of program to auto-generate the index.yaml parameters >> based on the search parameters. >> >> #1 and #2 are prohibitively tedious. Has anyone tried #3? Does anyone have >> other suggestions? It seems like a problem others must run into relatively >> often. >> >> =T= >> >> >> >> -- >> Tim Jones >> Activism & Technology Manager >> Electronic Frontier Foundation >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To post to this group, send email to google-appeng...@googlegroups.com. >> To unsubscribe from this group, send email to >> google-appengine+unsubscr...@googlegroups.com. >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> >> > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appeng...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] "The server encountered an error" ?
For a while earlier this evening, every page of my app was producing 500 errors with this message: > Error: Server Error > The server encountered an error and could not complete your request. > If the problem persists, please report your problem and mention this error > message and the query that caused it. I can't figure out why this would have suddenly happened and then suddenly stopped. Also, I see no record of these errors in my App Engine logs. Can anyone explain or guess what happened? =Tim Jones= -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] "The server encountered an error" ?
A correction to my original email: The errors do appear in my logs. They all say: > : cannot import name signals The exact traceback depends on the exact URL, but they all end at /base/python_runtime/python_lib/versions/third_party/django-1.1/django/db/models/query.py This doesn't really make things any clearer for me, but perhaps someone else will find it revelatory. =Tim Jones= On Oct 27, 2010, at 7:15 PM, Tim Jones wrote: > For a while earlier this evening, every page of my app was producing 500 > errors with this message: > >> Error: Server Error >> The server encountered an error and could not complete your request. >> If the problem persists, please report your problem and mention this error >> message and the query that caused it. > > I can't figure out why this would have suddenly happened and then suddenly > stopped. Also, I see no record of these errors in my App Engine logs. > > Can anyone explain or guess what happened? > > =Tim Jones= > > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appeng...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: "The server encountered an error" ?
+1, it is appreciated. =T= On Oct 27, 2010, at 8:53 PM, supercobra wrote: > Awesome. > -- > superco...@gmail.com > > > > On Wed, Oct 27, 2010 at 10:24 PM, Raymond C. wrote: >> Thanks GAE team for the quick action~ >> >> On Oct 28, 11:12 am, Sundar wrote: >>> And now it's all ok. It's amazing how well it works when it does, and how I >>> have crazy anxiety when things go wonky on GAE :) >>> >>> >>> >>> On Wed, Oct 27, 2010 at 11:04 PM, Sundar wrote: Would a state of "elevated" for datastor or task queues affect deployments? I'm unable to deploy my app. >>> On Wed, Oct 27, 2010 at 11:02 PM, blackpawn wrote: >>> > yep me too. system status says there is an Anomaly with the Datastore > that is being investigated. :O >>> > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appeng...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com e...@googlegroups.com> > . > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To post to this group, send email to google-appeng...@googlegroups.com. >> To unsubscribe from this group, send email to >> google-appengine+unsubscr...@googlegroups.com. >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> >> > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appeng...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Six deadline exceeded errors this morning
I'm also seeing a large number of deadline-exceeded errors today. My application is focused on election day (id is 'electionawareness') so this is especially problematic right now. I'm not sure if the problem is in my code or larger server issues. =T= On Nov 2, 2010, at 4:15 AM, Kenneth wrote: > And more deadline errors. What's going on? > > 11-02 04:02AM 47.382 > 11-02 03:44AM 45.758 > 11-02 03:27AM 56.115 > 11-02 03:24AM 09.423 > 11-02 03:24AM 05.896 > 11-02 03:23AM 54.113 > 11-02 03:22AM 35.044 > 11-02 03:21AM 33.330 > 11-02 03:16AM 14.863 > 11-02 03:14AM 11.689 > 11-02 03:14AM 11.509 > 11-02 03:13AM 08.019 > 11-02 03:06AM 13.217 > 11-02 03:06AM 11.927 > 11-02 02:58AM 46.345 > 11-02 02:58AM 15.460 > 11-02 02:48AM 04.067 > 11-02 02:47AM 21.838 > 11-02 02:47AM 30.377 (startup error) > 11-02 02:47AM 30.353 (startup error) > 11-02 02:47AM 30.055 (startup error) > 11-02 02:47AM 23.169 (startup error) > > On Nov 2, 9:40 am, Kenneth wrote: >> We had been down to about one or two a day but had a rash of them this >> morning at: >> >> 11-02 02:24AM 09.007 >> 11-02 02:20AM 54.125 >> 11-02 02:15AM 16.184 >> 11-02 02:12AM 53.254 >> 11-02 02:06AM 08.091 >> 11-02 01:28AM 50.022 >> >> Plus the usual instance startup error at >> >> 11-02 01:28AM 56.901 >> >> AppID is Ala ddinSch ools >> >> Thanks. > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appeng...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Six deadline exceeded errors this morning
These problems are continuing for me. Is anyone else experiencing this? =T= On Nov 2, 2010, at 7:25 AM, Tim Jones wrote: > I'm also seeing a large number of deadline-exceeded errors today. > > My application is focused on election day (id is 'electionawareness') so this > is especially problematic right now. I'm not sure if the problem is in my > code or larger server issues. > > =T= > > > > On Nov 2, 2010, at 4:15 AM, Kenneth wrote: > >> And more deadline errors. What's going on? >> >> 11-02 04:02AM 47.382 >> 11-02 03:44AM 45.758 >> 11-02 03:27AM 56.115 >> 11-02 03:24AM 09.423 >> 11-02 03:24AM 05.896 >> 11-02 03:23AM 54.113 >> 11-02 03:22AM 35.044 >> 11-02 03:21AM 33.330 >> 11-02 03:16AM 14.863 >> 11-02 03:14AM 11.689 >> 11-02 03:14AM 11.509 >> 11-02 03:13AM 08.019 >> 11-02 03:06AM 13.217 >> 11-02 03:06AM 11.927 >> 11-02 02:58AM 46.345 >> 11-02 02:58AM 15.460 >> 11-02 02:48AM 04.067 >> 11-02 02:47AM 21.838 >> 11-02 02:47AM 30.377 (startup error) >> 11-02 02:47AM 30.353 (startup error) >> 11-02 02:47AM 30.055 (startup error) >> 11-02 02:47AM 23.169 (startup error) >> >> On Nov 2, 9:40 am, Kenneth wrote: >>> We had been down to about one or two a day but had a rash of them this >>> morning at: >>> >>> 11-02 02:24AM 09.007 >>> 11-02 02:20AM 54.125 >>> 11-02 02:15AM 16.184 >>> 11-02 02:12AM 53.254 >>> 11-02 02:06AM 08.091 >>> 11-02 01:28AM 50.022 >>> >>> Plus the usual instance startup error at >>> >>> 11-02 01:28AM 56.901 >>> >>> AppID is Ala ddinSch ools >>> >>> Thanks. >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To post to this group, send email to google-appeng...@googlegroups.com. >> To unsubscribe from this group, send email to >> google-appengine+unsubscr...@googlegroups.com. >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appeng...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] search ListProperty for empty list?
Is there a way, using a single Query.filter() call or GQL operator, to search for all entities for which a particular ListProperty is empty? So for instance, say I have a type called Book and a type called Genre. These Books can have multiple genres, so my Book type has a ListProperty(db.key) which contains a list of keys for Genres. Can I easily run a query which returns a list of Books with no Genre? It seems likely to me that this is impossible, but I thought I'd ask. Thanks! =T= -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] search ListProperty for empty list?
Ok, that is what I suspected. Thanks again, =T= On Nov 4, 2010, at 3:01 PM, Ikai Lan (Google) wrote: > Nope. The values in the list themselves are indexed, not the list. You may > want to create a new property for empty lists if you need to do this. > > -- > Ikai Lan > Developer Programs Engineer, Google App Engine > Blogger: http://googleappengine.blogspot.com > Reddit: http://www.reddit.com/r/appengine > Twitter: http://twitter.com/app_engine > > > > On Thu, Nov 4, 2010 at 2:51 PM, Tim Jones wrote: > Is there a way, using a single Query.filter() call or GQL operator, to search > for all entities for which a particular ListProperty is empty? > > So for instance, say I have a type called Book and a type called Genre. These > Books can have multiple genres, so my Book type has a ListProperty(db.key) > which contains a list of keys for Genres. Can I easily run a query which > returns a list of Books with no Genre? > > It seems likely to me that this is impossible, but I thought I'd ask. > > Thanks! > > =T= > > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appeng...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appeng...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
