[google-appengine] Re: Timeout error
Hi adhi, Could you tell me the app ID for this application? When you mention timeout errors, are these datastore timeouts or are they overall deadline exceeded exceptions? It could be that fetching 1300 records in one request does take longer than the allowed time for a datastore operation. Thank you, Jeff On Nov 5, 3:28 am, Adhi adhi.ramanat...@orangescape.com wrote: Hi, We are running into timeout problem very frequently where as the same request is working fine during the consecutive attempts and its taking 4-5 seconds. The request involves only fetching the data from gfs using query. normally we fetch around 100-1000 in every request. any inputs for this abnormal behavior? this is the biggest request as of now, in terms of fetching data (1300 records)http://dev.orangescape.com/bulkexporter/export/primary?SheetMetadataI... Its working normally for some time and some times even the smaller requests are fails. Note:- We are splitting the request into multiple request and hitting the server concurrently, the above url is one of the split. adhi --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Cookie Bug at appspot.com
Hi gaenoob, I think we need to know a bit more about the cookie before we can be sure whether this is a bug or not. How is the cookie being set? If the expiration is set for far in the future, I would expect the cookie to remain in use when a user returns to your app with the same browser on the same machine. Was this a session tracking cookie? Thank you, Jef On Nov 5, 7:45 am, gaenoob spellw...@gmail.com wrote: My application do multiple calls to a remote site at single user request. The application work well if tested locally. but failed if deployed to gae. I traced the diff. In the test server (localhost), the cookie value change if new URLConnection (request and response) is made. But, in the gae server (appspot.com), the cookie won't change at all. I think it is a bug. Can someone fix it there? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Optimizing, what's normal?
Hi Sander, The numbers that you report seem plausible and it sounds like you've already taken some good steps to optimize. The api_cpu does include the cost of updating the entity data and indexes in the datastore. The CPU numbers are sometimes higher than people would initially expect because datastore writes touch more than one machine as all puts are replicated, so some of the cost comes from multiple machines working in parallel. One way that you could reduce the CPU used when writing to the datastore is to remove any indexes which you do not need. For example, if you will never query for entities by a given int property or string property then you could mark it as an unindexed property. This should make your puts cheaper. If you feel like sharing more info on the data models you are using we might be able to give more specific advice. Happy coding, Jeff On Nov 5, 8:46 am, Sander Rijken s...@d-90.nl wrote: In the app I'm building I have the need to log something at a certain pageview. I'm currently seeing about 15-20k requests per day here. It's essential (to keep under free quota) to minimize the CPU used here. Currently I'm hitting 35-40 megacycles and about 600-650msec api_cpu per page view. I have a feeling that this is quite high, because all I'm doing is reading get parameters from the request and storing these in a few entities in the same entity group. I'm already using a single transaction and also a single .put call. Can someone point out what's a normal amount of megacycles, and cpu msec? Also what does api_cpu mean? Does it include datastore acces for instance? What can I do to monitor the api_cpu counter during the request? Thanks, Sander Rijken --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: User from a user's ID
Hi David, From looking through the code for the users API, it looks like you may need the email to construct a User object from scratch: http://code.google.com/p/googleappengine/source/browse/trunk/python/google/appengine/api/users.py If the email address is None, the API attempts to determine the email address by looking for a signed in user and it will only examine the _user_id that you pass in after it looks at email. If you don't care whether or not the email address is correct, you should be able to set it to a fake value (like 'a'). If you could tell us a bit more about how you'd like to use this we might be able to give more specific advice ;-) Thank you, Jeff On Nov 6, 6:32 pm, wings david.mira...@gmail.com wrote: Is there a good way to get a User object if you have their user ID? Thanks ! --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Indexes building stuck on empty datastore
Hi Tonny, Yes this limit is for the custom composite indexes which are defined in index.yaml. Also if you really do need more than 100, it is possible to enable an app to use more than 100 indexes but we handle these requests on a case by case basis. Since more indexes could make a write request more expensive we do want to make sure that the design is reasonable before allowing more. Thank you, Jeff On Nov 9, 1:19 am, Tonny mezz...@gmail.com wrote: this limit of 100 indexes, i hope that's for composite indexes? or I'll eventually will get in trouble... On 7 Nov., 03:38, Jeff S (Google) j...@google.com wrote: Ah I see. Since the upper limit was reached for the number of indexes on the index upload, none of them completed building so I've moved all of these indexes into the error state. Since you mentioned that the final version will use fewer indexes, I think it might be a good idea to reduce the number of indexes early in development. If you had planned on using more than 100 in the final version then I would consider raising this limit for your app but since you plan on ultimately using fewer I think it would just be more trouble than it is worth :-) Happy coding, Jeff On Fri, Nov 6, 2009 at 3:13 PM, riklaunim riklau...@gmail.com wrote: Yes, there may be more than 100 right now, but I'll probably limit the number of indexes before using this in final version. On 6 Lis, 18:46, Jeff S (Google) j...@google.com wrote: Hello, How many indexes did you upload? There is a default maximum of 100 indexes, so if it was more than that you'll either need to remove some or I can look into allowing this app to have more than the default number of indexes. Thank you, Jeff On Fri, Nov 6, 2009 at 6:47 AM, riklaunim riklau...@gmail.com wrote: I've created app softwarecompl as a production copy of a devel app that runs on another account. The files got deployed, but the indexes got stuck - still building (and there is no data in datastore). Can you error them out if they are broken? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Deleting indexes in my application.
Hi Prawyn, I'm wondering if this app is getting close to the default limit of 100 indexes. How many indexes does it have and does this app need a higher limit? Thank you, Jeff On Wed, Nov 4, 2009 at 11:42 PM, Prawyn prawyn.mo...@gmail.com wrote: Hi, There are lot of indexes that are in building state for more than an hour now. Can you please mark that indexes as error so that I can vacuum that indexes.. My app id is : prawyn-test Thanks, Prawyn --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Datastore writes are temporarily unavailable
Hi all, Apologies for the delay, the status site has been updated to mention this planned maintenance. Thank you, Jeff P.S. As noted in the following blog post, we also plan maintenance on December 1st. http://googleappengine.blogspot.com/2009/09/migration-to-better-datastore.html On Nov 3, 5:42 pm, AS stripe...@gmail.com wrote: Yes. No fix still, and no good status On Nov 3, 8:31 pm, RollingCircle e.j.hard...@gmail.com wrote: Datastore writes are temporarily unavailable. Please seehttp://code.google.com/status/appengineformore information. 11-03 05:21PM 32.889 , application metutil. Hordes of the blighters. The status page was apparently repeating some mantra about everything being OK, despite everything being clearly Pete Tong on the App Engine datastore front. Anyone else? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: DateTimeProperty question
Hello Michał,
The feed_query.updated_min is expected to be a string corresponding to
the desired time but it cannot be a datetime object. The time string
should be in RFC 3339 timestamp format. For example:
'2005-08-09T10:57:00-08:00'. You can use time.strftime to convert a
datetime to a formatted string, there should be some good examples out
there on the Internet.
Thank you,
Jeff
On Oct 28, 9:29 am, Michał Klich klich.mic...@gmail.com wrote:
Hi,
I have model
class info(db.Model):
user = db.UserProperty()
last_update_date = db.DateTimeProperty()
I need to retrieve last_update_date for specific user. It is working good, i
can retrieve this value, i can even pass it to another variable
if results:
for result in results:
data = result.last_update_date
Problem lies when i try to assign it to
feed_uri = contacts.GetFeedUri()
feed_query = gdata.contacts.service.ContactsQuery(feed_uri)
*feed_query.updated_min = data*
Error message i receive is
Traceback (most recent call last):
File C:\Program Files
(x86)\Google\google_appengine\google\appengine\ext\webapp\__init__.py,
line 507, in __call__
handler.get(*groups)
File
C:\Users\mklich\workspace\google_contacts_webapp\src\contacts-list.py,
line 266, in get
listc = checkUserPrivateContacts(user)
File
C:\Users\mklich\workspace\google_contacts_webapp\src\contacts-list.py,
line 189, in checkUserPrivateContacts
feed = contacts.GetContactsFeed(feed_query.ToUri())
File
C:\Users\mklich\workspace\google_contacts_webapp\src\gdata\service.py,
line 1718, in ToUri
return atom.service.BuildUri(q_feed, self)
File C:\Users\mklich\workspace\google_contacts_webapp\src\atom\service.py,
line 584, in BuildUri
parameter_list = DictionaryToParamList(url_params, escape_params)
File C:\Users\mklich\workspace\google_contacts_webapp\src\atom\service.py,
line 551, in DictionaryToParamList
for param, value in (url_parameters or {}).items()]
File C:\Python25\lib\urllib.py, line 1210, in quote_plus
if ' ' in s:
TypeError: argument of type 'datetime.datetime' is not iterable
Am i doing something wrong or is it a bug?
Thank you for responses.
--
Michał Klich
klich.mic...@gmail.com
mic...@michalklich.comhttp://www.michalklich.com
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---
[google-appengine] Re: DownloadError: ApplicationError: 5 - Urgent
Hello Jairo, DownloadError 5 usually means that the remote server did not respond withing the URLfetch time limit. The default time limit is 5 seconds (the max is currently 10 seconds), so if the server you are posting to from within App Engine takes too long this exception will be raised. What is the URL that you were posting to? Happy coding, Jeff On Oct 29, 8:25 am, Jairo Vasquez Moreno jairo.vasq...@gmail.com wrote: Hi all, In last few I've seen an important increment of this error: DownloadError: ApplicationError: 5 .. . File /base/python_lib/versions/1/google/appengine/api/urlfetch.py, line 241, in fetch return rpc.get_result() File /base/python_lib/versions/1/google/appengine/api/apiproxy_stub_map.py, line 478, in get_result return self.__get_result_hook(self) File /base/python_lib/versions/1/google/appengine/api/urlfetch.py, line 331, in _get_fetch_result raise DownloadError(str(err)) DownloadError: ApplicationError: 5 That happens when I make post requests, is there any problem with the urlfetch api, please I need to know this Thanks in advance -- Jairo Vasquez Moreno Mentez Developerwww.mentez.com Medellin - Colombia --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: indexed=False
Hi vanya, Any changes made to your data model classes will only affect entities which have been put since your change, so in this case changing this property to be unindexed has no effect on the existing indexes but will prevent index rows from being added for new entities. To clean up the indexes you may need to get and re-put entities now that you've changed the model. Thank you, Jeff On Tue, Oct 27, 2009 at 6:57 AM, vanya vanya@gmail.com wrote: Is parameter 'indexed=false' applying to existing entities or it only suits for new entities? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: 500 error on updating indexes
Hi Travis, The index count for your application is now reported as zero, so you should be able to reupload. In the last release we made some changes in our index count quota tracking which should remove the need for us to reset index count quotas after a large number of quotas are deleted. Please keep us posted. Thank you, Jeff On Mon, Oct 26, 2009 at 1:58 PM, Travis siva...@gmail.com wrote: Ok, so I've now deleted all my indexes and it's still giving me that 400 error when I try to reupload them. I'm guessing that it still thinks I have 75+ indexes, so I probably need my index count reset again. Any help I could get with this would be great. Note: I am trying to upload 76 indexes, which should be below the old 100 index limit. Has the limit been changed? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Google App No Longer Loads And Nothing Was Changed
Hi Erik, My first guess is that this would be a configuration issue. Perhaps caching prevented the change from breaking change from being immediately apparent. Could we see your app.yaml/web.xml file? Thank you, Jeff On Thu, Oct 22, 2009 at 6:57 PM, Erik Vold erikvv...@gmail.com wrote: static.evold.ca (aka evold-static.appspot.com) used to display a simple html page, and nothing has been changed in the last 2 days, but this no longer works?? what could be wrong?? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Unable to create application
I'm not sure if this is the issue, but if your account is a Google Apps account then you will need to visit the App Engine dashboard which is for your Google Apps domain. You can find it at http://appengine.google.com/a/example.com or in your case I'm guessing this would be http://appengine.google.com/a/flat2software.com Thank you, Jeff On Sat, Oct 24, 2009 at 9:31 PM, Prashant antsh...@gmail.com wrote: Of course, most of the identifiers are already reserved by other users and also because appengine doesn't allow you to create identifier which is same as some other user's Google account id, so you must try some identifier which is unique to both, i.e. google account ids and appengine app ids. HINT : try putting one or more dashes (-) in your identifier like try * my-great-app* instead of *mygreatapp* or you can always create an app identifier same as your google account id. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: orphaned app - no access - seriously
Hi Bassil, What is the app ID for this app? Also, could you send me the email address of the old admin account which was deleted, and a new account that you would like to have as an admin? Feel free to email this to me directly. Thank you, Jeff On Fri, Oct 23, 2009 at 11:48 AM, Bassil Karam b...@thinkloop.com wrote: Can anyone from Google un-orphan my account? On Mon, Oct 19, 2009 at 11:22 AM, Bassil Karam b...@thinkloop.com wrote: That's interesting, I wonder what the proper solution to stuff like this is. For example, what should Google do if someone decided to delete an account that is associated with a service like App Engine? Should they: Disallow the deletion of an account until it is completely dis-associated with any Google services? Would be good, but it also seems like it would be technically challenging because the services seem to be very separate from each other, with their own sub-systems and ways of managing accounts. Delete all services associated with the account? This will just cause lots of anger as entire web presences are wiped out because someone accidentally deleted the wrong account. Automatically re-associate orphaned services with functional admin accounts? Seems good, but what if its not an apps account? What if there isn;t another obvious account to associate it with? What happens if it's not an apps account but a lone regular google account? Its a complex issue but the current hodge-podge patch-work solution of disallowing people from easily adding / deleting / editing / merging accounts, except in some cases, but not others - as well as, not being able to *ever* retrieve previously used accounts - or the bifurcation of Apps accounts and standard google accounts - is seriously not working. A huge, top-down re-factoring of all the systems is needed to fix all these issues. I hope it is in the works. Baz On Mon, Oct 19, 2009 at 11:02 AM, johnP j...@thinkwave.com wrote: Don't have a solution - but had a similar experience. I used my appengine credentials as the admin login to a newly created Apps account. As soon as I did this, I was unable to login to Appengine (got an error - you will are being redirected in a way that will never complete). So when I deleted the user from the Apps account - I was able to re-access my Appengine account. I think that's the opposite of what happened to you... So I don't know what to suggest in your case. johnP On Oct 19, 10:26 am, Bassil Karam b...@thinkloop.com wrote: We have an Apps account in which we created the user ad...@mydomain.com. We then used that account to create an App Engine application. A little while later, we deleted ad...@mydomain.com and replaced it with a couple of user-sepcific administrator accounts like b...@mydomain.com and s...@mydomain.com (both admins). The problem is now we can't seem to access our App Engine application - I am assuming because it is related to the now non-existent ad...@mydomain.com account. We tried to re-create ad...@mydomain.com, but Apps doesn't let you re-create recently deleted accounts. So as it stands, I believe my App Engine account is orphaned, without any possibility for access. Anyone know of a solution tot his? Thanks. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Newbie question about Task Queue
Hi fabrizio, From your description (running once ever 10 minutes) it sounds like scheduled tasks would be the simplest solution. Another slightly crazy idea that might work is to have the task return a non 200 code. When a task fails it is not removed from the queue, but there may be execution scheduling backoff behavior with this approach which would be undesirable. Happy coding, Jeff On Thu, Oct 22, 2009 at 7:02 AM, fhtino fht...@gmail.com wrote: Hello, I was testing Task Queue. It works fine. :) I'd like to repeat a task many time during the day, example 1 run every 10 minutes. But when the task is executed, it's deleted from the Queue. How can I run again the task? Should I use Scheduled Tasks (cron.xml) ? I've also tryed to enque a new task instance at the end of the execution of the task. But I don't like it. If it crashes for some reason, it does not enqueue a new instance. fabrizio --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Datastore: batch delete taking a long time
Hi Jarrod, Was the 2000ms you reported CPU time or wall clock time? There can sometimes be additional latency triggered by bulk deletes. It is possible that since these deletes are grouped by key that the writes for most of these deletes may go to the same Bigtable tablet. Most datastore operations can be executed in parallel because the data and indexes are spread out across multiple tablets. It might also be the case that tablets are being merged because they are shrinking in size which improves long term performance but has some time cost due to data being moved. Were you deleting all of the data in the app? Thank you, Jeff On Wed, Oct 21, 2009 at 6:47 AM, Jarrod jarrod.sincl...@gmail.com wrote: For a batch delete of about 10-20 entities (with about 5 properties, most unindexed), I'm seeing very slow API call times. Even around 2000ms. The logs indicate this as a potential quota warning. I'm running the delete in one batch call, from a key only query of about 10-20 entities. Is this API response time to be expected? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Datastore statistics not available
Hi Tim, Ah I see, would you mind telling me your app ID? I'd like to look into this to make sure there isn't some other reason. Thank you, Jeff On Thu, Oct 22, 2009 at 4:07 PM, Tim Hoffman zutes...@gmail.com wrote: HI Jeff I am in the same boat, only a few thousand entities, but about 30 models and a few are very big (lots of properties) and I haven't got any statistics yet. (The app has been deployed for 3 days) I assume I blowing out your 100KB limit. T On Oct 22, 4:32 am, Jeff S (Google) j...@google.com wrote: Hi nasim, I'm wondering if the issue is that the datastore stats for this app would require more space than is currently supported (100KB) http://code.google.com/appengine/kb/adminconsole.html#datastore_stats We're currently investigating this issue and we might be raising the stats size limit or making some other changes. Apologies for the inconvenience. Thank you, Jeff On Tue, Oct 20, 2009 at 7:19 AM, nasim nasim.ha...@gmail.com wrote: It's been a while that datastore statistics has been introduced. All my apps have this admin view except one. The app id is dhadharu. Could it be enabled, please? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Datastore statistics not available
Hi nasim, I'm wondering if the issue is that the datastore stats for this app would require more space than is currently supported (100KB) http://code.google.com/appengine/kb/adminconsole.html#datastore_stats We're currently investigating this issue and we might be raising the stats size limit or making some other changes. Apologies for the inconvenience. Thank you, Jeff On Tue, Oct 20, 2009 at 7:19 AM, nasim nasim.ha...@gmail.com wrote: It's been a while that datastore statistics has been introduced. All my apps have this admin view except one. The app id is dhadharu. Could it be enabled, please? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Datastore timeouts
Hi Michael, One possible cause could be that a Bigtable tablet which is used by your app was in the process of being split, which can cause a short burst of timeouts but ensure better performance going forward. Were these timeouts on just writes or also reads? Thank you, Jeff On Tue, Oct 20, 2009 at 12:55 PM, Michael m...@mzlab.net wrote: Last several minutes my app experiences a lot of datastore timeouts What can be the problem? App id is: sovpad --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Needs Index Error
Hi Andrew, It looks like you've updated your question on StackOverflow and it sounds like you figured it out. Please let me know if this is still an issue. Happy coding, Jeff On Sat, Oct 17, 2009 at 9:44 PM, andrewljohnson andrewljohn...@gmail.comwrote: Hello, I'm having trouble with an index. I described the problem on Stack Overflow, so I guess I'll just link that post here: http://stackoverflow.com/questions/1584026/google-app-engine-needs-index-error Do I need to just wait, or should I be debugging something? Thanks for your help! Regards, Andrew --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Stored data statistics
Hi Prashant, The storage space numbers reported on the dashboard are recalculated at least once a day, so you should see the deleted space freed up within 24 hours. For some operations, notably some forms of deletion, we do not currently adjust the stoage estimates in real time, but we periodically perform exact calculations (just to resolve a possible concern: you are not billed based on the estimates). Happy coding, Jeff On Thu, Oct 15, 2009 at 8:12 PM, Prashant antsh...@gmail.com wrote: last night i deleted all the indexes (coz' i don't need them) but there was no change in amount of Stored Data (Dashboard), how why? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: What changed? Site is completely down.
Hi moowoo, Are you able to update to the 1.2.6 SDK? I think this would be the simplest way to fix this, but if you are still seeing issues, would you mind sharing a bit more of your code? Thank you, Jeff On Mon, Oct 12, 2009 at 4:37 PM, moowoo chenjl.u...@gmail.com wrote: I got another error: 'Query' object has no attribute '_cursor' and my app id is x-focus On Oct 13, 6:49 am, Jon McAlister jon...@google.com wrote: It's an issue in the 1.2.6 release we're pushing out to the backends today. If you tell me your app id (off-list is ok) I can move your app to a 1.2.5 appserver and that will fix this your app. And yes, we're working on a real fix too right now. On Mon, Oct 12, 2009 at 3:47 PM, bvelasquez bvelasq...@gmail.com wrote: datastore_types.py:641File /base/python_lib/versions/1/google/ appengine/api/datastore_types.py, line 641, in __str__ if self._str is None: AttributeError: 'Key' object has no attribute '_str' I am getting this error across the site now. Nothing on my end has changed. I cannot convert the key object to a string. Barry --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Troubles with access to the datastore
Hi Denis, Is this app still active? I'm not seeing any data. Thank you, Jeff On Fri, Oct 9, 2009 at 10:09 AM, Denis Moskalets denya@gmail.comwrote: App id: classificators-ru Data viewer in console: Oops! We couldn't retrieve your list of Kinds. Please try again later. Query KladrStreetRecord.all(keys_only=True).fetch(10) fails too All my other apps works ok. What is this? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: app creation problem
Hi Kiren, Which account are you using to create the apps, is this a Google Apps account? The reason I ask is that a common source of confusion is that apps created with a Google Apps account show up under appengine.google.com/a/ example.com. Thank you, Jeff On Wed, Oct 14, 2009 at 12:09 PM, kiren kirense...@gmail.com wrote: I had this problem when I created my first app almost six months ago, and now I'm having it again: I go to create an app, select a name, etc, and click Save. It waits for a couple seconds, then redirects me back to the start page, i.e. app creation silently fails. (The app that I tried to create doesn't appear anywhere on the dashboard.) Unfortunately, if I try to create the app again, it says the name (which I tried last time) is taken. It seems like there are 2 problems: that app creation is flaky, and that it isn't transactional (i.e. if app creation fails the name still gets taken.) I've tried creating apps a few more times (with new names) and am getting the same failure. Is anyone else having trouble creating apps? And is the bug in which names become unavailable after a failed app creation on Google's radar? -Kiren --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Indexes building for 3 days
Interesting. I don't recall the old indexes which were stuck, are the ones that are now stuck the same ones? I'm investigating this in greater depth. Thank you, Jeff On Tue, Oct 13, 2009 at 9:53 AM, visadm543 visadm...@gmail.com wrote: Thanks. I vacuumed and updated the indexes. It worked this time, but now 16 new indexes are stuck building. If these 16 indexes are a problem, I can modify the application not to use them. On Oct 12, 10:38 am, Jeff S (Google) j...@google.com wrote: Apologies, I've move these indexes to the error state, so you'll need to re-vacuum. Thank you, Jeff On Sun, Oct 11, 2009 at 11:05 AM, visadm543 visadm...@gmail.com wrote: Thank you. I vacuumed the indexes and tried again, with a subset of 28 indexes. It has been 48 hours and they are still building. Any help is appreciated. On Oct 8, 4:04 pm, Jeff S (Google) j...@google.com wrote: I've reset your index count and moved the stuck indexes into the error state. I think the issue may have been related to the fact that this app had 100 indexes, which is the upper limit. Would it be possible to use fewer indexes? If not, we can discuss the possibility of allowing this app to have more. Thank you, Jeff On Oct 8, 1:51 pm, visadm543 visadm...@gmail.com wrote: The indexes for my app have been in the building state since the morning of 10/5. App ID is vispipe. Any help is appreciated. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Indexes building for 3 days
Apologies, I've move these indexes to the error state, so you'll need to re-vacuum. Thank you, Jeff On Sun, Oct 11, 2009 at 11:05 AM, visadm543 visadm...@gmail.com wrote: Thank you. I vacuumed the indexes and tried again, with a subset of 28 indexes. It has been 48 hours and they are still building. Any help is appreciated. On Oct 8, 4:04 pm, Jeff S (Google) j...@google.com wrote: I've reset your index count and moved the stuck indexes into the error state. I think the issue may have been related to the fact that this app had 100 indexes, which is the upper limit. Would it be possible to use fewer indexes? If not, we can discuss the possibility of allowing this app to have more. Thank you, Jeff On Oct 8, 1:51 pm, visadm543 visadm...@gmail.com wrote: The indexes for my app have been in the building state since the morning of 10/5. App ID is vispipe. Any help is appreciated. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Unable to upload new application and unable to access console
Hi Jacob, Is you email account a Google Apps account? Since the error states that the password doesn't match, I'm wondering if you could have a Google Apps account and a Google Account with the same email address but different passwords. Does that seem like a possibility? Thank you, Jeff On Wed, Oct 7, 2009 at 1:57 PM, jacobg ja...@cookiejunkie.com wrote: Hi, Earlier today I created an application. I went through the SMS verification process and entered the ID and other application details. When I hit the submit button it took me back to the create page (https://appengine.google.com/start) without giving me any feedback. I tried accessing the admin console, but it always took me back to the Create Application wizard. I looked around on the forums, and people mentioned that I needed to upload the application to GAE in order to see it in the console. When I tried to do that, it asked me for the account credentials three times and then said com.google.appengine.tools.admin.ServerConnection $ClientLoginException: Email jacobatcookiejunkiedotcom and password do not match. I tried this three times without success. I also verified the credentials by logging in and out of my Google Account several times and it worked fine. When I try to go through the Create Application wizard again it asks me to verify my mobile number, but then says it has already been used! So now I'm stuck, unable to access my new application and creating new ones. Please help me! --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Index building for a while. Unable to reset
Hi adhi, It looks like all of your indexes are now serving. How long were these indexes in the building state? Index building can sometimes take a few hours, but if it goes beyond 24 then there is certainly a problem which one of us on the team needs to address. Happy coding, Jeff On Oct 8, 4:49 am, adhi adhinaraya...@gmail.com wrote: One of the indexes in my application is still in building state. Please mark it as error so that I can update it again. My app-id is os-dev Is there any permanent solution for this. Thanks adhi --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Over Quota: Datastore Indices Count
Hi Thomas, I've reset your index count quota. It didn't look like you had any indexes stuck in the building state. Happy coding, Jeff On Thu, Oct 8, 2009 at 9:45 AM, gumptionthomas thomasbohmb...@gmail.comwrote: Hi Nick. We're seeing this same issue on 'giftag-int'. Could we get a reset as well? -Thomas On Sep 9, 5:08 am, Nick Johnson (Google) nick.john...@google.com wrote: Hi James, I've reset your index quota. -Nick Johnson On Wed, Sep 9, 2009 at 8:07 AM, james james.r...@gmail.com wrote: Hello - I am also experiencing the same issue. After updating my app (app-id: vhac) the dashboard is reported that I am exceeding quota at 100% for the datastore indices count. Can you reset the quota? Thanks -James On Aug 11, 3:52 am, Nick Johnson (Google) nick.john...@google.com wrote: I've reset quotas for me-trics and labpixiesdata. I can't reset NiklasRTZ's index quota, since he didn't provide an App ID. -Nick Johnson On Tue, Aug 11, 2009 at 7:24 AM, Guy Rutenbergg...@labpixies.com wrote: Hi Jeff, We are experiencing the same issue with app-id: labpixiesdata. It reportsDatastoreIndicesCountis 100 of 100, while the index page only lists 3 indexes and our entities are small without many properties. I don't think we did an index vacuum (at least not recently). I would appreciate if you could look at it and sort it out. Also would you be able to say how can we avoid this situation at all? Thanks, Guy On Jun 30, 3:05 am, Jeff S (Google) j...@google.com wrote: Hi Thomas, I've rest this quota, apologies for the delay. Thank you, Jeff On Sun, Jun 28, 2009 at 8:03 PM, Thomas McKay - www.winebythebar.com thomasfmc...@gmail.com wrote: Dashboard says over quota onindicesagain. No updates or vacuums today. App: winebythebar On Jun 23, 12:46 pm, Jeff S (Google) j...@google.com wrote: Hi Thomas, I've reset the indexcount, apologies for the inconvenience. Happy coding, Jeff On Tue, Jun 23, 2009 at 9:12 AM, Thomas McKay - www.winebythebar.com thomasfmc...@gmail.com wrote: My app is getting Your application is exceeding a quota:Datastore IndicesCount after a vacuum. Could I get a reset ofindicescount please? App: winebythebar On May 23, 11:50 pm, fedestabile stabile.feder...@gmail.com wrote: Thanks Jeff, it's working fine now :) Cheers, Fred On May 20, 5:48 am, Jeff S (Google) j...@google.com wrote: Fred, I've reset the indexcountso you should be all set. Kaspars I've reset the indexquotaforyourapp as well and it looks like you had some indexes which were stuck in the building state so I've moved them to error. Happy coding, Jeff On May 19, 2:11 am, kaspars...@gmail.com kaspars...@gmail.com wrote: I've only 8 indexes at the moment and I'm also getting Your applicationisexceedingaquota:DatastoreIndicesCount. The applicationis basically stuck for couple days. Could you please reset thequota, app ID is lasi2. Thanks, Kaspars -- Nick Johnson, Developer Programs Engineer, App Engine -- Nick Johnson, Developer Programs Engineer, App Engine --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Indexes building for 3 days
I've reset your index count and moved the stuck indexes into the error state. I think the issue may have been related to the fact that this app had 100 indexes, which is the upper limit. Would it be possible to use fewer indexes? If not, we can discuss the possibility of allowing this app to have more. Thank you, Jeff On Oct 8, 1:51 pm, visadm543 visadm...@gmail.com wrote: The indexes for my app have been in the building state since the morning of 10/5. App ID is vispipe. Any help is appreciated. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: stuck indexes
Hi Claude, It looks like the index count had become incorrect which is a known issue, I've reset the count and moved these indexes into the Error state so that they can be vacuumed. Apologies for the inconvenience. Thank you, Jeff On Oct 7, 1:35 am, Claude Vedovini cla...@vedovini.net wrote: Hello, Seems like my app (id: swissmeddev) have 6 stuck indexes, can you help? Thanks, Claude --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Recently Built Indexes are Incomplete
Hi Scott,
Yes your transactional get fits the bill. Unfortunately it seems that the
differences in query results are not the result of partially applied jobs,
but it seems like these indexes need to be rebuilt. I can do this for you
and I'll keep you updated via email since this is isolated to your app.
Thank you,
Jeff
On Thu, Oct 1, 2009 at 4:38 PM, Scott sderick...@gmail.com wrote:
SELECT * FROM UserItem where user = 'scott' and lang = 'ja' and style
= 'both' and part = 'rune' order by last desc
I just checked this one, and I still only get 308 (counting from the
data viewer in the dashboard). Some of these items had changes made to
the values when I was using the site, so I assume the difference is
those items that weren't previously in the index were added to it when
their values were altered in the datastore.
I could go through the table of useritems and put them, but that's an
awful lot of entities. These few hundred are just mine and there are a
lot of users with a lot more.
When you say starting a new transaction on the entity, what do you
mean exactly? I wasn't sure but I tried running the following code in
the remote console.
def getanything():
... ui = db.get(key)
...
db.run_in_transaction(getanything)
uis = models.UserItem.all().filter('user =','scott').filter('lang
=','ja').filter('style =','both').filter('part
=','rune').order('-last').fetch(1000)
len(uis)
308
-Scott
On Oct 1, 6:22 pm, Jeff S (Google) j...@google.com wrote:
Hi Scott,
Could you try these queries again and check the differences in the result
counts? I'm wondering if the issue was that the writes for the new
entities
were partially applied to the indexes. The datastore backend sweeps for
partially applied jobs (also you can also trigger a roll-forward on the
index by starting a new transaction on the entity - even if it is just a
get). Instances of this are rare but it's the first thing that comes to
mind.
Thank you,
Jeff
On Wed, Sep 30, 2009 at 3:30 PM, Jeff S (Google) j...@google.com
wrote:
Hi Scott,
Thank you for the report, we're investigating this now. I'll keep you
posted.
-Jeff
On Wed, Sep 30, 2009 at 2:29 PM, Scott sderick...@gmail.com wrote:
I just recently built a few more indexes. They were built much faster
than before.
But it seems like not everything that ought to be in the index is in
the index. Take for example this one:
- kind: UserItem
properties:
- name: lang
- name: part
- name: style
- name: user
- name: last
direction: desc
I just built that one to replace this one which was built a long time
ago:
- kind: UserItem
properties:
- name: part
- name: style
- name: user
- name: last
direction: desc
Now if I want to look at my UserItems on the data viewer I put in this
query:
SELECT * FROM UserItem where user = 'scott' and lang = 'ja' and style
= 'both' and part = 'rune' order by last desc
But this ends up giving me 289 entities. If I use the old index:
SELECT * FROM UserItem where user = 'scott' and style = 'both' and
part = 'rune' order by last desc
Or I use no index:
SELECT * FROM UserItem where user = 'scott' and style = 'both' and
part = 'rune'
I get 478 entities. I checked over these and they all have 'last' and
'lang' values so they should be in the index (and only three of them
have lang != 'ja'). I can't figure out any particular common theme
behind the items that aren't in the index that should be in the index.
The same thing happened with indexes:
- kind: UserItem
properties:
- name: lang
- name: part
- name: style
- name: user
- name: rtd
- kind: UserItem
properties:
- name: lang
- name: part
- name: style
- name: user
- name: time
direction: desc
All three of these indexes were built in the last three or four days.
The ones that do work were built early in August, I believe.
Appengine ID: skrit
Note: the numbers may vary as I continue to use the site. But those
are the numbers that I have now.
- Scott
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---
[google-appengine] Re: Authenticating to application to access REST services
Hi Devraj, Yes you can use ClientLogin (which sends the user's username and password over SSL in exchange for an auth token) to obtain a cookie which is used by App Engine's users API to determine the current user. I wrote a small open source Python library to accomplish this (based on the gdata-python-client) and I wrote up a description on my personal blog: http://blog.jeffscudder.com/2009/08/test-client-for-app-engine.html You could build a non-browser-based client library like this is just about any language. Happy coding, Jeff On Sun, Oct 4, 2009 at 10:15 PM, Devraj Mukherjee dev...@gmail.com wrote: Hi all, My AppEngine application (written in Python) provides a REST API that is used by a jQuery based web front end. Users are required to authenticate themselves to use my application and obviously I am able protect both my REST services and the UI parts setting login: required in app.yaml I wish to now write a consumer for my REST API to ship as a client library (preferred languages Python and/or Objective-C). How should I go about handling the authentication? Should authenticating using the GData libraries work? Thanks for any pointers. -- The secret impresses no-one, the trick you use it for is everything - Alfred Borden (The Prestiege) --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Indexes in building state for quite a while. Unable to vacuum.
Hi Sakthivel, I've moved these indices to the error state so you should be able to vacuum them now. Thank you, Jeff On Fri, Oct 2, 2009 at 5:35 AM, Sakthivel sakthiinfo...@gmail.com wrote: Hi, I updated a set of indexes and it is in building state for more than 2 hours now. I tried to use update_indexes, vacuum_indexes but it didn't solve the problem.. Any solution please... My app id is: sakthi-testing Thanks, Sakthivel --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Remove Application Permissions
Hi Todd, There is a webpage which allows you to change authorized websites under google.com/accounts. The specific page is here: https://www.google.com/accounts/IssuedAuthSubTokens Cheers, Jeff On Wed, Sep 30, 2009 at 7:13 AM, Todd tberman...@gmail.com wrote: This is a user question (not developer), so I hope I am posting in the correct place (I just could not find the answer anywhere). Anyway, I gave a 3rd part application access authority to access my contacts to use the app. After testing it for a few days, I determined it did not meet my needs. I am now looking for a way to turn off the access I granted. Can anyone explain to me how to do this (or show point my in the right direction to find this answer)? Thanks in advance! --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: index stuck, doesn't work
Ah I see, thank you for the details. So far I haven't been able to reproduce the timeout on the first query that you listed. How are you performing the query and how large are these entities? It may be that the cause of the timeout is the way in which the query is being performed. Also, I wanted to confirm that this a datastore timeout (as opposed to deadline exceeded). Thank you, Jeff On Wed, Sep 30, 2009 at 9:01 PM, Kazuho Okui kaz...@gmail.com wrote: SELECT * FROM User order by updated_at This query always returns timeout. It doesn't matter query from python or from dashboard. SELECT * FROM User where order by updated_at desc This one works better, however, it still gets a lot of errors. (error rate is 5-10%) I query 100 records per one http request. Is this usual error rate? On Wed, Sep 30, 2009 at 2:23 PM, Jeff S (Google) j...@google.com wrote: Hi Kazuho Okui, Which queries are giving you errors? It looks like you have an index on updated_at which is ascending and if there are no other filters in your query with updated_at descending then the single property indexes (there are two for each indexed property, one ascending, one descending) should be able to support this query. What is the specific error that you are seeing? Thank you, Jeff On Wed, Sep 30, 2009 at 10:02 AM, Kazuho Okui kaz...@gmail.com wrote: How long will this take? Fixing just single index issue takes more than 2 weeks? On Tue, Sep 22, 2009 at 11:28 PM, Kazuho Okui kaz...@gmail.com wrote: It seems a lot of errors occur in 'order by updated_at desc' now. 'order by updated_at' doesn't work for a week. Any updates? On Sat, Sep 19, 2009 at 12:16 PM, Kazuho Okui kaz...@gmail.com wrote: Thanks! I removed stuck indexes. However, I still get errors on 'order by updated_at' even 'order by updated_at desc' sometimes. - Kazuho On Fri, Sep 18, 2009 at 11:05 AM, Jeff S (Google) j...@google.com wrote: Hi Kazuho, I've set the state of the stuck indexes to error for twitrackbacktest so that they can be removed. I'm still looking into possible issues in echofonsync. Thank you, Jeff On Fri, Sep 18, 2009 at 10:23 AM, Kazuho Okui kaz...@gmail.com wrote: Hi I have 2 instance. app_id: twitrackbacktest Indexing stuck. Building / deleting index stuck. it takes almost 2weeks. app_id: echofonsync index of 'updated_at' is somehow broken. Following query always returns datastore_errors.timeout SELECT * FROM Users ORDER BY updated_at related query also causes error even I re-create index. SELECT * FROM User ORDER BY updated_at,device_token It's very odd, but if I add 'desc' to updated_at, it works. SELECT * FROM User ORDER BY updated_at desc Other indexes works fine. SELECT * FROM User ORDER BY user_id SELECT * FROM User ORDER BY username ... - Kazuho --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Recently Built Indexes are Incomplete
Hi Scott, Could you try these queries again and check the differences in the result counts? I'm wondering if the issue was that the writes for the new entities were partially applied to the indexes. The datastore backend sweeps for partially applied jobs (also you can also trigger a roll-forward on the index by starting a new transaction on the entity - even if it is just a get). Instances of this are rare but it's the first thing that comes to mind. Thank you, Jeff On Wed, Sep 30, 2009 at 3:30 PM, Jeff S (Google) j...@google.com wrote: Hi Scott, Thank you for the report, we're investigating this now. I'll keep you posted. -Jeff On Wed, Sep 30, 2009 at 2:29 PM, Scott sderick...@gmail.com wrote: I just recently built a few more indexes. They were built much faster than before. But it seems like not everything that ought to be in the index is in the index. Take for example this one: - kind: UserItem properties: - name: lang - name: part - name: style - name: user - name: last direction: desc I just built that one to replace this one which was built a long time ago: - kind: UserItem properties: - name: part - name: style - name: user - name: last direction: desc Now if I want to look at my UserItems on the data viewer I put in this query: SELECT * FROM UserItem where user = 'scott' and lang = 'ja' and style = 'both' and part = 'rune' order by last desc But this ends up giving me 289 entities. If I use the old index: SELECT * FROM UserItem where user = 'scott' and style = 'both' and part = 'rune' order by last desc Or I use no index: SELECT * FROM UserItem where user = 'scott' and style = 'both' and part = 'rune' I get 478 entities. I checked over these and they all have 'last' and 'lang' values so they should be in the index (and only three of them have lang != 'ja'). I can't figure out any particular common theme behind the items that aren't in the index that should be in the index. The same thing happened with indexes: - kind: UserItem properties: - name: lang - name: part - name: style - name: user - name: rtd - kind: UserItem properties: - name: lang - name: part - name: style - name: user - name: time direction: desc All three of these indexes were built in the last three or four days. The ones that do work were built early in August, I believe. Appengine ID: skrit Note: the numbers may vary as I continue to use the site. But those are the numbers that I have now. - Scott --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: index stuck, doesn't work
Hi Kazuho Okui, Which queries are giving you errors? It looks like you have an index on updated_at which is ascending and if there are no other filters in your query with updated_at descending then the single property indexes (there are two for each indexed property, one ascending, one descending) should be able to support this query. What is the specific error that you are seeing? Thank you, Jeff On Wed, Sep 30, 2009 at 10:02 AM, Kazuho Okui kaz...@gmail.com wrote: How long will this take? Fixing just single index issue takes more than 2 weeks? On Tue, Sep 22, 2009 at 11:28 PM, Kazuho Okui kaz...@gmail.com wrote: It seems a lot of errors occur in 'order by updated_at desc' now. 'order by updated_at' doesn't work for a week. Any updates? On Sat, Sep 19, 2009 at 12:16 PM, Kazuho Okui kaz...@gmail.com wrote: Thanks! I removed stuck indexes. However, I still get errors on 'order by updated_at' even 'order by updated_at desc' sometimes. - Kazuho On Fri, Sep 18, 2009 at 11:05 AM, Jeff S (Google) j...@google.com wrote: Hi Kazuho, I've set the state of the stuck indexes to error for twitrackbacktest so that they can be removed. I'm still looking into possible issues in echofonsync. Thank you, Jeff On Fri, Sep 18, 2009 at 10:23 AM, Kazuho Okui kaz...@gmail.com wrote: Hi I have 2 instance. app_id: twitrackbacktest Indexing stuck. Building / deleting index stuck. it takes almost 2weeks. app_id: echofonsync index of 'updated_at' is somehow broken. Following query always returns datastore_errors.timeout SELECT * FROM Users ORDER BY updated_at related query also causes error even I re-create index. SELECT * FROM User ORDER BY updated_at,device_token It's very odd, but if I add 'desc' to updated_at, it works. SELECT * FROM User ORDER BY updated_at desc Other indexes works fine. SELECT * FROM User ORDER BY user_id SELECT * FROM User ORDER BY username ... - Kazuho --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Recently Built Indexes are Incomplete
Hi Scott, Thank you for the report, we're investigating this now. I'll keep you posted. -Jeff On Wed, Sep 30, 2009 at 2:29 PM, Scott sderick...@gmail.com wrote: I just recently built a few more indexes. They were built much faster than before. But it seems like not everything that ought to be in the index is in the index. Take for example this one: - kind: UserItem properties: - name: lang - name: part - name: style - name: user - name: last direction: desc I just built that one to replace this one which was built a long time ago: - kind: UserItem properties: - name: part - name: style - name: user - name: last direction: desc Now if I want to look at my UserItems on the data viewer I put in this query: SELECT * FROM UserItem where user = 'scott' and lang = 'ja' and style = 'both' and part = 'rune' order by last desc But this ends up giving me 289 entities. If I use the old index: SELECT * FROM UserItem where user = 'scott' and style = 'both' and part = 'rune' order by last desc Or I use no index: SELECT * FROM UserItem where user = 'scott' and style = 'both' and part = 'rune' I get 478 entities. I checked over these and they all have 'last' and 'lang' values so they should be in the index (and only three of them have lang != 'ja'). I can't figure out any particular common theme behind the items that aren't in the index that should be in the index. The same thing happened with indexes: - kind: UserItem properties: - name: lang - name: part - name: style - name: user - name: rtd - kind: UserItem properties: - name: lang - name: part - name: style - name: user - name: time direction: desc All three of these indexes were built in the last three or four days. The ones that do work were built early in August, I believe. Appengine ID: skrit Note: the numbers may vary as I continue to use the site. But those are the numbers that I have now. - Scott --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Failover Datastore
Hi Robin, This is a great idea, in fact we already replicate data into more than one datacenter. At the moment, one datacenter is primary for a given app and data is replicated in the background to other datacenters. There is a small delay in replication, which we are in the process of shortening. When we do fail over, we put the primary datacenter into read only mode while replication completes, then we select the new primary datacenter. In the future we may no longer need to have just one datacenter be the primary. This is covered in more detail in a recent blog post: http://googleappengine.blogspot.com/2009/09/migration-to-better-datastore.html Thank you, Jeff On Mon, Sep 28, 2009 at 1:03 PM, Robin B robi...@gmail.com wrote: Here is an idea for better datastore fault tolerance: Why not have 1 datastore available to each application. When Google needs to do maintenance, they put at most 1 datastore in read-only mode, and applications can revert to 1 or more alternate datastores until the maintenance is completed, then apps can use their task queue to resync their own data. A person can accomplish this right now using AWS SDB when BigTable becomes unavailable, but sending that data over the internet is not ideal. One of the big selling points of GAE is scalability, fault tolerance, and uptime, but having no persistent write access for any period of time prevents people from achieving those ideals. Are temp/failover datastores a plausible idea? Thanks, Robin --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: How to find the creator of a given app ?
Hi David, At the moment, there is not an easy way for you to see who created an application. I'm curious, why do you ask? If you are concerned about an app we have a form to report suspected abuse. Thank you, Jeff On Sun, Sep 27, 2009 at 11:09 AM, davidgm david.guyonmar...@gmail.comwrote: Hi there, I wonder how can one find the creator of a given app ? For example: if I use samplapp.appspot.com , how do I find out who created this ? (the author) (I've searched for a while and no answer anywere about this...) Thanks ! David --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Outage today
There were more details posted here in the downtime notify group: http://groups.google.com/group/google-appengine-downtime-notify/browse_thread/thread/e497ce0638d63351 Also, the latencies returned to normal shortly after the second message was posted. Thank you, Jeff On Mon, Sep 28, 2009 at 1:28 PM, Max maks...@gmail.com wrote: Yeah I have same question too. On Sep 28, 1:22 pm, Hani Naguib haninag...@gmail.com wrote: Any news on todays outage (28th of September)? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: billing bug
Hi Jonathan, Could you send me your app ID? We're looking into this but it seems like this is the expected behavior. The denied emails are listed as billable (because if you had enabled billing, you could have been charged for them) even though you weren't charged, does that make sense? Thank you, Jeff On Mon, Sep 28, 2009 at 6:26 AM, Jonathan jricket...@gmail.com wrote: In my billing history I have the following content: Recipients Emailed: $0.0001/Email 7,399.002,000.005,399.00$0.00 The first thing that is strange about this is that I have never lifted my billable quota for email above the free quota. The second thing that is strange is that it says that it sent 7399 emails, when it actually only sent 2000, the rest hit a quota-exceeded exception. The third thing that is strange, is that the actual charged amount seems to have taken these details into account, and is not charging me anything... jonathan --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Update stuck on uploading index definitions (Error 500)
Hi Orlando, I've moved these indexes to the error state so that they can be vacuumed? However it looks like this app has a large number of indexes, right up to the limit. Would it be possible to reduce the number of indexes for this app, or do you need more than the default limit of 100? Thank you, Jeff On Sep 29, 1:02 am, Orlando orlanma...@gmail.com wrote: I have same problem in my application 'testingpin'. I've tried to updates_index, vacuum_index, updates...and no way. Thanks, On 20 sep, 05:54, Peter peter-appeng...@google.com wrote: Yes, we are aware of the problem and are currently working on it. Apologies for the inconvenience. On Sep 19, 5:35 pm, Stephen Mayer stephen.ma...@gmail.com wrote: Same here ... just posted about in another post. Must be a problem with all apps right now. Stephen On Sep 19, 4:27 pm, jorge jorge.velazq...@gmail.com wrote: Same here, this has been happening for the last hour or so. Unfortunately, most of my site is inaccessible until I can get the indexes uploaded. I haven't heard anything or seen any updates on the AppEngine blog or twitter feed. On Sep 19, 2:17 pm, Kevin Chen kevinchen1...@gmail.com wrote: HI, When I try to update my application (appid: cspsp) using appcfg.py, I get this message at uploadingindexdefinitions: Server Error (500) A server error has occurred. --- end server output --- I also get the same thing using update_indexes and vacuum_indexes. In addition, my cron jobs don't seem to be working at all (they aren't even being run). I haven't changed any of my indexes, so I'm not sure what caused it, but it began happening after I updated app engine and ran a bulk download. Thanks for any help! --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Applications created do not appear in Admin console
Hi stelg, I see your dilemma. Could you email me the app IDs for these two orphaned apps? I'm not sure what you are asking for, access to these apps or would you prefer that they be deactivated? Thank you, Jeff On Tue, Sep 22, 2009 at 10:28 AM, stelg stelg.best...@gmail.com wrote: Hi GAE team, I am still suffering from the fact that I cannot access any more two applications that i created previously. One of them is still running on the web. So i can access it using http://appName2.appspot.com, but appName2 is not on any of my admin consoles (i have 2 accounts) anymore. I created appName1, appName2 and appName3 using my private email: firstname.lastn...@xxx.yyy Later i created a gmail account and added that as active developer to appName1 Then finally i removed firstname.lastn...@planet.nl as a developer from the same list, as my private email was going to change. appName2 and 3 did appear in the admin console for firstname.lastn...@planet.nl account. Then my private email address changed to firstname.lastn...@kkk.lll but I forgot to add that as developer for appName2 and 3. Now it is impossible to get access to appName2 and appName3. The names are still active. I cannot reset firstname.lastn...@xxx.yyy as I don't know the old password and the email adress doesn't exist anymore. I think that acoount is still attached to appName2 and 3. I have sent a email with details to the google engineer, but dit not got any feedback since june 2009. So I am still lost in cyberspace for the other applications. One application is still up and running quite comfortable! I use my gmail account for administrating it. No problem here. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: JDOQuery
Hi anurag, One of the design constraints with Bigtable is that there can only be inequality filters on a single property. That is why idx works, but there is an error when you add namey. In some cases, the recommended approach is to create a special property at write to for the purpose of allowing an inequality scan. You might also ask on the discussion group for App Engine's Java runtime as the authors of the JDO and JPA support for App Engine tend to frequent that list. http://groups.google.com/group/google-appengine-java Happy coding, Jeff On Wed, Sep 23, 2009 at 11:58 AM, anurag anuraggupta@gmail.com wrote: HI, all i want to put two or filter for an object.how can i put ? i m using google JDO jar file. RDBMS query select * from user where id10 or name like 'anu%'; i want same query in JDO i wrote select from User.class where id10; its working fine. but when i put both filter that means select from User.class where id10 || name'anu'; its throwing error. how to resole this issue please suggest me thanks in advance. anurag --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Indexes still 'Building'
Hi Szczepan, These indexes were in fact stuck, I've taken this discussion into direct email since this is related to this app's large number of indexes. Thanks for reporting :-) -Jeff On Thu, Sep 24, 2009 at 4:41 AM, Szczepan s.m.woj...@gmail.com wrote: Thanks Jeff, I was able to vacuum the indexes, waited till they disappeared and then updated my app with desired indexes. Now they are again stuck in 'Building' state since two days. Should I expect them to complete or are they stuck again? Szczepan On Sep 22, 7:44 pm, Jeff S (Google) j...@google.com wrote: Apologies Szczepan, I had indeed missed your email and you should now be able to vacuum. Please keep me posted if you get stuck again. Since your app has a large number of indexes, you may encounter issues if you delete and re-add the indexes multiple times in a day as there is currently a known issue with the index count. This should be improved in the next release but for now deleting indexes multiple times in a day can cause problems with the index count quota. Thank you, Jeff On Tue, Sep 22, 2009 at 6:45 AM, Szczepan s.m.woj...@gmail.com wrote: Hi, my indexes are in the 'Building' state since two weeks and I just can't do a thing about it. Tried vacuum_indexes, reported an issue: http://code.google.com/p/googleappengine/issues/detail?id=2111even mailed Jeff S from Google but I didn't get any response. Any help would be appreciated. Szczepan --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Poor app performance: periods of very high latency
Hi all, Thank you for all of the detailed reports. We've made some changes which should have improved the deadline exception situation, especially when related to a large number of imports when spinning up a new instance of an app. Since the fix has gone out we've been closely monitoring these apps but if you are still seeing issues please post here with your app ID, imports, and stack traces. Thanks again and apologies for the latency induced errors. Happy coding, Jeff On Sep 23, 2:10 pm, Jason C jason.a.coll...@gmail.com wrote: We are using Django 1.0.2 via zipimport and the most recent appengine_django (r90), and are still seeing the DeadlineExceededErrors. Taro, please repost here again and update us in a day or two. j On Sep 23, 2:59 am, Taro Morimoto taro.morim...@gmail.com wrote: Hi! I had the same problem with very high latencies and DeadlineExceededErrors. I don't know if you have the same problem as I did but I hope this helps for some of you. I'm using django 1.0.2 with zip import. So I just updated my google- app-engine-django helper library and the latencies are now gone. :) Best regards, Taro On Sep 19, 2:17 am, Michael m...@mzlab.net wrote: I'm having the same problem (app: sovpad) Except from my logs can be found here:http://groups.google.com/group/google-appengine-python/browse_thread/... On Sep 19, 1:05 am, bvelasquez bvelasq...@gmail.com wrote: I'm experiencing this also (app: jacob-6). 2 Sept. is when I started noticing the issue. Mostly in the morning (PST). Later in the day, the app is very fast, and responses come back after 200ms. In the morning, these same requests can take up 2ms. Barry On Sep 18, 9:28 am, johnP j...@thinkwave.com wrote: Dozens of people have been starring the following item:http://code.google.com/p/googleappengine/issues/detail?id=1695 Something happened after the 2 Sept deployment. On Sep 18, 7:42 am, Mahmoud mahmoud.ar...@gmail.com wrote: Actually, our app (spont.appspot.com) has been seeing elevated latency as well in the last two weeks. The code has not changed at all in those two weeks. -M On Sep 18, 4:54 am, Nick Johnson (Google) nick.john...@google.com wrote: Hi Brandon, What is your App ID? On Fri, Sep 18, 2009 at 8:46 AM, Brandon Thomson gra...@gmail.com wrote: I get bursty periods of very high request latency, with increasing frequency over the last few weeks, which last from seconds to hours. Usually the elevated latencies are in the 3-6s range but sometimes it goes up into the 20-30s range. For example, here are some logs from a few minutes ago: 09-18 12:23AM 46.511 /checkStatus 500 2906ms 105cpu_ms 8api_cpu_ms 0kb Pingdom.com_bot_version_1.4_(http:// www.pingdom.com/),gzip(gfe),gzip(gfe) 09-18 12:23AM 46.511 /checkStatus 500 2906ms 105cpu_ms 8api_cpu_ms 0kb Pingdom.com_bot_version_1.4_(http:// www.pingdom.com/),gzip(gfe),gzip(gfe) 09-18 12:23AM 46.360 /stats 200 2771ms 105cpu_ms 8api_cpu_ms 5kb w3m/0.5.2,gzip(gfe),gzip(gfe) 09-18 12:23AM 46.118 /admin/tick 200 2706ms 113cpu_ms 16api_cpu_ms 0kb Python-urllib/2.5,gzip(gfe),gzip(gfe) 09-18 12:23AM 43.878 /admin/tick 200 3825ms 113cpu_ms 16api_cpu_ms 0kb Python-urllib/2.5,gzip(gfe),gzip(gfe) 09-18 12:23AM 41.639 /admin/tick 200 4983ms 113cpu_ms 16api_cpu_ms 0kb Python-urllib/2.5,gzip(gfe),gzip(gfe) 09-18 12:23AM 41.603 /stats 200 4602ms 105cpu_ms 8api_cpu_ms 5kb w3m/0.5.2,gzip(gfe),gzip(gfe) 09-18 12:23AM 41.603 /stats 200 4602ms 105cpu_ms 8api_cpu_ms 5kb w3m/0.5.2,gzip(gfe),gzip(gfe) 09-18 12:23AM 39.401 /admin/tick 200 4826ms 113cpu_ms 16api_cpu_ms 0kb Python-urllib/2.5,gzip(gfe),gzip(gfe) 09-18 12:23AM 39.401 /admin/tick 200 4826ms 113cpu_ms 16api_cpu_ms 0kb Python-urllib/2.5,gzip(gfe),gzip(gfe) 09-18 12:23AM 37.158 /admin/tick 200 4800ms 113cpu_ms 16api_cpu_ms 0kb Python-urllib/2.5,gzip(gfe),gzip(gfe) Pingdom is pinging from all over the globe and sees the problem so it is definitely on the App Engine side. Can you elaborate on this? Drilling down into my logs: Even when the requests are taking 6s+ to return, from my first logging statement at the very top of my python file to the last logging statement at the end of my request handler is only 500ms of real time. So, I don't know where exactly the issue is, but it doesn't seem to be inside my code. What imports, other than 'logging' are you doing before your first logging statement?
[google-appengine] Re: Upload data to development server
Hello again rc, Apologies, it seems I was too hasty in my reply. Nick has pointed out that we do in fact document how to upload data into the development server. Please see: http://code.google.com/appengine/docs/python/tools/uploadingdata.html#Loading_Data_Into_the_Development_Server Thank you, Jeff On Tue, Sep 22, 2009 at 10:57 AM, Jeff S (Google) j...@google.com wrote: Hi rc, The upload_data command is designed for pushing data into the hosted application, on appspot, and might not be usable with the local SDK server. Authentication is particular is handled differently in the local SDK than in App Engine. Thank you, Jeff On Mon, Sep 21, 2009 at 7:01 AM, rc rkc...@gmail.com wrote: Hi, I am new to the Google app engine. I have developed a simple app which has a datastore component. I want to upload some data to the development server. I am using the 'appcfg.py upload_data' but I am getting a login/password prompt and I am not sure what to put there. I tried using my gmail a/c password but that fails. Could you please let me know what I am missing here? Thanks rc Uploading data records. [INFO] Logging to bulkloader-log-20090921.085252 [INFO] Throttling transfers: [INFO] Bandwidth: 25 bytes/second [INFO] HTTP connections: 8/second [INFO] Entities inserted/fetched/modified: 20/second [INFO] Opening database: bulkloader-progress-20090921.085252.sql3 Please enter login credentials for localhost Email: r**...@gmail.com Password for r**...@gmail.com: [INFO] Connecting to localhost:8080/remote_api [ERROR ] Exception during authentication Traceback (most recent call last): File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/ GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/ google/appengine/tools/bulkloader.py, line 2985, in Run request_manager.Authenticate() File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/ GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/ google/appengine/tools/bulkloader.py, line 1152, in Authenticate remote_api_stub.MaybeInvokeAuthentication() File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/ GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/ google/appengine/ext/remote_api/remote_api_stub.py, line 494, in MaybeInvokeAuthentication datastore_stub._server.Send(datastore_stub._path, payload=None) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/ GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/ google/appengine/tools/appengine_rpc.py, line 344, in Send f = self.opener.open(req) File /System/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/urllib2.py, line 374, in open response = self._open(req, data) File /System/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/urllib2.py, line 392, in _open '_open', req) File /System/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/urllib2.py, line 353, in _call_chain result = func(*args) File /System/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/urllib2.py, line 1100, in http_open return self.do_open(httplib.HTTPConnection, req) File /System/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/urllib2.py, line 1075, in do_open raise URLError(err) URLError: urlopen error (61, 'Connection refused') [INFO] Authentication Failed --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: App limit
Hi Jason, I've increased your cap to 20 apps. Thank you, Jeff On Wed, Sep 23, 2009 at 7:56 AM, Jason jason.m.cartwri...@gmail.com wrote: Hi, Enjoying AppEngine, but have reached my app limit. Could I get it increased pls? Kind Regards, Jason --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: do you use values with value with db.DateTimeProperty(auto_now=True) ?
Hi Nelson, Thanks for raising the issue. Could you be more specific as to what these surprises were? Also, if you could share your app ID with me, I might be able to dig a bit deeper than just trying to reproduce the issue. Assuming that the problem is that expected entities are not in the query results, what are some of the queries which contain unexpected results? Also, what is the time frame for the creation of the new entity and the query? I'd like to help you get to the bottom of the issue. Thank you, Jeff On Tue, Sep 22, 2009 at 5:31 AM, Nelson jusfi...@att.net wrote: I have found infrequent but repeating surprises when using (auto_now=True), and the past six months have led to no further enlightenment via: http://code.google.com/p/googleappengine/issues/detail?id=1158 I would rather help to debug this datastore feature than switch to explicitly maintaining another timestamp within each record. But, I also wish to run a reliable application. If you use (auto_now=True), do you just blindly trust your query results, or might you have noticed similar failures? Cheers, Nelson --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Indexes still 'Building'
Apologies Szczepan, I had indeed missed your email and you should now be able to vacuum. Please keep me posted if you get stuck again. Since your app has a large number of indexes, you may encounter issues if you delete and re-add the indexes multiple times in a day as there is currently a known issue with the index count. This should be improved in the next release but for now deleting indexes multiple times in a day can cause problems with the index count quota. Thank you, Jeff On Tue, Sep 22, 2009 at 6:45 AM, Szczepan s.m.woj...@gmail.com wrote: Hi, my indexes are in the 'Building' state since two weeks and I just can't do a thing about it. Tried vacuum_indexes, reported an issue: http://code.google.com/p/googleappengine/issues/detail?id=2111 even mailed Jeff S from Google but I didn't get any response. Any help would be appreciated. Szczepan --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Upload data to development server
Hi rc, The upload_data command is designed for pushing data into the hosted application, on appspot, and might not be usable with the local SDK server. Authentication is particular is handled differently in the local SDK than in App Engine. Thank you, Jeff On Mon, Sep 21, 2009 at 7:01 AM, rc rkc...@gmail.com wrote: Hi, I am new to the Google app engine. I have developed a simple app which has a datastore component. I want to upload some data to the development server. I am using the 'appcfg.py upload_data' but I am getting a login/password prompt and I am not sure what to put there. I tried using my gmail a/c password but that fails. Could you please let me know what I am missing here? Thanks rc Uploading data records. [INFO] Logging to bulkloader-log-20090921.085252 [INFO] Throttling transfers: [INFO] Bandwidth: 25 bytes/second [INFO] HTTP connections: 8/second [INFO] Entities inserted/fetched/modified: 20/second [INFO] Opening database: bulkloader-progress-20090921.085252.sql3 Please enter login credentials for localhost Email: r**...@gmail.com Password for r**...@gmail.com: [INFO] Connecting to localhost:8080/remote_api [ERROR ] Exception during authentication Traceback (most recent call last): File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/ GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/ google/appengine/tools/bulkloader.py, line 2985, in Run request_manager.Authenticate() File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/ GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/ google/appengine/tools/bulkloader.py, line 1152, in Authenticate remote_api_stub.MaybeInvokeAuthentication() File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/ GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/ google/appengine/ext/remote_api/remote_api_stub.py, line 494, in MaybeInvokeAuthentication datastore_stub._server.Send(datastore_stub._path, payload=None) File /Applications/GoogleAppEngineLauncher.app/Contents/Resources/ GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/ google/appengine/tools/appengine_rpc.py, line 344, in Send f = self.opener.open(req) File /System/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/urllib2.py, line 374, in open response = self._open(req, data) File /System/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/urllib2.py, line 392, in _open '_open', req) File /System/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/urllib2.py, line 353, in _call_chain result = func(*args) File /System/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/urllib2.py, line 1100, in http_open return self.do_open(httplib.HTTPConnection, req) File /System/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/urllib2.py, line 1075, in do_open raise URLError(err) URLError: urlopen error (61, 'Connection refused') [INFO] Authentication Failed --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: I'm getting 500 errors with a CapabilityDisabledError Datastore writes are temporarily unavailable.
We are currently in planned maintenance. See http://groups.google.com/group/google-appengine-downtime-notify/browse_thread/thread/af970296d9a0b9c8# http://groups.google.com/group/google-appengine-downtime-notify/browse_thread/thread/78f2590cd347fdd0# and http://googleappengine.blogspot.com/2009/09/migration-to-better-datastore.html Apologies for the inconvenience, Jeff On Sep 22, 5:15 pm, pdub pwj...@gmail.com wrote: My app is bidtective. The system status page is all green at the moment ... --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Deployment Error: Server Connection Error
(ServerConnection.java:143) at com.google.appengine.tools.admin.ServerConnection.post (ServerConnection.java:81) at com.google.appengine.tools.admin.AppVersionUpload.send (AppVersionUpload.java:415) at com.google.appengine.tools.admin.AppVersionUpload.updateCron (AppVersionUpload.java:151) at com.google.appengine.tools.admin.AppVersionUpload.doUpload (AppVersionUpload.java:121) at com.google.appengine.tools.admin.AppAdminImpl.update (AppAdminImpl.java:53) at com.google.appengine.eclipse.core.proxy.AppEngineBridgeImpl.deploy (AppEngineBridgeImpl.java:271) at com.google.appengine.eclipse.core.deploy.DeployProjectJob.runInWorkspace (DeployProjectJob.java:148) at org.eclipse.core.internal.resources.InternalWorkspaceJob.run (InternalWorkspaceJob.java:38) at org.eclipse.core.internal.jobs.Worker.run(Worker.java:55) My application id is crmitreport.. Please help me..its urgent... On Jul 14, 10:59 pm, Jeff S (Google) j...@google.com wrote: Is this consistent and reproducible? There are occasional failures when uploading the app, but they tend to be rare. Also if you provide the app ID you are uploading to, I can look into this for you. Thank you, Jeff On Mon, Jul 13, 2009 at 6:51 AM, Upperstage jaylockw...@gmail.com wrote: Unable to upload app:ErrorpostingtoURL: http://appengine.google.com/api/datastore/cron/update?app_id=ver... 500 Internal ServerError ServerError(500) A servererrorhas occurred. Theerrordialog directs me to the deployment console: Unable to upload: java.io.IOException:ErrorpostingtoURL: http://appengine.google.com/api/datastore/cron/update?app_id=xxxvers... 500 Internal ServerError ServerError(500) A servererrorhas occurred. at com.google.appengine.tools.admin.ServerConnection.send (ServerConnection.java:140) at com.google.appengine.tools.admin.ServerConnection.post (ServerConnection.java:78) at com.google.appengine.tools.admin.AppVersionUpload.send (AppVersionUpload.java:345) at com.google.appengine.tools.admin.AppVersionUpload.updateCron (AppVersionUpload.java:101) at com.google.appengine.tools.admin.AppVersionUpload.doUpload (AppVersionUpload.java:87) at com.google.appengine.tools.admin.AppAdminImpl.update (AppAdminImpl.java:49) at com.google.appengine.eclipse.core.proxy.AppEngineBridgeImpl.deploy (AppEngineBridgeImpl.java:271) at com.google.appengine.eclipse.core.deploy.DeployProjectJob.runInWorkspace (DeployProjectJob.java:148) at org.eclipse.core.internal.resources.InternalWorkspaceJob.run (InternalWorkspaceJob.java:38) at org.eclipse.core.internal.jobs.Worker.run(Worker.java:55) Any ideas??? -- Nick Johnson, Developer Programs Engineer, App Engine --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Deployment Error: Server Connection Error
Hello Hani, Datastore reads and writes should now be available. Thank you, Jeff On Sep 22, 5:49 pm, Hani Naguib haninag...@gmail.com wrote: How long is this planned mainteneance going to last? I have been trying to invite a developer into some of my projects and getting 'Server error' messages. Also one of my apps is failing with The API call datastore_v3.Put() is temporarily unavailable On Sep 22, 5:41 pm, Jeff S (Google) j...@google.com wrote: Hi Jason, How recently did you see the error? We are currently undergoing planned mainteneance so if this error was in the past few minutes that may be the cause. Thank you, Jeff On Sep 22, 5:37 pm, JasonGoecke jsgoe...@gmail.com wrote: I am having this same error with appid 'tropo-robot' with only consuming 4 of my available 250 deploys. Any ideas? On Aug 17, 5:51 am, Nick Johnson (Google) nick.john...@google.com wrote: Hi acocarla, I've reset your index quota. You should be able to upload your app again now. -Nick Johnson On Fri, Aug 14, 2009 at 12:15 PM, acocarla acoca...@gmail.com wrote: Hi, I am having a similar problem but with the indexes. I deleted all indexes of the application (voucherapp) using the python appcfg, and now I cannot upload the application anymore. The error I get is the following: Unable to upload: java.io.IOException: Error posting to URL: http://appengine.google.com/api/datastore/index/add?app_id=voucherapp... 500 Internal Server Error Server Error (500) A server error has occurred. at com.google.appengine.tools.admin.ServerConnection.send (ServerConnection.java:143) at com.google.appengine.tools.admin.ServerConnection.post (ServerConnection.java:81) at com.google.appengine.tools.admin.AppVersionUpload.send (AppVersionUpload.java:415) at com.google.appengine.tools.admin.AppVersionUpload.updateIndexes (AppVersionUpload.java:143) at com.google.appengine.tools.admin.AppVersionUpload.doUpload (AppVersionUpload.java:120) at com.google.appengine.tools.admin.AppAdminImpl.update (AppAdminImpl.java:53) at com.google.appengine.tools.admin.AppCfg$UpdateAction.execute (AppCfg.java:504) at com.google.appengine.tools.admin.AppCfg.init(AppCfg.java:129) at com.google.appengine.tools.admin.AppCfg.init(AppCfg.java:57) at com.google.appengine.tools.admin.AppCfg.main(AppCfg.java:53) com.google.appengine.tools.admin.AdminException: Unable to upload app: Error posting to URL: http://appengine.google.com/api/datastore/index/add?app_id=voucherapp... 500 Internal Server Error Server Error (500) A server error has occurred. at com.google.appengine.tools.admin.AppAdminImpl.update (AppAdminImpl.java:59) at com.google.appengine.tools.admin.AppCfg$UpdateAction.execute (AppCfg.java:504) at com.google.appengine.tools.admin.AppCfg.init(AppCfg.java:129) at com.google.appengine.tools.admin.AppCfg.init(AppCfg.java:57) at com.google.appengine.tools.admin.AppCfg.main(AppCfg.java:53) Caused by: java.io.IOException: Error posting to URL: http://appengine.google.com/api/datastore/index/add?app_id=voucherapp... 500 Internal Server Error Server Error (500) A server error has occurred. at com.google.appengine.tools.admin.ServerConnection.send (ServerConnection.java:143) at com.google.appengine.tools.admin.ServerConnection.post (ServerConnection.java:81) at com.google.appengine.tools.admin.AppVersionUpload.send (AppVersionUpload.java:415) at com.google.appengine.tools.admin.AppVersionUpload.updateIndexes (AppVersionUpload.java:143) at com.google.appengine.tools.admin.AppVersionUpload.doUpload (AppVersionUpload.java:120) at com.google.appengine.tools.admin.AppAdminImpl.update (AppAdminImpl.java:53) ... 4 more I did not modify my indexes in any way. Before deleting them, I was able to upload the very same file I'm now trying to upload. I tried removing stuff from the datastore-indexes.xml in order to see if I could upload only one index. So I cannot upload even the following sample file: !-- Indices written at 19-5-09 10:05 -- datastore-indexes autoGenerate=true datastore-index kind=Voucher ancestor=true source=auto property name=vouchers_INTEGER_IDX direction=asc/ /datastore-index /datastore-indexes Can somebody please help me figuring out what the problem is? Thanks, Alecsandru On Jul 31, 10:24 am, Geetha geetha...@gmail.com wrote: Hi Jeff, Even i'm facing the same problem.. i'm trying to deploy my java web
[google-appengine] Re: Deployment Error: Server Connection Error
Also, keep an eye on the thread in downtime notify http://groups.google.com/group/google-appengine-downtime-notify/browse_thread/thread/af970296d9a0b9c8 The cron service has not yet come back online but check the above thread for notification of when it is back up. Thank you, Jeff On Sep 22, 6:17 pm, Jeff S (Google) j...@google.com wrote: Hello Hani, Datastore reads and writes should now be available. Thank you, Jeff On Sep 22, 5:49 pm, Hani Naguib haninag...@gmail.com wrote: How long is this planned mainteneance going to last? I have been trying to invite a developer into some of my projects and getting 'Server error' messages. Also one of my apps is failing with The API call datastore_v3.Put() is temporarily unavailable On Sep 22, 5:41 pm, Jeff S (Google) j...@google.com wrote: Hi Jason, How recently did you see the error? We are currently undergoing planned mainteneance so if this error was in the past few minutes that may be the cause. Thank you, Jeff On Sep 22, 5:37 pm, JasonGoecke jsgoe...@gmail.com wrote: I am having this same error with appid 'tropo-robot' with only consuming 4 of my available 250 deploys. Any ideas? On Aug 17, 5:51 am, Nick Johnson (Google) nick.john...@google.com wrote: Hi acocarla, I've reset your index quota. You should be able to upload your app again now. -Nick Johnson On Fri, Aug 14, 2009 at 12:15 PM, acocarla acoca...@gmail.com wrote: Hi, I am having a similar problem but with the indexes. I deleted all indexes of the application (voucherapp) using the python appcfg, and now I cannot upload the application anymore. The error I get is the following: Unable to upload: java.io.IOException: Error posting to URL: http://appengine.google.com/api/datastore/index/add?app_id=voucherapp... 500 Internal Server Error Server Error (500) A server error has occurred. at com.google.appengine.tools.admin.ServerConnection.send (ServerConnection.java:143) at com.google.appengine.tools.admin.ServerConnection.post (ServerConnection.java:81) at com.google.appengine.tools.admin.AppVersionUpload.send (AppVersionUpload.java:415) at com.google.appengine.tools.admin.AppVersionUpload.updateIndexes (AppVersionUpload.java:143) at com.google.appengine.tools.admin.AppVersionUpload.doUpload (AppVersionUpload.java:120) at com.google.appengine.tools.admin.AppAdminImpl.update (AppAdminImpl.java:53) at com.google.appengine.tools.admin.AppCfg$UpdateAction.execute (AppCfg.java:504) at com.google.appengine.tools.admin.AppCfg.init(AppCfg.java:129) at com.google.appengine.tools.admin.AppCfg.init(AppCfg.java:57) at com.google.appengine.tools.admin.AppCfg.main(AppCfg.java:53) com.google.appengine.tools.admin.AdminException: Unable to upload app: Error posting to URL: http://appengine.google.com/api/datastore/index/add?app_id=voucherapp... 500 Internal Server Error Server Error (500) A server error has occurred. at com.google.appengine.tools.admin.AppAdminImpl.update (AppAdminImpl.java:59) at com.google.appengine.tools.admin.AppCfg$UpdateAction.execute (AppCfg.java:504) at com.google.appengine.tools.admin.AppCfg.init(AppCfg.java:129) at com.google.appengine.tools.admin.AppCfg.init(AppCfg.java:57) at com.google.appengine.tools.admin.AppCfg.main(AppCfg.java:53) Caused by: java.io.IOException: Error posting to URL: http://appengine.google.com/api/datastore/index/add?app_id=voucherapp... 500 Internal Server Error Server Error (500) A server error has occurred. at com.google.appengine.tools.admin.ServerConnection.send (ServerConnection.java:143) at com.google.appengine.tools.admin.ServerConnection.post (ServerConnection.java:81) at com.google.appengine.tools.admin.AppVersionUpload.send (AppVersionUpload.java:415) at com.google.appengine.tools.admin.AppVersionUpload.updateIndexes (AppVersionUpload.java:143) at com.google.appengine.tools.admin.AppVersionUpload.doUpload (AppVersionUpload.java:120) at com.google.appengine.tools.admin.AppAdminImpl.update (AppAdminImpl.java:53) ... 4 more I did not modify my indexes in any way. Before deleting them, I was able to upload the very same file I'm now trying to upload. I tried removing stuff from the datastore-indexes.xml in order to see if I could upload only one index. So I cannot upload even the following sample file: !-- Indices written
[google-appengine] Re: Stuck Index
Hello Romain, I'm guessing that the problem was that your index had not yet completed building since it had just been uploaded. Are you still seeing the same error? Thank you, Jeff On Sun, Sep 20, 2009 at 12:46 PM, Romain hippe...@bellsouth.net wrote: My app is: http://appengine.google.com/datastore/indexes?app_id=romanhippoversion_id=1 My code works fine on my local machine. (I am using the eclipse plugin for 3.4) I have the index in my datastore.indexes.xml ?xml version=1.0 encoding=utf-8? datastore-indexes autoGenerate=true datastore-index kind=UserEntity ancestor=false source=auto property name=email direction=asc/ property name=nickName direction=desc/ /datastore-index /datastore-indexes The query I am trying to make is: ... pm = PMF.get().getPersistenceManager(); query = pm.newQuery(UserEntity.class); query.setFilter(email == userID); query.setOrdering(nickName desc); query.declareParameters(String userID); users = (ListUserEntity)query.execute(userID); ... The stack trace is: 68.218.232.159 - - [20/Sep/2009:12:33:16 -0700] POST /romanhippo/ login HTTP/1.1 500 113 http://romanhippo.appspot.com/romanhippo/ 1634924FD7067EEAACF95164045F509B.cache.html Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US) AppleWebKit/532.0 (KHTML, like Gecko) Chrome/ 3.0.195.21 Safari/532.0,gzip(gfe) romanhippo.appspot.com E 09-20 12:33PM 16.673 javax.servlet.ServletContext log: Exception while dispatching incoming RPC call com.google.gwt.user.server.rpc.UnexpectedException: Service method 'public abstract com.rch.romanhippo.client.persistence.UserEntity com.rch.romanhippo.client.logon.LoginService.createUser (com.rch.romanhippo.client.persistence.UserEntity) throws com.rch.romanhippo.client.logon.DuplicateUsersException,com.rch.romanhippo.client.logon.DuplicateNickNameException' threw an unexpected exception: com.google.appengine.api.datastore.DatastoreNeedIndexException: no matching index found. at com.google.gwt.user.server.rpc.RPC.encodeResponseForFailure (RPC.java:360) at com.google.gwt.user.server.rpc.RPC.invokeAndEncodeResponse (RPC.java:546) at com.google.gwt.user.server.rpc.RemoteServiceServlet.processCall (RemoteServiceServlet.java:166) at com.google.gwt.user.server.rpc.RemoteServiceServlet.doPost (RemoteServiceServlet.java:86) at javax.servlet.http.HttpServlet.service(HttpServlet.java:713) at javax.servlet.http.HttpServlet.service(HttpServlet.java:806) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java: 487) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter (ServletHandler.java:1093) at com.google.apphosting.runtime.jetty.SaveSessionFilter.doFilter (SaveSessionFilter.java:35) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter (ServletHandler.java:1084) at com.google.apphosting.utils.servlet.TransactionCleanupFilter.doFilter (TransactionCleanupFilter.java:43) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter (ServletHandler.java:1084) at org.mortbay.jetty.servlet.ServletHandler.handle (ServletHandler.java:360) at org.mortbay.jetty.security.SecurityHandler.handle (SecurityHandler.java:216) at org.mortbay.jetty.servlet.SessionHandler.handle (SessionHandler.java:181) at org.mortbay.jetty.handler.ContextHandler.handle (ContextHandler.java:712) at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java: 405) at com.google.apphosting.runtime.jetty.AppVersionHandlerMap.handle (AppVersionHandlerMap.java:237) at org.mortbay.jetty.handler.HandlerWrapper.handle (HandlerWrapper.java:139) at org.mortbay.jetty.Server.handle(Server.java:313) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java: 506) at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete (HttpConnection.java:830) at com.google.apphosting.runtime.jetty.RpcRequestParser.parseAvailable (RpcRequestParser.java:76) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:381) at com.google.apphosting.runtime.jetty.JettyServletEngineAdapter.serviceRequest (JettyServletEngineAdapter.java:139) at com.google.apphosting.runtime.JavaRuntime.handleRequest (JavaRuntime.java:235) at com.google.apphosting.base.RuntimePb$EvaluationRuntime $6.handleBlockingRequest(RuntimePb.java:4950) at com.google.apphosting.base.RuntimePb$EvaluationRuntime $6.handleBlockingRequest(RuntimePb.java:4948) at com.google.net.rpc.impl.BlockingApplicationHandler.handleRequest (BlockingApplicationHandler.java:24) at com.google.net.rpc.impl.RpcUtil.runRpcInApplication(RpcUtil.java: 359) at
[google-appengine] Re: Indexes Stuck
Hi pdub, I've moved these indexes to the error state so it should now be possible to vacuum then and reupload. Happy coding, Jeff On Sep 17, 6:19 pm, pdub pwj...@gmail.com wrote: appid: bidtective Hello, My indexes seem to have gotten stuck building. I don't actually have any data in my datastore at the moment, but they've been building for several hours. I tried uploading an index.yaml with no indexes defined and then vacuuming, but that didn't remove the stuck indexes. Any suggestions on what to do? Thanks, --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: index stuck, doesn't work
Hi Kazuho, I've set the state of the stuck indexes to error for twitrackbacktest so that they can be removed. I'm still looking into possible issues in echofonsync. Thank you, Jeff On Fri, Sep 18, 2009 at 10:23 AM, Kazuho Okui kaz...@gmail.com wrote: Hi I have 2 instance. app_id: twitrackbacktest Indexing stuck. Building / deleting index stuck. it takes almost 2weeks. app_id: echofonsync index of 'updated_at' is somehow broken. Following query always returns datastore_errors.timeout SELECT * FROM Users ORDER BY updated_at related query also causes error even I re-create index. SELECT * FROM User ORDER BY updated_at,device_token It's very odd, but if I add 'desc' to updated_at, it works. SELECT * FROM User ORDER BY updated_at desc Other indexes works fine. SELECT * FROM User ORDER BY user_id SELECT * FROM User ORDER BY username ... - Kazuho --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Is 'date' a GQL reserved word and therefore is problematic to use as a property name?
The property name date isn't listed in the list of reserved names: http://code.google.com/appengine/docs/python/datastore/modelclass.html#Disallowed_Property_Names If you wouldn't mind filing an issue I think that would be best. We'll reproduce and determine if it is a GQL issue or something that should be added to the documentation. Thank you, Jeff On Wed, Sep 16, 2009 at 8:58 PM, gae123 pa...@gae123.com wrote: Up to recently, in order to support pagination, for every non unique property say 'foo' I would also have a 'foo_index'. On put() I would set the 'foo_index' to a string value that had the same sort properties as 'foo' but was unique. All nice and fine, this had been described elsewhere, and does work. Now with the introductions of __key__queries it has been pointed out that there is a better way to do pagination and avoid the wasted 'foo_index' space, the extra work on update and the complex code. So I have been retiring the 'foo_index' fields. This also means that my queries that used to be: 'SELECT * ORDER BY foo_index' became 'SELECT * ORDER BY foo' Well, all this worked fine until during testing I realized that a few of the queries would return no results. Troubleshooting, led me to the conclusion that if the property name is 'date' then queries silently fail and return empty!!! I think I narrowed this down to the use of 'date' as field in the query (in particular I think is 'ORDER BY date' part). Now, calling a property 'date' is bad for other reasons so I renamed my fields and worked around the problem. I am curious, is what I report a bug or a feature (ie is date a reserved word in GQL)? Thanks --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Problems adding developer to app
Hello Murray, When I tried to look up your account a few days ago, I was unable to find it but now I can - so I think that an invite should now work. Could you ask your friend to re-invite you? Please let me know how it goes, Jeff On Thu, Sep 17, 2009 at 7:18 AM, murraybiscuit murraybisc...@gmail.comwrote: Yeah, I can sign in. On Sep 16, 11:28 pm, Jeff S (Google) j...@google.com wrote: Hi Murray, Are you able to sign in to App Engine? http://appengine.google.com Thank you, Jeff On Tue, Sep 15, 2009 at 8:40 AM, murraybiscuit murraybisc...@gmail.com wrote: Hi there. A friend and myself are collaborating on a project. He sent a developer activation link to my gmail address, which I clicked on. Unfortunately the page that loaded said Unauthorized. You are not authorized to access this application. I've read through the body of the mail and it just says that I have to click the link, sign in and off we go. Suggestions? App name is sa-voice-drop-box. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Error on update. Ask for email 3 times and then... 401 authentication error
Would you mind sending me the app IDs for these applications. I'm also curious what the app auth settings are for these apps and what domain the account is in (for the second report, I saw gmail for the first). Thank you, Jeff 2009/9/13 m4spam m4s...@gmail.com Got the same error. Is there any solution? On 8 сен, 17:51, Lecter23 lecte...@gmail.com wrote: Hi. This is the log of the update: Initiating update. Email: x...@gmail.com Password for x...@gmail.com: Saving authentication cookies to C:\Documents and Settings \Administrador/.appcfg_cookies Email: x...@gmail.com Password for x...@gmail.com: Saving authentication cookies to C:\Documents and Settings \Administrador/.appcfg_cookies Email: x...@gmail.com Password for x...@gmail.com: Saving authentication cookies to C:\Documents and Settings \Administrador/.appcfg_cookies 2009-10-08 19:25:20,671 ERRORappcfg.py:1334 An unexpected error occurred. Aborting. Error401: --- begin server output --- Must authenticate first. --- end server output --- The login credentials are ok, and after the password and after saving the cookies, it ask for email once again. Any idea? Thanks! --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: filter on entries from a certain user
Hi Peter,
One way to gurantee that the owner property is set and not None would be to
make the URL require login in your app.yaml file (not sure if this will work
for you), you could also check before creating the entity by calling
get_current_user(). Do you need to use the generic view?
To query on owner, you could pass a User object into the GQL query or
filter, for example see
http://code.google.com/appengine/docs/python/datastore/queryclass.html#Query_filter
query.filter('owner = ', users.get_current_user())
or in GQL
(... WHERE owner = :1 ..., users.get_current_user(), ...)
Happy coding,
Jeff
On Sat, Sep 12, 2009 at 4:18 PM, Peter Newman
peter.newman@googlemail.com wrote:
Guys -
I have a class
class Contact(db.Model):
person = db.ReferenceProperty(Person)
contact_date = db.DateTimeProperty(auto_now_add=True)
remarks = db.TextProperty()
owner = db.UserProperty(auto_current_user_add=True)
however if i add an record in Django with the generic view the field
owner stays blank?
Second if i next want to filter on entries from a certain user. How
would i do that?
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---
[google-appengine] Re: 500 severe error Question!
Hi Cody, Could you send us the full stack trace and show more of your code? I imagine that the exception is actually cause further on in your example. Thank you, Jeff On Mon, Sep 14, 2009 at 6:45 PM, CODY rockcody...@hotmail.com wrote: hello,everyone! the data i put in datastore follows: User: ID/Name Date user 4029 2009-09-09 00:57:40.532377 cody and i would like to do the following: q = db.GqlQuery(SELECT * FROM User WHERE Date date(2009,09,10)) result = q.fetch(5) or: q = db.GqlQuery(SELECT * FROM User WHERE Date :1,date(2009,09,10)) result = q.fetch(5) The idea is to find a row that has been stored earlier... but every time i get a 500 severe error... type 'exceptions.TypeError': 'module' object is not callable Traceback (most recent call last): How can I solve this?? Thanks in advance,CODY --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Problems adding developer to app
Hi Murray, Are you able to sign in to App Engine? http://appengine.google.com Thank you, Jeff On Tue, Sep 15, 2009 at 8:40 AM, murraybiscuit murraybisc...@gmail.comwrote: Hi there. A friend and myself are collaborating on a project. He sent a developer activation link to my gmail address, which I clicked on. Unfortunately the page that loaded said Unauthorized. You are not authorized to access this application. I've read through the body of the mail and it just says that I have to click the link, sign in and off we go. Suggestions? App name is sa-voice-drop-box. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: data viewer couldn't retrieve list of Kinds
Hi kostmo and Sebastjan, Could you send me the app IDs where you are seeing this? I imagine that the problem is the admin console is timing out when attempting to introspect a list of kinds used in your app. This has happened to a few apps before and is more likely where there is a large number of kinds and they are added all at once (not incrementally). Since you mentioned a recent bulk upload, this would be my first guess as to the cause. If I know the app ID I can look into it. Cheers, Jeff On Wed, Sep 9, 2009 at 4:04 AM, Sebastjan Trepca tre...@gmail.com wrote: This exact thing has happened to me too after bulk uploading. What's the problem? Sebastjan On Sep 6, 5:37 pm, kostmo kos...@gmail.com wrote: When I click on the Data Viewer in the production console, I keep getting the message Oops! We couldn't retrieve your list of Kinds. This has happened often, for extended periods, over the past several days while I'm trying to bulk upload/delete. What specific conditions would cause this error, and how can it be avoided? It makes debugging difficult when the datastore cannot be examined. When I enter a GQL query in the box below the error message, I get no results for Kinds that I would expect to be in the datastore. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: I cannot get SMS verification messages again.
Hi Richie, Please fill out the SMS issues form available here: https://appengine.google.com/waitlist/sms_issues Thank you, Jeff On Tue, Sep 8, 2009 at 2:35 AM, Richie.Yan richie...@gmail.com wrote: [you have sent too many SMS verification messages.] For some reason, I try it before. I used my friends mobile, but the code is too late to send to me. I miss the time for register the appengine. So now i allways get the message[you have sent too many SMS verification messages]. Could you help me? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Billing - Alerts when nearing maximum quota?
Hi Stephen, Good question, the App Engine system does not currently notify you when your app is nearing its quota. However this is a feature request I've heard a few times. Thank you, Jeff On Sat, Sep 5, 2009 at 5:27 PM, Stephen Mayer stephen.ma...@gmail.comwrote: I'm nowhere near the point where I even need to use billable usage ... but does Google send an alert when you near the point of exceeding your daily quota based on the amount set in your billing account? If you were slashdotted or mentioned on the major news networks you would want to increase your billing settings pronto to prevent your site from going down. Just curious if anyone has addressed this issue. Stephen --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: SMS Account Verification
Hi Mark, Since you aren't able to reuse your mobile phone number at the moment, I think your best bet is to fill out this form: https://appengine.google.com/waitlist/sms_issues Your new account should be enabled in a day or two, please let me know if it is not. Thank you, Jeff On Mon, Sep 7, 2009 at 1:39 AM, MarkC m...@markcane.com wrote: The phone number has been sent too many messages or has already been used to confirm an account Is there any way around this issue? I used my own mobile number for a project on behalf of my prior employer, now I want to develop my own app and I can't get past the above... Help please. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Regarding developer guides
Hi anu, A good place to start might be the developer guide tutorial: http://code.google.com/appengine/docs/java/gettingstarted/introduction.html Also, there are several demo applications included with the SDK or avilable to checkout using subversion here: http://code.google.com/p/googleappengine/source/browse/#svn/trunk/java/demos http://code.google.com/p/googleappengine/source/checkout Happy coding, Jeff On Mon, Sep 7, 2009 at 2:41 AM, anu anunimmala.nimm...@gmail.com wrote: HI I was new to google appengine application development ,so i want some developer guides which guide me through various sample applications developed using googleappengine with java using eclipse IDE Environment.So provide me with developer guides. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: 500 Server Error caused by HardDeadlineExceededError from javax.persistence.Persistence.createEntityManagerFactory
Hello cyc, The HardDeadlineExceededError is raised when your app attempts to continue executing after the 30 second time limit for a single request to return a result. It looks like you may need to chop up the work you are trying to do into smaller chunks to allow each segment to execute in less than 30 seconds. Once the work is divided up, you can sometimes even perform requests in parallel (depending on what you are trying to accomplish). Without knowing any specifics about your app it's difficult to give good advice, but I know quite a few apps have used the task queue to segment and defer long running work, so that might be a good place to start. Thank you, Jeff On Tue, Sep 8, 2009 at 9:10 PM, cyc chenyingchun...@gmail.com wrote: My application id is cygpia. Now I often get 500 Server Error. Here is the stack trace: rror for / com.google.apphosting.runtime.HardDeadlineExceededError: This request (c1483d87bde4acaf) started at 2009/09/09 03:56:22.521 UTC and was still executing at 2009/09/09 03:56:51.920 UTC. at com.google.appengine.runtime.Request.process-0882f1d4d491af52 (Request.java) at sun.reflect.ReflectionFactory.copyField(Unknown Source) at java.lang.Class.copyFields(Unknown Source) at java.lang.Class.getDeclaredFields(Unknown Source) at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.datanucleus.metadata.ClassMetaData.addMetaDataForMembersNotInMetaData (ClassMetaData.java:355) at org.datanucleus.metadata.ClassMetaData.populate(ClassMetaData.java: 199) at org.datanucleus.metadata.MetaDataManager$1.run (MetaDataManager.java:2317) at java.security.AccessController.doPrivileged(AccessController.java: 34) at org.datanucleus.metadata.MetaDataManager.populateAbstractClassMetaData (MetaDataManager.java:2311) at org.datanucleus.metadata.MetaDataManager.populateFileMetaData (MetaDataManager.java:2148) at org.datanucleus.metadata.MetaDataManager.initialiseFileMetaDataForUse (MetaDataManager.java:864) at org.datanucleus.metadata.MetaDataManager.loadPersistenceUnit (MetaDataManager.java:794) at org.datanucleus.jpa.EntityManagerFactoryImpl.initialisePMF (EntityManagerFactoryImpl.java:488) at org.datanucleus.jpa.EntityManagerFactoryImpl.init (EntityManagerFactoryImpl.java:355) at org.datanucleus.store.appengine.jpa.DatastoreEntityManagerFactory.init (DatastoreEntityManagerFactory.java:63) at org.datanucleus.store.appengine.jpa.DatastorePersistenceProvider.createEntityManagerFactory (DatastorePersistenceProvider.java:35) at javax.persistence.Persistence.createFactory(Persistence.java:172) at javax.persistence.Persistence.createEntityManagerFactory (Persistence.java:112) at javax.persistence.Persistence.createEntityManagerFactory (Persistence.java:66) --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Over Quota: Datastore Indices Count
Hi James, This has been resolved for vhac. Thank you, Jeff On Wed, Sep 9, 2009 at 12:07 AM, james james.r...@gmail.com wrote: Hello - I am also experiencing the same issue. After updating my app (app-id: vhac) the dashboard is reported that I am exceeding quota at 100% for the datastore indices count. Can you reset the quota? Thanks -James On Aug 11, 3:52 am, Nick Johnson (Google) nick.john...@google.com wrote: I've reset quotas for me-trics and labpixiesdata. I can't reset NiklasRTZ's index quota, since he didn't provide an App ID. -Nick Johnson On Tue, Aug 11, 2009 at 7:24 AM, Guy Rutenbergg...@labpixies.com wrote: Hi Jeff, We are experiencing the same issue with app-id: labpixiesdata. It reportsDatastoreIndicesCountis 100 of 100, while the index page only lists 3 indexes and our entities are small without many properties. I don't think we did an index vacuum (at least not recently). I would appreciate if you could look at it and sort it out. Also would you be able to say how can we avoid this situation at all? Thanks, Guy On Jun 30, 3:05 am, Jeff S (Google) j...@google.com wrote: Hi Thomas, I've rest this quota, apologies for the delay. Thank you, Jeff On Sun, Jun 28, 2009 at 8:03 PM, Thomas McKay -www.winebythebar.com thomasfmc...@gmail.com wrote: Dashboard says over quota onindicesagain. No updates or vacuums today. App: winebythebar On Jun 23, 12:46 pm, Jeff S (Google) j...@google.com wrote: Hi Thomas, I've reset the indexcount, apologies for the inconvenience. Happy coding, Jeff On Tue, Jun 23, 2009 at 9:12 AM, Thomas McKay - www.winebythebar.com thomasfmc...@gmail.com wrote: My app is getting Your application is exceeding a quota:Datastore IndicesCount after a vacuum. Could I get a reset ofindicescount please? App: winebythebar On May 23, 11:50 pm, fedestabile stabile.feder...@gmail.com wrote: Thanks Jeff, it's working fine now :) Cheers, Fred On May 20, 5:48 am, Jeff S (Google) j...@google.com wrote: Fred, I've reset the indexcountso you should be all set. Kaspars I've reset the indexquotaforyourapp as well and it looks like you had some indexes which were stuck in the building state so I've moved them to error. Happy coding, Jeff On May 19, 2:11 am, kaspars...@gmail.com kaspars...@gmail.com wrote: I've only 8 indexes at the moment and I'm also getting Your applicationisexceedingaquota:DatastoreIndicesCount. The applicationis basically stuck for couple days. Could you please reset thequota, app ID is lasi2. Thanks, Kaspars -- Nick Johnson, Developer Programs Engineer, App Engine --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Queue Rate
With the recent release of 1.2.5 we did increase the quota limits for task queue execution. Do the new limits work for you? If not, please let us know as these limits are not currently set in stone. Happy coding, Jeff On Thu, Sep 3, 2009 at 10:43 AM, vivpuri v...@vivekpuri.com wrote: In my queue.yaml i defined couple of new queues, besides the existing default queue. For each of these new queues i tried setting the rate to 10/s. On uploading the app i received an error that my rate was 20.0, whereas the max allowed is 10/s. Would this limitation be removed when appengine goes live with billable tasks/queues? Also current this limitation does not throw any error anywhere on localhost. Or maybe it does but i dont know where to look for. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Deploy Application From Code
Hi Wadja, Yes this should be technically possible, you could duplicate the SDK's appcfg to uploads the app but this is not currently documented. Cheers, Jeff On Thu, Sep 3, 2009 at 7:54 AM, Wadja oua...@gmail.com wrote: Hé, It is possible to deploy application to cloud from code(Java). thanks --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: can you use contacts API within an AppEngine app?
Yes you can call the contacts API (and any other Google Data API) using the gdata-python-client. There are a couple of articles which document how to use these libraries http://code.google.com/appengine/articles/gdata.html http://code.google.com/appengine/articles/more_google_data.html Thank you, Jeff On Wed, Sep 2, 2009 at 11:17 PM, Graham Charles grahampchar...@gmail.comwrote: Can I import gdata.contacts.service into an AppEngine app to work with contacts of the app's domain? I realize that google.appengine.api.user exposes some read-only access to a user's e-mail and name, but I'd like to be able to update contacts, forwarding addresses, etc., given an administrator's login. It seems like a call to gdata.contacts.service.ContactsService() Wouldn't work from within an app's sandbox... but I may be wrong? Thanks, g. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Adding MultiUserChat to the all new XMPP support :)
Hello nah0y, Sounds like a good feature request. Would you mind adding it here? http://code.google.com/p/googleappengine/issues/list Thank you, Jeff On Fri, Sep 4, 2009 at 1:55 AM, nah0y hadjedjyo...@gmail.com wrote: In order to respond to the article on your blog : http://googleappengine.blogspot.com/2009/09/app-engine-sdk-125-released-for-python.html I have a particular request :) Can you implement the MultiUserChat protocol on future updates ? http://xmpp.org/extensions/xep-0045.html This would be very very usefull ! --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: CPU Quota
Hi Cornel, One possible cause that the data upload might be more expensive the second time around is if you had created indexes after the initial upload. If you have a large amount of data and your application is not yet being used, it is often best to upload the data, then create indexes. The index creation time might be longer, but you'll save on API CPU cost. This is just one possibility, I think I'd need to know more about your application. Thank you, Jeff On Tue, Sep 1, 2009 at 9:05 AM, Cornel corneliu.lupu...@gmail.com wrote: Hello! I tried to upload my database from a *.csv file using the appcfg.py tool. The file has about 35MB. The first time i uploaded (several weeks ago) it consumed about 70% CPU Quota. Later i deleted the database. Today i tried to upload again, but the quota got 95% and it only uploaded about half of the database. (I also got a lot of HTTPError: HTTP Error 403: Forbidden errors). My question is, where does the difference in CPU Quota come from (considering it was the same script and the same input file) ? --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Problem with filling sms issue
If the waitlist SMS issues form redirects you to the applications overview, then it sounds like your account can now create applications. Cheers, Jeff On Mon, Aug 31, 2009 at 2:15 AM, Sergey Okhotny okho...@gmail.com wrote: I'm trying to fill this form If you are unable to verify your account using SMS, please fill out the this form (https:// appengine.google.com/waitlist/sms_issues) But after authorizing it redirects me to create application form. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Problem: Accidently deleted an index
It had been more than a day and this index was still building so I've moved it to error. Cheers, Jeff On Aug 31, 11:40 am, Jeff S (Google) j...@google.com wrote: Hi Navin, It looks like deletion has completed as I no longer see any indexes still in the deleting state for this app. I do see one building at the moment though. How long has it been running, does it need to be unstuck? Happy coding, Jeff On Fri, Aug 28, 2009 at 6:34 PM, navku...@gmail.com navku...@gmail.comwrote: Hello my app id is 267526273, and I accidently deleted 2 indexes, which have now been stuck in Deleting for a while. Is it possible to reset these indexes, so I can build them again. Or actually get them back. I don't mind, just want the fastest possible resolution to the issue. Thanks, Navin --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: building indexes stucked - urgently need help
Hello, I've reset the index quota for a-global-mind and errored out the stuck indexes. It looks like though that this app has 100 indexes, which is the default limit. Will some of these indexes be removed or do you need all 100 (or more)? Since you created a-global-mind-vtora to work around this issue, should I reset quota and error the indexes for this app or can I just leave as is? Thank you, Jeff On Aug 31, 8:31 am, pmilosev pmilo...@gmail.com wrote: Hi My application indexes are 'BUILDING' for longer then two days. Can someone @GOOGLE help me fixing this. My application is 'a-global-mind' ... it has some of the indexes built earlier but the one I started two days ago are still not finished. I also tried creating a new application 'a-global-mind-vtora' where I tried to build all indexes from scratch but no success. I need this application urgently since it is part of a client-server app that will take the part on the ADCII chalenge (the submission site closes today and I NEED to know which application URL to use). any help ??? regards --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Building indexes stucked
I've errored the indexes for these three apps. In order to recreate them you'll need to use the vaccum_indexes command and reupload them. In general, it is best to wait for index creation/deletion to finish before uploading new indexes. As to your last question if you have an app which you do not plan to use anymore, uploading an empty project is the recommended approach for now. Cheers, Jeff On Sun, Aug 30, 2009 at 12:03 AM, JcOaCrO jcoa...@gmail.com wrote: the id's are : mit-fb , the-end , need-have the first two have the same app installed. I was just testing some apps i am not experienced so maby i made a mistake. Is there a problem if I upload new version or some other app while the indexes are building? Does uploading an empty project deletes the indexes and files? Sorry for the questions i hope i'll not mess again. On Aug 29, 7:50 pm, Jeff S (Google) j...@google.com wrote: Index building will usually take at most 24 hours (usually much less than that) so since it has been two days these index tasks will likely need to be errored out by one of us Googlers. I imagine the issue here was the high index building latency that we experienced yesterday which resulted in a few stuck jobs. If you tell me your app ID I will error these out for you so that you can vacuum and recreate them. Thank you, Jeff On Sat, Aug 29, 2009 at 1:53 AM, JcOaCrO jcoa...@gmail.com wrote: Hi ! i was trying to test bloog on appengine and seems building indexes is stucked like 2 days. I tried automatic index building on a new app and that one is stucked. How can this be resolved and what's the averadge time to build indexes? Thanks --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: ClientLogin and prompt for username/password
Hi SolidRoot, Sounds interesting. After reading your post though, I'm not sure what the problem is specifically. Are you receiving an error? Thank you, Jeff On Thu, Aug 27, 2009 at 12:07 AM, SolidRoot ernest.sur...@gmail.com wrote: Hi there, I need to use the GData API to add a post to a blog. Always the same blog, always the same user (whose credentials I happen to have, since they are my own). I've gotten this working, except for one thing: when I request the page that does this and the logic runs, I am prompted for my Google credentials anyways. Since I don't want the user of my app to be bothered with this (I am guessing it doesn't matter WHO authenticates, as long as someone does), I'd like to figure out how to stop this behaviour... The code that does the logging in is this: # Authenticate using ClientLogin. service = gdata.service.GDataService(email, password) service.source = 'GAE App' service.service = 'blogger' service.server = 'www.blogger.com' gdata.alt.appengine.run_on_appengine(service, store_tokens=False, single_user_mode=True) service.ProgrammaticLogin() Has anyone run into this problem? Is there a solution? Thanks! --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Static Files
Hi Scottish, One way that I've seen this done is to define a servlet which uses the JSP file as follows: getServletContext().getRequestDispatcher(/something.jsp). forward(req, resp); You can then add a mapping in web.xml to send requests for the .html page to this servlet. I'm sure there are more ways to go about this... Thank you, Jeff On Thu, Aug 27, 2009 at 2:25 PM, Scottish scott.ashf...@gmail.com wrote: I am using java server side. I am curious if there is anyway to have pretty urls (for example www.example.com/home) point to a static home.html (so no .html in the url) . I would like to do this without converting home.html to a jsp file. Thanks. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: high variance in cpu_ms for same GET URL data, constant api_cpu_ms
Hi Jeff On Fri, Aug 28, 2009 at 1:08 AM, Jeff Enderwick jeff.enderw...@gmail.comwrote: Trolling my logs, I'm coming across cases where there is extreme (~10x) variance in cpu_ms for the exact same code flow, same GET URL and same data (not even any intervening writes to the datastore). I am logging my db.* function accesses, and I have factored out memcache too. For example: 92ms, 142cpu_ms, 74api_cpu_ms, followed by: 965ms, 1500cpu_ms, 74api_cpu_ms Q1: what could cause such a whopping delta? I am using Django, so perhaps template compilation? I used cprofile on the SDK with a similar data/result set, and the first page served was maybe ~2x subsequent pages in total time. Thoughts? Your idea of template compilation is along the same lines as my thinking. I can't say difinitively for this case but I would guess that you might be seeing a more expensive first request when a new instance of you app is being spun up. Q2: I am assuming the 1st number after the '200' is the wall-clock time-to-server. As the app is single threaded ... how is it able to burn 1500ms less 74ms in only 965ms? Most API calls make calls to distributed services which parallelize work across multiple machines, so it often easy to use more CPU time than wall clock time. If you want to see where the CPU usage is coming from, you can get information about CPU quota levels at any point within your code as documented here: http://code.google.com/appengine/docs/quotas.html#Monitoring_CPU_Usage_in_a_Request Thank you, Jeff Thanks! --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: upload application
Hi Steven, Do the two accounts that you mentioned share the same email address? Thank you, Jeff On Thu, Aug 27, 2009 at 8:18 PM, Steven Etzkorn stetzk...@gmail.com wrote: I have 6 applications on google appengine. So I have install applications before. I am attempting to upload my third application to stetzkorn3.appspot.com. I was able to login to the console and create the application name: stetzkorn3. When I go to upload my new application I am told I don't have permissions. But I do. I am missing something. I do have two google gmail accounts. One I use for my company email and the other for developing application. Could this be a problem? This is very frustrating. Thanks for your help. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Accidentally Deleted all my INDEXES :(
Hi Arun, Your app was over quota for datastore index count. I've reset this so you should be able to proceed. Thank you, Jeff On Sun, Aug 30, 2009 at 6:43 PM, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, I am still getting the server 500 error. Uploading index definitions. Error 500: --- begin server output --- Server Error (500) A server error has occurred. --- end server output --- Was the issue shown in the App engine status fixed? The status there has not been updated. Thanks, Arun Shanker Prasad. On Aug 29, 2:17 pm, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi Jeff, Thank you Jeff for the update. I just now tried to update the indexes and i am still getting the 500 server error. Thanks, Arun Shanker Prasad. On Aug 29, 3:53 am, Jeff S (Google) j...@google.com wrote: Jeff On Aug 28, 1:16 pm, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, Thank You Jeff for the quick response. I will wait for the status to return to normal before I try to upload again. Thanks a bunch to You and Nick for the help :D :D Thanks, Arun Shanker Prasad. On Aug 29, 1:04 am, Jeff S (Google) j...@google.com wrote: Index creation and deletion is slow at the moment, so uploading new indexes may not currently be possible. We've posted a notice on the status site, apologies: http://code.google.com/status/appengine -Jeff On Aug 28, 12:14 pm, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi Jeff, Thank You for removing the indexes. I tried to upload the old indexes one at a time, but I get the following error after I run the appcfg.py Uploading index definitions. Error 500: --- begin server output --- Server Error (500) A server error has occurred. --- end server output --- Last time I uploaded a whole bunch which seemed to get stuck. Thanks, Arun Shanker Prasad. On Aug 29, 12:09 am, Jeff S (Google) j...@google.com wrote: The indexes have now been deleted for this app. Thank you, Jeff On Fri, Aug 28, 2009 at 9:56 AM, Jeff S (Google) j...@google.com wrote: It looks like your indexes are all in the deleting state, I'll keep you posted. On Fri, Aug 28, 2009 at 7:57 AM, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, Bump, any one to help me? Thanks, Arun Shanker Prasad. On Aug 28, 5:37 pm, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, Any updates? Almost 24 hours now :( and the indexes are still stuck in the building state. Please have a look. Thanks, Arun Shanker Prasad. On Aug 28, 6:42 am, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi Jeff, Still no updates? My indexes are still stuck building. Thanks, Arun Shanker Prasad. On Aug 28, 2:27 am, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, I have sent the app id as a mail, please let me know when you have tracked anything down. Thanks, Arun Shanker Prasad. On Aug 28, 2:07 am, Jeff S (Google) j...@google.com wrote: Hello, I'd be happy to help but I'm having a tough time tracking down the app ID that this is for. What is your app ID? Thank you, Jeff On Thu, Aug 27, 2009 at 11:56 AM, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, I tried to upload indexes I deleted but they seem to be stuck in the Building state. I think this is similar to the problem I had earlier, since I think I uploaded the same indexes again, my mistake :( http://groups.google.com/group/google-appengine/browse_thread/thread/... A day full of mistakes Any help will be GREATLY appreciated. Thanks, Arun Shanker Prasad. On Aug 27, 7:54 pm, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, Oh I was afraid that would be the answer :( By the time I saw your reply all my indexes were already deleted. Trying to track down all the past backups to get the indexes :( The 'a' option SHOULD really be REMOVED :( :( Thanks, Arun Shanker Prasad. On Aug 27, 7:41 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Arun, I'm afraid your only
[google-appengine] Re: Problem: Accidently deleted an index
Hi Navin, It looks like deletion has completed as I no longer see any indexes still in the deleting state for this app. I do see one building at the moment though. How long has it been running, does it need to be unstuck? Happy coding, Jeff On Fri, Aug 28, 2009 at 6:34 PM, navku...@gmail.com navku...@gmail.comwrote: Hello my app id is 267526273, and I accidently deleted 2 indexes, which have now been stuck in Deleting for a while. Is it possible to reset these indexes, so I can build them again. Or actually get them back. I don't mind, just want the fastest possible resolution to the issue. Thanks, Navin --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: error logs not showing full detail?
Hi peterk, What was the app ID where you were seeing this. I'd like to try to reproduce. Cheers, Jeff On Sat, Aug 29, 2009 at 10:48 AM, peterk peter.ke...@gmail.com wrote: Hey everyone, Not sure if this is a general fault or just for me, but right now my error logs seem to be alternating between showing me the full detail of the error when I expand them, and just showing a small portion of data about the request that caused the error (i.e. the user agent string i think). More often than not right now it's just showing the user agent string and not the full error. Maybe not an ideal development process, but I rely a lot on these logs to hammer out things and get things working well. Not being able to see the full error detail is slowing down my development a lot. Anyone else having this problem or is it something on my end? Any help would be appreciated. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: the status of Indexes were building for a long time.
Please let me know your app ID. It sounds like I will need to unstick them so that they can be vacuumed. Thank you, Jeff On Sun, Aug 30, 2009 at 9:56 PM, gxtiou gxt...@gmail.com wrote: the status of Indexes are building just like 5 days ago. what shoult i do. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: high variance in cpu_ms for same GET URL data, constant api_cpu_ms
Hi Jeff, Ah I see, thanks for the details. I'm looking into this, would you mind sharing which runtime you are using, and the app ID? Cheers, Jeff On Aug 31, 1:52 pm, Jeff Enderwick jeff.enderw...@gmail.com wrote: thanks - I expected that the api calls would use parallel processing, but the app/servelet itself is a single thread of execution. if I have api_cpu_ms of 74, and cpu_ms of 1500, then that gives 1426ms for the non-api (app/servelet usage), yes? I'm trying to grok how that would happen in a single thread in 965ms of wall-clock time. Jeff On Mon, Aug 31, 2009 at 11:30 AM, Jeff S (Google)j...@google.com wrote: Hi Jeff On Fri, Aug 28, 2009 at 1:08 AM, Jeff Enderwick jeff.enderw...@gmail.com wrote: Trolling my logs, I'm coming across cases where there is extreme (~10x) variance in cpu_ms for the exact same code flow, same GET URL and same data (not even any intervening writes to the datastore). I am logging my db.* function accesses, and I have factored out memcache too. For example: 92ms, 142cpu_ms, 74api_cpu_ms, followed by: 965ms, 1500cpu_ms, 74api_cpu_ms Q1: what could cause such a whopping delta? I am using Django, so perhaps template compilation? I used cprofile on the SDK with a similar data/result set, and the first page served was maybe ~2x subsequent pages in total time. Thoughts? Your idea of template compilation is along the same lines as my thinking. I can't say difinitively for this case but I would guess that you might be seeing a more expensive first request when a new instance of you app is being spun up. Q2: I am assuming the 1st number after the '200' is the wall-clock time-to-server. As the app is single threaded ... how is it able to burn 1500ms less 74ms in only 965ms? Most API calls make calls to distributed services which parallelize work across multiple machines, so it often easy to use more CPU time than wall clock time. If you want to see where the CPU usage is coming from, you can get information about CPU quota levels at any point within your code as documented here: http://code.google.com/appengine/docs/quotas.html#Monitoring_CPU_Usag... Thank you, Jeff Thanks! --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: high variance in cpu_ms for same GET URL data, constant api_cpu_ms
Nevermind, I forgot that you had mentioned Django :-) The app ID would still be helpful as well as example code if you feel comfortable sharing. Thank you, Jeff On Aug 31, 3:16 pm, Jeff S (Google) j...@google.com wrote: Hi Jeff, Ah I see, thanks for the details. I'm looking into this, would you mind sharing which runtime you are using, and the app ID? Cheers, Jeff On Aug 31, 1:52 pm, Jeff Enderwick jeff.enderw...@gmail.com wrote: thanks - I expected that the api calls would use parallel processing, but the app/servelet itself is a single thread of execution. if I have api_cpu_ms of 74, and cpu_ms of 1500, then that gives 1426ms for the non-api (app/servelet usage), yes? I'm trying to grok how that would happen in a single thread in 965ms of wall-clock time. Jeff On Mon, Aug 31, 2009 at 11:30 AM, Jeff S (Google)j...@google.com wrote: Hi Jeff On Fri, Aug 28, 2009 at 1:08 AM, Jeff Enderwick jeff.enderw...@gmail.com wrote: Trolling my logs, I'm coming across cases where there is extreme (~10x) variance in cpu_ms for the exact same code flow, same GET URL and same data (not even any intervening writes to the datastore). I am logging my db.* function accesses, and I have factored out memcache too. For example: 92ms, 142cpu_ms, 74api_cpu_ms, followed by: 965ms, 1500cpu_ms, 74api_cpu_ms Q1: what could cause such a whopping delta? I am using Django, so perhaps template compilation? I used cprofile on the SDK with a similar data/result set, and the first page served was maybe ~2x subsequent pages in total time. Thoughts? Your idea of template compilation is along the same lines as my thinking. I can't say difinitively for this case but I would guess that you might be seeing a more expensive first request when a new instance of you app is being spun up. Q2: I am assuming the 1st number after the '200' is the wall-clock time-to-server. As the app is single threaded ... how is it able to burn 1500ms less 74ms in only 965ms? Most API calls make calls to distributed services which parallelize work across multiple machines, so it often easy to use more CPU time than wall clock time. If you want to see where the CPU usage is coming from, you can get information about CPU quota levels at any point within your code as documented here: http://code.google.com/appengine/docs/quotas.html#Monitoring_CPU_Usag... Thank you, Jeff Thanks! --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: high variance in cpu_ms for same GET URL data, constant api_cpu_ms
Hello again Jeff, The CPU measurements for runtime are actually in cycles which would be performed by a 1.2 GHz processor in a second. We used to call these amounts megacycles, as described in our documentation: http://code.google.com/appengine/docs/quotas.html#Resources CPU time is reported in seconds, which is equivalent to the number of CPU cycles that can be performed by a 1.2 GHz Intel x86 processor in that amount of time. The actual number of CPU cycles spent varies greatly depending on conditions internal to App Engine, so this number is adjusted for reporting purposes using this processor as a reference measurement. For the runtime portion of your application (non API usage), the CPU is running faster than 1.2 GHz so it is possible to use more normalized CPU seconds (or megacycles if you prefer) in the amount of real time. This does seem a bit confusing though, so I'm open to ideas on how to make this more clear. Thank you, Jeff On Aug 31, 3:20 pm, Jeff S (Google) j...@google.com wrote: Nevermind, I forgot that you had mentioned Django :-) The app ID would still be helpful as well as example code if you feel comfortable sharing. Thank you, Jeff On Aug 31, 3:16 pm, Jeff S (Google) j...@google.com wrote: Hi Jeff, Ah I see, thanks for the details. I'm looking into this, would you mind sharing which runtime you are using, and the app ID? Cheers, Jeff On Aug 31, 1:52 pm, Jeff Enderwick jeff.enderw...@gmail.com wrote: thanks - I expected that the api calls would use parallel processing, but the app/servelet itself is a single thread of execution. if I have api_cpu_ms of 74, and cpu_ms of 1500, then that gives 1426ms for the non-api (app/servelet usage), yes? I'm trying to grok how that would happen in a single thread in 965ms of wall-clock time. Jeff On Mon, Aug 31, 2009 at 11:30 AM, Jeff S (Google)j...@google.com wrote: Hi Jeff On Fri, Aug 28, 2009 at 1:08 AM, Jeff Enderwick jeff.enderw...@gmail.com wrote: Trolling my logs, I'm coming across cases where there is extreme (~10x) variance in cpu_ms for the exact same code flow, same GET URL and same data (not even any intervening writes to the datastore). I am logging my db.* function accesses, and I have factored out memcache too. For example: 92ms, 142cpu_ms, 74api_cpu_ms, followed by: 965ms, 1500cpu_ms, 74api_cpu_ms Q1: what could cause such a whopping delta? I am using Django, so perhaps template compilation? I used cprofile on the SDK with a similar data/result set, and the first page served was maybe ~2x subsequent pages in total time. Thoughts? Your idea of template compilation is along the same lines as my thinking. I can't say difinitively for this case but I would guess that you might be seeing a more expensive first request when a new instance of you app is being spun up. Q2: I am assuming the 1st number after the '200' is the wall-clock time-to-server. As the app is single threaded ... how is it able to burn 1500ms less 74ms in only 965ms? Most API calls make calls to distributed services which parallelize work across multiple machines, so it often easy to use more CPU time than wall clock time. If you want to see where the CPU usage is coming from, you can get information about CPU quota levels at any point within your code as documented here: http://code.google.com/appengine/docs/quotas.html#Monitoring_CPU_Usag... Thank you, Jeff Thanks! --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Help: indexes stuck building
You'll need to use the vacuum_indexes command as described here since you have indexes which are in the error state. http://code.google.com/appengine/docs/python/tools/uploadinganapp.html#Command_Line_Arguments In order to remove all indexes, you'll need to edit you index.yaml file to contain no indexes (might be a good idea to keep a backup copy for when you want to recreate them). Thank you, Jeff On Thu, Aug 27, 2009 at 6:52 PM, luciferous neuman.v...@gmail.com wrote: Tried to vacuum, but error message is that the index doesn't exist. Tried uploading an empty project, and then re-uploading the project, but I get: Uploading index definitions. Error 500: --- begin server output --- Server Error (500) A server error has occurred. --- end server output --- Your app was updated, but there was an error updating your indexes. Please retry later with appcfg.py update_indexes. My app is 'e-drop'. Need some help here. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Building indexes stucked
Index building will usually take at most 24 hours (usually much less than that) so since it has been two days these index tasks will likely need to be errored out by one of us Googlers. I imagine the issue here was the high index building latency that we experienced yesterday which resulted in a few stuck jobs. If you tell me your app ID I will error these out for you so that you can vacuum and recreate them. Thank you, Jeff On Sat, Aug 29, 2009 at 1:53 AM, JcOaCrO jcoa...@gmail.com wrote: Hi ! i was trying to test bloog on appengine and seems building indexes is stucked like 2 days. I tried automatic index building on a new app and that one is stucked. How can this be resolved and what's the averadge time to build indexes? Thanks --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Accidentally Deleted all my INDEXES :(
It looks like your indexes are all in the deleting state, I'll keep you posted. On Fri, Aug 28, 2009 at 7:57 AM, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, Bump, any one to help me? Thanks, Arun Shanker Prasad. On Aug 28, 5:37 pm, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, Any updates? Almost 24 hours now :( and the indexes are still stuck in the building state. Please have a look. Thanks, Arun Shanker Prasad. On Aug 28, 6:42 am, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi Jeff, Still no updates? My indexes are still stuck building. Thanks, Arun Shanker Prasad. On Aug 28, 2:27 am, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, I have sent the app id as a mail, please let me know when you have tracked anything down. Thanks, Arun Shanker Prasad. On Aug 28, 2:07 am, Jeff S (Google) j...@google.com wrote: Hello, I'd be happy to help but I'm having a tough time tracking down the app ID that this is for. What is your app ID? Thank you, Jeff On Thu, Aug 27, 2009 at 11:56 AM, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, I tried to upload indexes I deleted but they seem to be stuck in the Building state. I think this is similar to the problem I had earlier, since I think I uploaded the same indexes again, my mistake :( http://groups.google.com/group/google-appengine/browse_thread/thread/... A day full of mistakes Any help will be GREATLY appreciated. Thanks, Arun Shanker Prasad. On Aug 27, 7:54 pm, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, Oh I was afraid that would be the answer :( By the time I saw your reply all my indexes were already deleted. Trying to track down all the past backups to get the indexes :( The 'a' option SHOULD really be REMOVED :( :( Thanks, Arun Shanker Prasad. On Aug 27, 7:41 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Arun, I'm afraid your only option is to recreate the indexes once they've finished deleting. If you no longer have your index.yaml, you can copy down the index definitions from the App Engine console index page in order to recreate it. -Nick Johnson On Thu, Aug 27, 2009 at 3:34 PM, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi All, I tried to vacuum out some indexes that were in the error state, I gave appcfg.py vacuum_indexes My_application During the process I missed a couple of them, I tried to give the 'a' option thinking that it was the Abort option :( :( Now all my indexes are in deleting state, its very late in my dev stage to track down all the previous indexes and upload them again. Can anyone please help me to get the indexes back, my app is down at the moment due to the missing indexes :( :( Thanks, Arun Shanker Prasad. -- Nick Johnson, Developer Programs Engineer, App Engine --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: index building stuck
Hi all, There is currently a slowdown in the processing of index changes. We're aware of the issue and will keep you updated. Apologies for the inconvenience, Jeff On Aug 28, 4:57 am, martin.kukan martinku...@gmail.com wrote: Hi, I'm using java and low level api for the datastore and after uploading incorrect index definition (I specified a column in index which doesn't exist) the index is stuck on building. I've updated the index definition with no indexes also added the missing column but nothing helps. My app id is fotomaraton-twig. Thanks for help, --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Accidentally Deleted all my INDEXES :(
The indexes have now been deleted for this app. Thank you, Jeff On Fri, Aug 28, 2009 at 9:56 AM, Jeff S (Google) j...@google.com wrote: It looks like your indexes are all in the deleting state, I'll keep you posted. On Fri, Aug 28, 2009 at 7:57 AM, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, Bump, any one to help me? Thanks, Arun Shanker Prasad. On Aug 28, 5:37 pm, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, Any updates? Almost 24 hours now :( and the indexes are still stuck in the building state. Please have a look. Thanks, Arun Shanker Prasad. On Aug 28, 6:42 am, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi Jeff, Still no updates? My indexes are still stuck building. Thanks, Arun Shanker Prasad. On Aug 28, 2:27 am, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, I have sent the app id as a mail, please let me know when you have tracked anything down. Thanks, Arun Shanker Prasad. On Aug 28, 2:07 am, Jeff S (Google) j...@google.com wrote: Hello, I'd be happy to help but I'm having a tough time tracking down the app ID that this is for. What is your app ID? Thank you, Jeff On Thu, Aug 27, 2009 at 11:56 AM, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, I tried to upload indexes I deleted but they seem to be stuck in the Building state. I think this is similar to the problem I had earlier, since I think I uploaded the same indexes again, my mistake :( http://groups.google.com/group/google-appengine/browse_thread/thread/... A day full of mistakes Any help will be GREATLY appreciated. Thanks, Arun Shanker Prasad. On Aug 27, 7:54 pm, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, Oh I was afraid that would be the answer :( By the time I saw your reply all my indexes were already deleted. Trying to track down all the past backups to get the indexes :( The 'a' option SHOULD really be REMOVED :( :( Thanks, Arun Shanker Prasad. On Aug 27, 7:41 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Arun, I'm afraid your only option is to recreate the indexes once they've finished deleting. If you no longer have your index.yaml, you can copy down the index definitions from the App Engine console index page in order to recreate it. -Nick Johnson On Thu, Aug 27, 2009 at 3:34 PM, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi All, I tried to vacuum out some indexes that were in the error state, I gave appcfg.py vacuum_indexes My_application During the process I missed a couple of them, I tried to give the 'a' option thinking that it was the Abort option :( :( Now all my indexes are in deleting state, its very late in my dev stage to track down all the previous indexes and upload them again. Can anyone please help me to get the indexes back, my app is down at the moment due to the missing indexes :( :( Thanks, Arun Shanker Prasad. -- Nick Johnson, Developer Programs Engineer, App Engine --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Accidentally Deleted all my INDEXES :(
Index creation and deletion is slow at the moment, so uploading new indexes may not currently be possible. We've posted a notice on the status site, apologies: http://code.google.com/status/appengine -Jeff On Aug 28, 12:14 pm, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi Jeff, Thank You for removing the indexes. I tried to upload the old indexes one at a time, but I get the following error after I run the appcfg.py Uploading index definitions. Error 500: --- begin server output --- Server Error (500) A server error has occurred. --- end server output --- Last time I uploaded a whole bunch which seemed to get stuck. Thanks, Arun Shanker Prasad. On Aug 29, 12:09 am, Jeff S (Google) j...@google.com wrote: The indexes have now been deleted for this app. Thank you, Jeff On Fri, Aug 28, 2009 at 9:56 AM, Jeff S (Google) j...@google.com wrote: It looks like your indexes are all in the deleting state, I'll keep you posted. On Fri, Aug 28, 2009 at 7:57 AM, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, Bump, any one to help me? Thanks, Arun Shanker Prasad. On Aug 28, 5:37 pm, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, Any updates? Almost 24 hours now :( and the indexes are still stuck in the building state. Please have a look. Thanks, Arun Shanker Prasad. On Aug 28, 6:42 am, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi Jeff, Still no updates? My indexes are still stuck building. Thanks, Arun Shanker Prasad. On Aug 28, 2:27 am, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, I have sent the app id as a mail, please let me know when you have tracked anything down. Thanks, Arun Shanker Prasad. On Aug 28, 2:07 am, Jeff S (Google) j...@google.com wrote: Hello, I'd be happy to help but I'm having a tough time tracking down the app ID that this is for. What is your app ID? Thank you, Jeff On Thu, Aug 27, 2009 at 11:56 AM, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, I tried to upload indexes I deleted but they seem to be stuck in the Building state. I think this is similar to the problem I had earlier, since I think I uploaded the same indexes again, my mistake :( http://groups.google.com/group/google-appengine/browse_thread/thread/... A day full of mistakes Any help will be GREATLY appreciated. Thanks, Arun Shanker Prasad. On Aug 27, 7:54 pm, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, Oh I was afraid that would be the answer :( By the time I saw your reply all my indexes were already deleted. Trying to track down all the past backups to get the indexes :( The 'a' option SHOULD really be REMOVED :( :( Thanks, Arun Shanker Prasad. On Aug 27, 7:41 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Arun, I'm afraid your only option is to recreate the indexes once they've finished deleting. If you no longer have your index.yaml, you can copy down the index definitions from the App Engine console index page in order to recreate it. -Nick Johnson On Thu, Aug 27, 2009 at 3:34 PM, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi All, I tried to vacuum out some indexes that were in the error state, I gave appcfg.py vacuum_indexes My_application During the process I missed a couple of them, I tried to give the 'a' option thinking that it was the Abort option :( :( Now all my indexes are in deleting state, its very late in my dev stage to track down all the previous indexes and upload them again. Can anyone please help me to get the indexes back, my app is down at the moment due to the missing indexes :( :( Thanks, Arun Shanker Prasad. -- Nick Johnson, Developer Programs Engineer, App Engine --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: Accidentally Deleted all my INDEXES :(
Index creation and deletion should be proceeding normally now. Cheers, Jeff On Aug 28, 1:16 pm, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, Thank You Jeff for the quick response. I will wait for the status to return to normal before I try to upload again. Thanks a bunch to You and Nick for the help :D :D Thanks, Arun Shanker Prasad. On Aug 29, 1:04 am, Jeff S (Google) j...@google.com wrote: Index creation and deletion is slow at the moment, so uploading new indexes may not currently be possible. We've posted a notice on the status site, apologies: http://code.google.com/status/appengine -Jeff On Aug 28, 12:14 pm, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi Jeff, Thank You for removing the indexes. I tried to upload the old indexes one at a time, but I get the following error after I run the appcfg.py Uploading index definitions. Error 500: --- begin server output --- Server Error (500) A server error has occurred. --- end server output --- Last time I uploaded a whole bunch which seemed to get stuck. Thanks, Arun Shanker Prasad. On Aug 29, 12:09 am, Jeff S (Google) j...@google.com wrote: The indexes have now been deleted for this app. Thank you, Jeff On Fri, Aug 28, 2009 at 9:56 AM, Jeff S (Google) j...@google.com wrote: It looks like your indexes are all in the deleting state, I'll keep you posted. On Fri, Aug 28, 2009 at 7:57 AM, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, Bump, any one to help me? Thanks, Arun Shanker Prasad. On Aug 28, 5:37 pm, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, Any updates? Almost 24 hours now :( and the indexes are still stuck in the building state. Please have a look. Thanks, Arun Shanker Prasad. On Aug 28, 6:42 am, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi Jeff, Still no updates? My indexes are still stuck building. Thanks, Arun Shanker Prasad. On Aug 28, 2:27 am, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, I have sent the app id as a mail, please let me know when you have tracked anything down. Thanks, Arun Shanker Prasad. On Aug 28, 2:07 am, Jeff S (Google) j...@google.com wrote: Hello, I'd be happy to help but I'm having a tough time tracking down the app ID that this is for. What is your app ID? Thank you, Jeff On Thu, Aug 27, 2009 at 11:56 AM, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, I tried to upload indexes I deleted but they seem to be stuck in the Building state. I think this is similar to the problem I had earlier, since I think I uploaded the same indexes again, my mistake :( http://groups.google.com/group/google-appengine/browse_thread/thread/... A day full of mistakes Any help will be GREATLY appreciated. Thanks, Arun Shanker Prasad. On Aug 27, 7:54 pm, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi, Oh I was afraid that would be the answer :( By the time I saw your reply all my indexes were already deleted. Trying to track down all the past backups to get the indexes :( The 'a' option SHOULD really be REMOVED :( :( Thanks, Arun Shanker Prasad. On Aug 27, 7:41 pm, Nick Johnson (Google) nick.john...@google.com wrote: Hi Arun, I'm afraid your only option is to recreate the indexes once they've finished deleting. If you no longer have your index.yaml, you can copy down the index definitions from the App Engine console index page in order to recreate it. -Nick Johnson On Thu, Aug 27, 2009 at 3:34 PM, Arun Shanker Prasad arunshankerpra...@gmail.com wrote: Hi All, I tried to vacuum out some indexes that were in the error state, I gave appcfg.py vacuum_indexes My_application During the process I missed a couple of them, I tried to give the 'a' option thinking that it was the Abort option :( :( Now all my indexes are in deleting state, its very late in my dev stage to track down all the previous indexes and upload them again. Can anyone please help me to get the indexes back
