[google-appengine] How to implement endpoint authentication without hardcoding client identifiers?
How can I secure endpoints with authentication using for example Google Accounts or OAuth2? Is it possible to do it at all? I read many sample in web but not found solution which allow keep user database out of code. Current solution for authentication is not sufficient for it - appengine-endpoints-helloendpoints-python https://github.com/GoogleCloudPlatform/appengine-endpoints-helloendpoints-python/blob/master/helloworld_api.py . Problem with this API is such that I need *hardcode identifiers* how to workaround it? WEB_CLIENT_ID = 'replace this with your web client application ID' ANDROID_CLIENT_ID = 'replace this with your Android client ID' IOS_CLIENT_ID = 'replace this with your iOS client ID' ANDROID_AUDIENCE = WEB_CLIENT_ID @endpoints.api(name='helloworld', version='v1', allowed_client_ids=[WEB_CLIENT_ID, ANDROID_CLIENT_ID, IOS_CLIENT_ID], audiences=[ANDROID_AUDIENCE])class HelloWorldApi(remote.Service): Helloworld API v1. I want to define allowed_client_ids dynamically with use some database not and want share API with python applications - if it possible at all. How to do it? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Please help with some hints - Implementing unicode tags (language Polish, None English, ...) with use search API.
I found some bug which not allow me to use tags with unicode names like:
http://stackoverflow.com/questions/23349600/how-to-query-atom-field-with-unicode-value-in-google-app-engine-production-searc
https://code.google.com/p/googleappengine/issues/detail?id=10861
This code not allows me to find results on production because of this bug.
*I want do some workaround but not sure how to do it - if you have some
experience please suggest something. I will try to convert 'zamówienie'
into ó = oq 'zamoqwienie' but may I can use some symbols 'zamo`wienie' or
'zam_owienie' or 'zamo1wienie'. Can you sahre some hints please?*
index = search.Index(name = 'DeleteMe')
language = None
fields = [
search.AtomField(name = 'tag', value = 'zamówienia', language = language),
search.AtomField(name = 'tag', value = 'pizza', language = language),
search.AtomField(name = 'tag2', value = 'zamówienia', language =
language),
]
document = search.Document(doc_id = 'deleteMe', fields = fields, language =
language)
index.put(document)
queryString = 'tag:zamówienia'
searchQuery = search.Query(queryString)
results = index.search(searchQuery)
messages.append('query = %s, hits = %s'
% (queryString.decode('utf8'), results.number_found))
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.
[google-appengine] Is fulltext search support unicode?
I found problem on production with such query: distance(geoLocation, geopoint(None, None)) = 5 AND tag:zamówienia internetowe Is fulltext search not support unicode on production? BTW This query works fine on SDK so I can not detect this error on SDK. https://code.google.com/p/googleappengine/issues/detail?id=10662thanks=10662ts=1394115443 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] How to make endpoints working with endpoints old_dev_appserver.py and Dart?
I do not know what need threading Dart or Endpoints. I receive simple error connection refused with old_dev_appserver.py which allow debugging - that looks like typical problem with multiple connection - GAE refuse second connection. API Explorer doesn't work if old_dev_appserver.py which allow debugging == mean :) == I see random list of Google APIs instead of requested MY API. API Explorer shows MY API with dev_appserver.py. For both I use same url. IT NOT WORKS. W dniu poniedziałek, 3 marca 2014 19:41:41 UTC+1 użytkownik Vinny P napisał: On Mon, Mar 3, 2014 at 7:02 AM, Cezary Wagner cezary...@gmail.comjavascript: wrote: http://stackoverflow.com/questions/22118196 *From your SO post:* *I try to use old_dev_appserver.py - I can debug Python whatever Dart can not connect to GAE application (looks like need threading - no idea why?). API expolorer not work.* Which needs threading, the Python dev appserver or Dart? Do you have an error message/traceback for the connection error? When you say the APIs Explorer doesn't work, how exactly does it not work? What are you expecting from it, and what is the error message (if any) coming from it? - -Vinny P Technology Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Python27 + new dev_appservery.py + debugging
Let's finish this unpractical talk - your arguments are hell quality. With Eclipse I can see whole obejct with one click and hover - forward with one key. With PDB - http://docs.python.org/2/library/pdb.html 1. I need put not need code to code - import pdb; pdb.set_trace() 2. Get variable value _ print x 3.1. Get next variable value - print x. 3. Remember to remove - import pdb; pdb.set_trace() 4. after each - import pdb; pdb.set_trace() I need continue (F8! in Eclipse) You proposing hell like a devil :) W dniu poniedziałek, 3 marca 2014 22:53:06 UTC+1 użytkownik D X napisał: From my experience, stepping through code is much slower on eclipse than pdb. I disagree with your other comments; pdb is fine for professional use on huge projects. On Sunday, March 2, 2014 3:57:22 PM UTC-8, Cezary Wagner wrote: I found some combo like Pydev 3.3.3 + Eclipse 3.8.x (but no Django templates support or Aptana!). It allow fast debugging with little slower coding. W dniu poniedziałek, 3 marca 2014 00:49:14 UTC+1 użytkownik Cezary Wagner napisał: Thanks for hints - it is not helpful. Discussion is very old and there is not clear conclusion In my opinion pdb is good for hobbists - placing break points by editing code it is good for 100 lines programs or amateurs - sadomacho :) It looks that I can not use dart, endpoints because there is no usable debugger for it :) W dniu niedziela, 2 marca 2014 17:50:44 UTC+1 użytkownik Vinny P napisał: On Sat, Mar 1, 2014 at 9:59 AM, Cezary Wagner cezary...@gmail.com wrote: What is the best tools to use dev_appserver.py with breakpoint and debugging - what is the best choice. Hi Cezary, You might want to read this forums discussion here: https://groups.google.com/forum/#!topic/google-appengine/ep5BWYKpQpU - there's an interesting discussion on Python debugging with the dev_appserver. If you're OK with debugging using pdb, you'll want to read this message in particular: https://groups.google.com/d/msg/google-appengine/ep5BWYKpQpU/41asdxKhuycJ - -Vinny P Technology Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Python27 + new dev_appservery.py + debugging
Pdb is hell - you waste time and money. In the most case simple debugger is enough and some assert use. W dniu wtorek, 4 marca 2014 04:01:57 UTC+1 użytkownik timh napisał: +1 I have worked on numersous projects with very large code bases on appengine, and I prefer pdb, and don't use Eclipse. On Tuesday, March 4, 2014 5:53:06 AM UTC+8, D X wrote: From my experience, stepping through code is much slower on eclipse than pdb. I disagree with your other comments; pdb is fine for professional use on huge projects. On Sunday, March 2, 2014 3:57:22 PM UTC-8, Cezary Wagner wrote: I found some combo like Pydev 3.3.3 + Eclipse 3.8.x (but no Django templates support or Aptana!). It allow fast debugging with little slower coding. W dniu poniedziałek, 3 marca 2014 00:49:14 UTC+1 użytkownik Cezary Wagner napisał: Thanks for hints - it is not helpful. Discussion is very old and there is not clear conclusion In my opinion pdb is good for hobbists - placing break points by editing code it is good for 100 lines programs or amateurs - sadomacho :) It looks that I can not use dart, endpoints because there is no usable debugger for it :) W dniu niedziela, 2 marca 2014 17:50:44 UTC+1 użytkownik Vinny P napisał: On Sat, Mar 1, 2014 at 9:59 AM, Cezary Wagner cezary...@gmail.com wrote: What is the best tools to use dev_appserver.py with breakpoint and debugging - what is the best choice. Hi Cezary, You might want to read this forums discussion here: https://groups.google.com/forum/#!topic/google-appengine/ep5BWYKpQpU- there's an interesting discussion on Python debugging with the dev_appserver. If you're OK with debugging using pdb, you'll want to read this message in particular: https://groups.google.com/d/msg/google-appengine/ep5BWYKpQpU/41asdxKhuycJ - -Vinny P Technology Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Python27 + new dev_appservery.py + debugging
Thanks for helpful hint I try to check it. W dniu wtorek, 4 marca 2014 16:59:06 UTC+1 użytkownik Doug Anderson napisał: I've been using PyCharm and am very pleased with it. I've also used JetBrains' WebStorm with node.js projects and was quite pleased with that as well. On Sunday, March 2, 2014 6:49:14 PM UTC-5, Cezary Wagner wrote: Thanks for hints - it is not helpful. Discussion is very old and there is not clear conclusion In my opinion pdb is good for hobbists - placing break points by editing code it is good for 100 lines programs or amateurs - sadomacho :) It looks that I can not use dart, endpoints because there is no usable debugger for it :) W dniu niedziela, 2 marca 2014 17:50:44 UTC+1 użytkownik Vinny P napisał: On Sat, Mar 1, 2014 at 9:59 AM, Cezary Wagner cezary...@gmail.com wrote: What is the best tools to use dev_appserver.py with breakpoint and debugging - what is the best choice. Hi Cezary, You might want to read this forums discussion here: https://groups.google.com/forum/#!topic/google-appengine/ep5BWYKpQpU - there's an interesting discussion on Python debugging with the dev_appserver. If you're OK with debugging using pdb, you'll want to read this message in particular: https://groups.google.com/d/msg/google-appengine/ep5BWYKpQpU/41asdxKhuycJ - -Vinny P Technology Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Python27 + new dev_appservery.py + debugging
Debugging is for troubleshooting. You should never avoid unit testing, logging, assert, exception if you have debugger - since debugger is not testing tools. I am not avoiding too bu need fast debugger - mean spend less time on this. W dniu wtorek, 4 marca 2014 17:16:35 UTC+1 użytkownik PK napisał: What version of pycharm do you use? My experience is that development slows down enough to avoid it. If there were an option to attach to a running instance when I really want to track something down I might use it once in a while. I am still looking for a solution that does not slow down the Dev. Cycle; I would love a how to blog if somebody mastered that. On the upside, not using a debugger has forced me to add many debug log messages that prove useful in troubleshooting in production. PK www.gae123.com On Mar 4, 2014, at 7:59 AM, Doug Anderson do...@claystreet.comjavascript: wrote: I've been using PyCharm and am very pleased with it. I've also used JetBrains' WebStorm with node.js projects and was quite pleased with that as well. On Sunday, March 2, 2014 6:49:14 PM UTC-5, Cezary Wagner wrote: Thanks for hints - it is not helpful. Discussion is very old and there is not clear conclusion In my opinion pdb is good for hobbists - placing break points by editing code it is good for 100 lines programs or amateurs - sadomacho :) It looks that I can not use dart, endpoints because there is no usable debugger for it :) W dniu niedziela, 2 marca 2014 17:50:44 UTC+1 użytkownik Vinny P napisał: On Sat, Mar 1, 2014 at 9:59 AM, Cezary Wagner cezary...@gmail.com wrote: What is the best tools to use dev_appserver.py with breakpoint and debugging - what is the best choice. Hi Cezary, You might want to read this forums discussion here: https://groups.google.com/forum/#!topic/google-appengine/ep5BWYKpQpU - there's an interesting discussion on Python debugging with the dev_appserver. If you're OK with debugging using pdb, you'll want to read this message in particular: https://groups.google.com/d/msg/google-appengine/ep5BWYKpQpU/41asdxKhuycJ - -Vinny P Technology Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengi...@googlegroups.com javascript:. To post to this group, send email to google-a...@googlegroups.comjavascript: . Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Python27 + new dev_appservery.py + debugging
I completly disagree that pdb is the best solution for any size project. I was explained in my first response and will not change mind since tested it. Pdb can be only the best for really hardcore debugging - I think that the most developers will never meet. It is waste of time and money to use it for simple debugging. Tell me can I debug in pdb with one click or forward with one key? W dniu środa, 5 marca 2014 01:21:53 UTC+1 użytkownik Vinny P napisał: On Sun, Mar 2, 2014 at 5:49 PM, Cezary Wagner cezary...@gmail.comjavascript: wrote: In my opinion pdb is good for hobbists PDB is perfectly fine for use with any size projects. The choice of a debugger is - of course - largely a personal preference, but I'd urge you to give pdb a second chance. - -Vinny P Technology Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Python27 + new dev_appservery.py + debugging
Why you prefer pdb - can you debug basic problems with one/two clicks + forward in pdb? W dniu wtorek, 4 marca 2014 04:01:57 UTC+1 użytkownik timh napisał: +1 I have worked on numersous projects with very large code bases on appengine, and I prefer pdb, and don't use Eclipse. On Tuesday, March 4, 2014 5:53:06 AM UTC+8, D X wrote: From my experience, stepping through code is much slower on eclipse than pdb. I disagree with your other comments; pdb is fine for professional use on huge projects. On Sunday, March 2, 2014 3:57:22 PM UTC-8, Cezary Wagner wrote: I found some combo like Pydev 3.3.3 + Eclipse 3.8.x (but no Django templates support or Aptana!). It allow fast debugging with little slower coding. W dniu poniedziałek, 3 marca 2014 00:49:14 UTC+1 użytkownik Cezary Wagner napisał: Thanks for hints - it is not helpful. Discussion is very old and there is not clear conclusion In my opinion pdb is good for hobbists - placing break points by editing code it is good for 100 lines programs or amateurs - sadomacho :) It looks that I can not use dart, endpoints because there is no usable debugger for it :) W dniu niedziela, 2 marca 2014 17:50:44 UTC+1 użytkownik Vinny P napisał: On Sat, Mar 1, 2014 at 9:59 AM, Cezary Wagner cezary...@gmail.com wrote: What is the best tools to use dev_appserver.py with breakpoint and debugging - what is the best choice. Hi Cezary, You might want to read this forums discussion here: https://groups.google.com/forum/#!topic/google-appengine/ep5BWYKpQpU- there's an interesting discussion on Python debugging with the dev_appserver. If you're OK with debugging using pdb, you'll want to read this message in particular: https://groups.google.com/d/msg/google-appengine/ep5BWYKpQpU/41asdxKhuycJ - -Vinny P Technology Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] How to make endpoints working with endpoints old_dev_appserver.py and Dart?
http://stackoverflow.com/questions/22118196 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Is possible GAE Python27 SDK 1.8.x or 1.9.x with Aptana + PyDev?
Simple question is possible to use Aptana + PYdev? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Is old_dev_appserver.py supports enpoints?
I try to write some Dart client to endpoints and want to use old_dev_appserver.py since work nice with debugger. Can I use it? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Python27 + new dev_appservery.py + debugging
Thanks for hints - it is not helpful. Discussion is very old and there is not clear conclusion In my opinion pdb is good for hobbists - placing break points by editing code it is good for 100 lines programs or amateurs - sadomacho :) It looks that I can not use dart, endpoints because there is no usable debugger for it :) W dniu niedziela, 2 marca 2014 17:50:44 UTC+1 użytkownik Vinny P napisał: On Sat, Mar 1, 2014 at 9:59 AM, Cezary Wagner cezary...@gmail.comjavascript: wrote: What is the best tools to use dev_appserver.py with breakpoint and debugging - what is the best choice. Hi Cezary, You might want to read this forums discussion here: https://groups.google.com/forum/#!topic/google-appengine/ep5BWYKpQpU - there's an interesting discussion on Python debugging with the dev_appserver. If you're OK with debugging using pdb, you'll want to read this message in particular: https://groups.google.com/d/msg/google-appengine/ep5BWYKpQpU/41asdxKhuycJ - -Vinny P Technology Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Python27 + new dev_appservery.py + debugging
I found some combo like Pydev 3.3.3 + Eclipse 3.8.x (but no Django templates support or Aptana!). It allow fast debugging with little slower coding. W dniu poniedziałek, 3 marca 2014 00:49:14 UTC+1 użytkownik Cezary Wagner napisał: Thanks for hints - it is not helpful. Discussion is very old and there is not clear conclusion In my opinion pdb is good for hobbists - placing break points by editing code it is good for 100 lines programs or amateurs - sadomacho :) It looks that I can not use dart, endpoints because there is no usable debugger for it :) W dniu niedziela, 2 marca 2014 17:50:44 UTC+1 użytkownik Vinny P napisał: On Sat, Mar 1, 2014 at 9:59 AM, Cezary Wagner cezary...@gmail.com wrote: What is the best tools to use dev_appserver.py with breakpoint and debugging - what is the best choice. Hi Cezary, You might want to read this forums discussion here: https://groups.google.com/forum/#!topic/google-appengine/ep5BWYKpQpU - there's an interesting discussion on Python debugging with the dev_appserver. If you're OK with debugging using pdb, you'll want to read this message in particular: https://groups.google.com/d/msg/google-appengine/ep5BWYKpQpU/41asdxKhuycJ - -Vinny P Technology Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] What is the best tools set to develop/debug Python27/Django Google App Engine Applications
What is the best set of tools to develop Python27/Django templates :) It should allow debug/develop with dev_appserver.py? It should allow debug/develop with old_dev_appserver.py? I am using Eclipse + Aptana + PyDev 2.7.x. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Python27 + new dev_appservery.py + debugging
What is the best tools to use dev_appserver.py with breakpoint and debugging - what is the best choice. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] When SDK1.7.3 datastore API will be fixed and invalid code incompatible with python 2.5 will be removed?
I found serious bug in SDK1.7.3 - probably in production what not allow use datastore anymore. http://code.google.com/p/googleappengine/issues/detail?id=8335sort=-idcolspec=ID%20Type%20Component%20Status%20Stars%20Summary%20Language%20Priority%20Owner%20Log -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/RJTUseAasosJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] When there will be timeline for solving 200 index limitation which lead to major pain with medium or large application developement?
Current Google App Engine architecture lead to major problem with 200 index limitation since: 1. Queries requires many indexes sometimes little overlapping - for example I have (A, B, C) with sort on (D) but it is required to create also (A, B) for sort on (D) - try to add some algorithm reducing number of required indexes especially overlapping. 2. Good practice it to create many models to separate code - it leads to some index duplication - for example I want have different types of time reservation in different tables not merge all types into one table to complicate development - do not force users to write bad and complex code. 3. Medium or large application need operate on 100-200 tables or more - if tables will require composite indexes it mean that is not possible to develop some kind of application on Google App Engine. I think that better to charge us for service (indexes i/o) than limit development to small or medium application which not use too much indexing. http://code.google.com/p/googleappengine/issues/detail?id=8305sort=-idcolspec=ID%20Type%20Component%20Status%20Stars%20Summary%20Language%20Priority%20Owner%20Log -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/v9kttrTKHrIJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 1.7.0 Prerelease Now Available
Number not matter - matter features.
Better is stable application than fireworks :)
On Jun 21, 9:30 am, Carlos Aguilar Moreno c.aguim...@gmail.com
wrote:
I'm a bit dissapointed. Why next version isn't 1.6.7? What's the big
improve?
On Jun 20, 9:00 pm, Christopher Ramírez blindedbythed...@gmail.com
wrote:
Thanks Guido!
I addressed the issue thank to Alfred Fuller and Timh.
https://groups.google.com/forum/?hl=enfromgroups#!topic/google-appen...
The origin of the problem seems to be that some properties included in the
proyection were not indexed. And yes, you are right, I'm using db.
On Tuesday, June 19, 2012 2:03:23 PM UTC-6, Guido van Rossum wrote:
On Tuesday, June 19, 2012 7:22:15 AM UTC-7, Christopher Ramírez wrote:
On Monday, June 18, 2012 6:00:23 PM UTC-6, Marce (Google) wrote:
- Projection queries are now supported in NDB.
I have problems with projection queries. If I use them with
.order('-__key__').fetch(limit=20) records returned seems to be only the
even or odd ones. I opened a new discussion in this group but it was
never
publicised.
To be clear, is this with NDB or with db? (I'm guessing db, since NDB
doesn't support the syntax .order('-__key__') -- you'd have to use
.order(-MyClass._key).
Either way, can you please submit this to stackoverflow, with more details
about what your code looks like and so on, so someone can help you?
--Guido van Rossum
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: App Engine SDK 1.6.2 is out!
Brandom, please cut message tails since it not readable :) http://groups.google.com/group/google-appengine/browse_thread/thread/986e19cd7366a655 Example: We aren't real bright here. We didn't do much with tasks until recently J We knew we should but to make our code work on multiple platforms we had avoided it. Now we are starting to branch our code so that functions detect which platform they are on and to things better. So we will look in to using your logic. Brandon Wirtz BlackWaterOps: President / Lead Mercenary Description: http://www.linkedin.com/img/signature/bg_slate_385x42.jpg Work: 510-992-6548 Toll Free: 866-400-4536 IM: drak...@gmail.com (Google Talk) Skype: drakegreene YouTube: http://www.youtube.com/blackwateropsdotcom BlackWaterOpsDotCom http://www.blackwaterops.com/ BlackWater Ops http://www.cloudonastring.com/ Cloud On A String Mastermind Group From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Robert Kluin Sent: Wednesday, February 01, 2012 10:41 PM To: google-appengine@googlegroups.com Subject: Re: [google-appengine] App Engine SDK 1.6.2 is out! Ouch. By the way, a faster pattern looks like this: while there's stuff to delete: do a keys only query (using a cursor to continue) insert one or more tasks to delete those keys insert a task and break from the while to continue if there are still more to delete (to prevent deadline errors) You can speed that up further by sharding the key space in the keys only query, which will yield better parallelism. Robert On Thu, Feb 2, 2012 at 01:18, Brandon Wirtz drak...@digerat.com wrote: The version I have goes like this. Yourapp.appspot.com/psuedodroptable/Name Then the code logic says For all batches of maximum size delete async Next batch We ran it the person hitting it's Chrome crashed an hour later (unrelated) they came back in the morning Got the Chrome has crashed would you like to restore? Yes why note and they deleted all the data we had spent 18 hours putting in to the system. well not all the data, since we were still loading it, so new data wasn't deleted cause it wasn't in the batch J Brandon Wirtz BlackWaterOps: President / Lead Mercenary Description: http://www.linkedin.com/img/signature/bg_slate_385x42.jpg Work: 510-992-6548 Toll Free: 866-400-4536 IM: drak...@gmail.com (Google Talk) Skype: drakegreene YouTube: http://www.youtube.com/blackwateropsdotcom BlackWaterOpsDotCom http://www.blackwaterops.com/ BlackWater Ops http://www.cloudonastring.com/ Cloud On A String Mastermind Group From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Robert Kluin Sent: Wednesday, February 01, 2012 10:11 PM To: google-appengine@googlegroups.com Subject: Re: [google-appengine] App Engine SDK 1.6.2 is out! WTF, a confirmation? Coward. I'd also like to see a magic reset button, especially one that was fast and didn't cost a fortune. Would sure be nice for testing purposes. Robert On Thu, Feb 2, 2012 at 01:07, Brandon Wirtz drak...@digerat.com wrote: Yeah, we have a something, I don't like it. I need to password it, and ad a confirmation, and a bunch of stuff. Plus, we have a use case where we actually want a Flush every things NOW button. That the SQL version of our code does really well. And we can't quite find an analog for in GQL Brandon Wirtz BlackWaterOps: President / Lead Mercenary Description: http://www.linkedin.com/img/signature/bg_slate_385x42.jpg Work: 510-992-6548 Toll Free: 866-400-4536 IM: drak...@gmail.com (Google Talk) Skype: drakegreene YouTube: http://www.youtube.com/blackwateropsdotcom BlackWaterOpsDotCom http://www.blackwaterops.com/ BlackWater Ops http://www.cloudonastring.com/ Cloud On A String Mastermind Group From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Robert Kluin Sent: Wednesday, February 01, 2012 9:38 PM To: google-appengine@googlegroups.com Subject: Re: [google-appengine] App Engine SDK 1.6.2 is out! I wrote a simple task-based script that can delete a few tens of millions of entities within a few hours. So I'd suggest just writing something. Robert On Thu, Feb 2, 2012 at 00:27, Brandon Wirtz drak...@digerat.com wrote: It can take days. Brandon Wirtz BlackWaterOps: President / Lead Mercenary Description: http://www.linkedin.com/img/signature/bg_slate_385x42.jpg Work: 510-992-6548 Toll Free: 866-400-4536 IM: drak...@gmail.com (Google Talk) Skype: drakegreene YouTube: http://www.youtube.com/blackwateropsdotcom BlackWaterOpsDotCom http://www.blackwaterops.com/ BlackWater Ops http://www.cloudonastring.com/ Cloud On A String Mastermind Group From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Timofey Koolin Sent: Wednesday, February 01, 2012 9:14 PM To: google-appengine@googlegroups.com Subject: Re: [google-appengine] App Engine SDK 1.6.2 is out! You can delete all items of any kind from datastore admin. 2012/2/2 Brandon
[google-appengine] Re: Free Write and Read Operations
I do some tool which list all tables and shows bottlenecks base on: https://code.google.com/intl/en/appengine/docs/billing.html. First of all do indexed=False for all fields! - not sure about overhead of import tools since could generate more operation than is need. On Feb 3, 7:55 am, Robert Kluin robert.kl...@gmail.com wrote: If you're lazy, you can also try importing it on the local dev server, then goto the local datastore viewer. It will tell you how many write ops each entity required. You can also disable unneeded indexes (what Timofey is talking about), which will reduce cost and improve performance. Robert On Thu, Feb 2, 2012 at 18:36, Timofey Koolin timo...@koolin.ru wrote: Every field have index by default. You can calc write ops by table https://code.google.com/intl/en/appengine/docs/billing.html These low-level operations map to API-level operations as follows 2012/2/2 José Luis Ordiales Fernandez jlof1...@gmail.com Hi, im a student of Spain and im using the free version of the GAE. Actually im working with a CSV file and I get to import to the Datastore, but this CSV file has about 200 columns and 1000 rows and when i try to read the data into the datastore the GAE tell me that i have exceed the number of reads. I have seen that if you enable your billing the cost of reading each 100k operations is 0.07$,but i dont know how many operations of read has my CSV file. Can anyone help me? Thanks in advance. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/wDh1011b3i0J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Blog:www.rekby.ru -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Why in 1.6.2 there is no 1.3 Django on servers - release notes says that is done???
Still not have idea why in 2.5 python on server there is not django in library directory - why path set by use_library is empty? On Feb 2, 6:37 pm, Cezary Wagner cezary.wag...@gmail.com wrote: Hi I found that there is notDjango1.3on servers since path is empty - how it passed tests with such bug??? http://code.google.com/p/googleappengine/issues/detail?id=6847sort=-... In case olddjangoeverything is o.k. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Why in 1.6.2 there is no 1.3 Django on servers - release notes says that is done???
Looks that works now both - checked on test application - both dirs contains django! D 2012-02-03 20:46:40.385 /base/python_runtime/python_lib/versions/ third_party/django-1.2 D 2012-02-03 20:46:40.385 ['django'] D 2012-02-03 20:46:40.385 /base/python_runtime/python_lib/versions/ third_party/django-1.3 D 2012-02-03 20:46:40.386 ['django'] On Feb 3, 6:41 pm, Cezary Wagner cezary.wag...@gmail.com wrote: Still not have idea why in 2.5 python on server there is not django in library directory - why path set by use_library is empty? On Feb 2, 6:37 pm, Cezary Wagner cezary.wag...@gmail.com wrote: Hi I found that there is notDjango1.3on servers since path is empty - how it passed tests with such bug??? http://code.google.com/p/googleappengine/issues/detail?id=6847sort=-... In case olddjangoeverything is o.k. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Why in 1.6.2 there is no 1.3 Django on servers - release notes says that is done???
Hi I found that there is not Django 1.3 on servers since path is empty - how it passed tests with such bug??? http://code.google.com/p/googleappengine/issues/detail?id=6847sort=-idcolspec=ID%20Type%20Component%20Status%20Stars%20Summary%20Language%20Priority%20Owner%20Log In case old django everything is o.k. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: App Engine SDK 1.6.2 is out!
Brandon, please cut message tail since it not readable/repetition - your tail is longer than response near 100 times :) On Feb 2, 7:57 am, Brandon Wirtz drak...@digerat.com wrote: We aren't real bright here. We didn't do much with tasks until recently J We knew we should but to make our code work on multiple platforms we had avoided it. Now we are starting to branch our code so that functions detect which platform they are on and to things better. So we will look in to using your logic. Brandon Wirtz BlackWaterOps: President / Lead Mercenary Description:http://www.linkedin.com/img/signature/bg_slate_385x42.jpg Work: 510-992-6548 Toll Free: 866-400-4536 IM: drak...@gmail.com (Google Talk) Skype: drakegreene YouTube: http://www.youtube.com/blackwateropsdotcom BlackWaterOpsDotCom http://www.blackwaterops.com/ BlackWater Ops http://www.cloudonastring.com/ Cloud On A String Mastermind Group From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Robert Kluin Sent: Wednesday, February 01, 2012 10:41 PM To: google-appengine@googlegroups.com Subject: Re: [google-appengine] App Engine SDK 1.6.2 is out! Ouch. By the way, a faster pattern looks like this: while there's stuff to delete: do a keys only query (using a cursor to continue) insert one or more tasks to delete those keys insert a task and break from the while to continue if there are still more to delete (to prevent deadline errors) You can speed that up further by sharding the key space in the keys only query, which will yield better parallelism. Robert On Thu, Feb 2, 2012 at 01:18, Brandon Wirtz drak...@digerat.com wrote: The version I have goes like this. Yourapp.appspot.com/psuedodroptable/Name Then the code logic says For all batches of maximum size delete async Next batch We ran it the person hitting it's Chrome crashed an hour later (unrelated) they came back in the morning Got the Chrome has crashed would you like to restore? Yes why note and they deleted all the data we had spent 18 hours putting in to the system. well not all the data, since we were still loading it, so new data wasn't deleted cause it wasn't in the batch J Brandon Wirtz BlackWaterOps: President / Lead Mercenary Description:http://www.linkedin.com/img/signature/bg_slate_385x42.jpg Work: 510-992-6548 Toll Free: 866-400-4536 IM: drak...@gmail.com (Google Talk) Skype: drakegreene YouTube: http://www.youtube.com/blackwateropsdotcom BlackWaterOpsDotCom http://www.blackwaterops.com/ BlackWater Ops http://www.cloudonastring.com/ Cloud On A String Mastermind Group From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Robert Kluin Sent: Wednesday, February 01, 2012 10:11 PM To: google-appengine@googlegroups.com Subject: Re: [google-appengine] App Engine SDK 1.6.2 is out! WTF, a confirmation? Coward. I'd also like to see a magic reset button, especially one that was fast and didn't cost a fortune. Would sure be nice for testing purposes. Robert On Thu, Feb 2, 2012 at 01:07, Brandon Wirtz drak...@digerat.com wrote: Yeah, we have a something, I don't like it. I need to password it, and ad a confirmation, and a bunch of stuff. Plus, we have a use case where we actually want a Flush every things NOW button. That the SQL version of our code does really well. And we can't quite find an analog for in GQL Brandon Wirtz BlackWaterOps: President / Lead Mercenary Description:http://www.linkedin.com/img/signature/bg_slate_385x42.jpg Work: 510-992-6548 Toll Free: 866-400-4536 IM: drak...@gmail.com (Google Talk) Skype: drakegreene YouTube: http://www.youtube.com/blackwateropsdotcom BlackWaterOpsDotCom http://www.blackwaterops.com/ BlackWater Ops http://www.cloudonastring.com/ Cloud On A String Mastermind Group From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Robert Kluin Sent: Wednesday, February 01, 2012 9:38 PM To: google-appengine@googlegroups.com Subject: Re: [google-appengine] App Engine SDK 1.6.2 is out! I wrote a simple task-based script that can delete a few tens of millions of entities within a few hours. So I'd suggest just writing something. Robert On Thu, Feb 2, 2012 at 00:27, Brandon Wirtz drak...@digerat.com wrote: It can take days. Brandon Wirtz BlackWaterOps: President / Lead Mercenary Description:http://www.linkedin.com/img/signature/bg_slate_385x42.jpg Work: 510-992-6548 Toll Free: 866-400-4536 IM: drak...@gmail.com (Google Talk) Skype: drakegreene YouTube: http://www.youtube.com/blackwateropsdotcom BlackWaterOpsDotCom http://www.blackwaterops.com/ BlackWater Ops http://www.cloudonastring.com/ Cloud On A String Mastermind Group From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Timofey Koolin Sent: Wednesday, February 01, 2012 9:14 PM To:
[google-appengine] Re: App Engine SDK 1.6.2 is out!
Still no Django 1.3 since not deployed on server - check this out: http://code.google.com/p/googleappengine/issues/detail?id=6847sort=-idcolspec=ID%20Type%20Component%20Status%20Stars%20Summary%20Language%20Priority%20Owner%20Log On Feb 1, 2:20 pm, sebastián serrano sebastian.serr...@gmail.com wrote: Python Django now work with Cloud SQL without additional configuration So cool. Thanks!!! -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: is app engine down? I'm seeing a huge number of deadline errors and our app failing to server, hr datastore
I am feel that some week ago same was on M/S so maybe next version is comming - whatever it should be more stable - I currently use M/S and there is not problems planning to go to hrd but see that it is not good time to do it in this week maybe :) On Jan 31, 8:28 pm, Marzia Niccolai marce+appeng...@google.com wrote: Hi, Both today and yesterday, there was a networking issue in one of the datacenters serving High Replication applications that caused increased datastore latency and elevated error rates. We responded by stopping app engine from serving out of the affected datacenter until the problem was resolved. If you have a paid HRD app and you feel the SLA has been violated for your app, you can file a request for billing credits here:https://docs.google.com/a/google.com/spreadsheet/formResponse?hl=en_U... -Marzia On Tue, Jan 31, 2012 at 9:33 AM, Alexis alexis.hanico...@gmail.com wrote: Also get big issues simultaneously with all our apps 10 min ago. Lot of errors, drop in requests/sec while peak of active instances. http://code.google.com/status/appengineshowed an anomaly for Python, but now it's back to Elevated and I guess it'll disappear as usually... -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Why are several production issues related to DeadlineExceededErrors being ignored?
Alexis, It looks that GEA has hidden balancing/lack of resources problems or deadlocks both results in RANDOM problems. I think about moving to HRD but it looks that you suffer same on HRD the last days so it will not help till GEA will not generate RANDOM problems - I do some optimization it helps with time but not yet with availability. Day Total checksOutages Failed checks Avg. response time Uptime 2012.01.14 26 1 1 3.152 96.154 % 2012.01.15 47 1 1 4.937 97.872 % 2012.01.16 48 4 5 3.699 89.583 % 2012.01.17 48 3 5 2.507 89.583 % 2012.01.18 48 1 1 2.419 97.917 % 2012.01.19 47 2 2 3.143 95.745 % On 18 Sty, 11:02, Alexis alexis.hanico...@gmail.com wrote: Cezary, I was in the same position in August, with our Python apps on M/S. The DEE errors began to appear, then were more and more frequent and finally had a high impact on our app availability. Our warmup requests, that only load code, were randomly taking from a few secs to more than 30sec and so triggering the DEE. I could not figure out how it could be linked to the datastore, but Google team only had one word to mouth: move to HRD. No explanation at that time and made so sense for me but I decided to trust them. We migrated to HRD writing our own mapreduce and then all went fine (except for the costs that went higher but hey, was the price for a more reliable solution). But since something like mid-December, exactly the same symptoms begin to appear again. Less frequent and not really impacting our availability yet, but still there. And no official acknowledgement of this issue so far... -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Why are several production issues related to DeadlineExceededErrors being ignored?
Brandon, I am doing service management/development many years and your explanation not convince me since it not show partially valid root cause - I think so - see why it not convincing. Low availability is a fact see report again it random for same thing: 2012.01.14 26 1 1 3.152 96.154 % 2012.01.15 47 1 1 4.937 97.872 % 2012.01.16 48 4 5 3.699 89.583 % 2012.01.17 20 0 0 1.699 100 % Now it looks that it works but I try to open some test pages and it opens slowly comparing to previous week. TODAY customer experience is still bad - I do some optimization it visible in times. You said that it could matter on/have root cause: 1. Configuration of application - why it is RANDOM - once something loads once not loads - same configuration should give same results. 2. Instance die early if I hit memory limit - good point but not see in log any message about memory and application is much below 48M - it should not die - why it is RANDOM. 3. Master/Slave is NOT ROOT CAUSE since DeadlineExceededError occcurs before any datastore will be touched so there is not impact - are you agree with that? 4. If Master/Slave is not supported by Google is there any information that is not supported and from which date? QUICK example of DeadlineExceededError (dead in imports): class 'google.appengine.runtime.DeadlineExceededError': Traceback (most recent call last): File /base/data/home/apps/wcinamy/1-9-9-6.356145314073492481/ frontend/web/order_in_restaurant.py, line 20, in module from frontend.web.cache import restaurant_menu as cache_restaurant_menu File /base/data/home/apps/wcinamy/1-9-9-6.356145314073492481/ frontend/web/cache/restaurant_menu.py, line 4, in module from google.appengine.api import memcache On Jan 17, 12:19 am, Brandon Wirtz drak...@digerat.com wrote: If it is a software / configuration issue in your setup then it is not down time. If you have errors on M/S you are on your own. Instances die early if you hit the soft memory limit. Likely if you have load time issues you have memory usage issues as well. -Original Message- From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Cezary Wagner Sent: Monday, January 16, 2012 2:37 PM To: Google App Engine Subject: [google-appengine] Re: Why are several production issues related to DeadlineExceededErrors being ignored? Brandom, I think that problem of DeadlinesExceeds is different: 1st of GAE availability is not measure considering DeadlinesExceeds - it will be rather not 100%. If it not monitored it has not impact on quality. Am I wrong? This is data for the last week: Day Total checks Outages Failed checks Avg. response time Uptime 2012.01.14 26 1 1 3.152 96.154 % 2012.01.15 47 1 1 4.937 97.872 % 2012.01.16 47 4 5 3.657 89.362 % 2nd My code without changes through months becomes slower/not faster - I have optimized code and it works not faster - on SDK it executes 5s-1s (excluding load time) see above results from production. It could be suffered with imports but why it once loads and once not loads it random - it should not load every time or it problem with balance/resource - why IT IS RANDOM? 3rd Instance DIES just after load not survive 15min period - instance was load for 1 min than it dies - that is some problem or lack of balance/resource? 4rd Maybe master/slave has impact? 5th The application not works in my case under low traffic EARLY DIES of INSTANCES and DeadlinesExceeds kills 3%-10% of customer traffic(stats above) - I am imagine that GAE works some for higher traffic with exception that number of errors will be lower - maybe - but how achieve high traffic if it not works on lower? Please answer to question or propose other solution - GAE concept is good but the current my customers experience is not excellent. On 16 Sty, 18:58, Brandon Wirtz drak...@digerat.com wrote: I agree multiple imports is not supposed to be a problem, but I have seen it cause issues, or seen issues be resolved by not doing it. Remember that the Google Implementation of Python has its own Specialness and what is true in traditional python is not always quite the same in GAE land. From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Karl Rosaen Sent: Monday, January 16, 2012 7:32 AM To: google-appengine@googlegroups.com Subject: Re: [google-appengine] Re: Why are several production issues related to DeadlineExceededErrors being ignored? Brandon, thanks so much for taking the time to put together the video, very helpful. The key insight seem to be: time spent in the queue waiting for a frontend counts towards the limit for a DeadlineExceedError. This seems silly - seems to me user visible latency
[google-appengine] Re: Why are several production issues related to DeadlineExceededErrors being ignored?
Kenneth, The timeouts could not be 10s or 15s - since DeadlineExceededErrors occurs in my logs is about 60s - I think that 10s or 15s is myths or wrong implementation since what is sense to give 60s if it should start in 15s??? Common timeouts are: 64608ms, 70806ms, 63093ms, 64499ms, ... On Jan 17, 9:10 am, Kenneth kennet...@aladdinschools.com wrote: Wow, sorry to hear that. Is it java or python? I've been on hrd now for about a month. I have the sliders set to el cheapo mode and haven't had any timeouts at all. My understanding is the startup timeout is 10 seconds. The total request timeout is 60 seconds. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Why are several production issues related to DeadlineExceededErrors being ignored?
Brandon, Test on Master/Slave. Not keeping point that my code is perfect I keep point that GEA LOAD behavior is RANDOM/UNPREDICTED - once it load faster (5s) once it not loads since DeadlineExceed (70s) - it not enough for production system. Problem start from last weeks. I will do some imports tracing and found what imports has the major impact but problem is that its load RANDOM once faster once longer - I do some downgrade one module but still GAE works worser than before but should work faster since added very fast caching and optimizations. Planning to do HRD to see if it has any impact on customer experience/ availabity. See how random it is (first load time if from module start and second for the single module). Shows time only above second - both requests has same input variance is from 17s, 30s till deadline - it is NOT STABLE: 2012-01-17 14:16:07.807 ImportLogger 1.03 1.02 - frontend.web.handlers - frontend.web.handlers.common:17. D 2012-01-17 14:16:09.310 ImportLogger 2.53 1.50 - google - frontend.web.handlers.common:28. D 2012-01-17 14:16:10.164 ImportLogger 3.38 0.53 - frontend.web.cookie - frontend.web.handlers.common:45. D 2012-01-17 14:16:11.118 ImportLogger 4.34 0.95 - frontend.web - frontend.web.handlers.common:47. D 2012-01-17 14:16:12.106 ImportLogger 5.32 0.93 - frontend.web.authentication - frontend.web.handlers.common:52. D 2012-01-17 14:16:12.239 ImportLogger 6.66 6.66 - common handler - __main__:13. D 2012-01-17 14:16:18.552 ImportLogger 12.97 6.31 - frontend.restaurant - __main__:29. D 2012-01-17 14:16:19.886 ImportLogger 1.23 1.23 - cssutils - css_inliner:8. D 2012-01-17 14:16:19.924 ImportLogger 1.30 1.28 - css_inliner - frontend.ordering.messages:24. D 2012-01-17 14:16:22.118 ImportLogger 3.50 2.13 - utilities.time - frontend.ordering.messages:39. D 2012-01-17 14:16:22.579 ImportLogger 3.97 3.96 - frontend.ordering - frontend.ordering.processing:22. D 2012-01-17 14:16:22.642 ImportLogger 17.06 4.04 - frontend.ordering - __main__:35. 2012-01-17 14:15:41.905 ImportLogger 0.95 0.61 - frontend.ordering.order - __main__:33. D 2012-01-17 14:15:59.633 ImportLogger 17.32 17.32 - cssutils - css_inliner:8. D 2012-01-17 14:16:03.322 ImportLogger 21.01 3.69 - BeautifulSoup - css_inliner:13. D 2012-01-17 14:16:04.559 ImportLogger 22.25 1.24 - pynliner.soupselect - css_inliner:17. D 2012-01-17 14:16:04.559 ImportLogger 22.51 22.37 - css_inliner - frontend.ordering.messages:24. D 2012-01-17 14:16:06.902 ImportLogger 24.85 2.34 - messaging.sms.smsapipl - frontend.ordering.messages:27. D 2012-01-17 14:16:07.636 ImportLogger 25.59 0.73 - link_shortener - frontend.ordering.messages:29. D 2012-01-17 14:16:08.990 ImportLogger 26.94 0.64 - globals - frontend.ordering.messages:54. D 2012-01-17 14:16:08.990 ImportLogger 27.02 27.01 - frontend.ordering - frontend.ordering.processing:22. D 2012-01-17 14:16:10.166 ImportLogger 28.20 0.85 - frontend.ordering.order_state_controller - frontend.ordering.processing:26. D 2012-01-17 14:16:12.010 ImportLogger 30.04 1.84 - frontend.billing - frontend.ordering.processing:30. D 2012-01-17 14:16:12.010 ImportLogger 31.06 30.10 - frontend.ordering - __main__:35. On Jan 17, 10:50 am, Brandon Wirtz drak...@digerat.com wrote: You keep pointing to reasons you believe it isn't your code, and why we are wrong, but you aren't trying the things we point out. If your time out are at 70 seconds you are doing something wrong, it shouldn't take that long to start up. EVER. Also you are on M/S which has its own rules. Jump in to the modern world and run on HR with the rest of us happy shiny people, rather than running on the unsupported, failed experiment that M/S is. -Original Message- From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Cezary Wagner Sent: Tuesday, January 17, 2012 1:43 AM To: Google App Engine Subject: [google-appengine] Re: Why are several production issues related to DeadlineExceededErrors being ignored? Kenneth, The timeouts could not be 10s or 15s - since DeadlineExceededErrors occurs in my logs is about 60s - I think that 10s or 15s is myths or wrong implementation since what is sense to give 60s if it should start in 15s??? Common timeouts are: 64608ms, 70806ms, 63093ms, 64499ms, ... On Jan 17, 9:10 am, Kenneth kennet...@aladdinschools.com wrote: Wow, sorry to hear that. Is it java or python? I've been on hrd now for about a month. I have the sliders set to el cheapo mode and haven't had any timeouts at all. My understanding is the startup timeout is 10 seconds. The total request timeout is 60 seconds. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group
[google-appengine] Re: Why are several production issues related to DeadlineExceededErrors being ignored?
Brandom, I think that problem of DeadlinesExceeds is different: 1st of GAE availability is not measure considering DeadlinesExceeds - it will be rather not 100%. If it not monitored it has not impact on quality. Am I wrong? This is data for the last week: Day Total checksOutages Failed checks Avg. response time Uptime 2012.01.14 26 1 1 3.152 96.154 % 2012.01.15 47 1 1 4.937 97.872 % 2012.01.16 47 4 5 3.657 89.362 % 2nd My code without changes through months becomes slower/not faster - I have optimized code and it works not faster - on SDK it executes 5s-1s (excluding load time) see above results from production. It could be suffered with imports but why it once loads and once not loads it random - it should not load every time or it problem with balance/resource - why IT IS RANDOM? 3rd Instance DIES just after load not survive 15min period - instance was load for 1 min than it dies - that is some problem or lack of balance/resource? 4rd Maybe master/slave has impact? 5th The application not works in my case under low traffic EARLY DIES of INSTANCES and DeadlinesExceeds kills 3%-10% of customer traffic(stats above) - I am imagine that GAE works some for higher traffic with exception that number of errors will be lower - maybe - but how achieve high traffic if it not works on lower? Please answer to question or propose other solution - GAE concept is good but the current my customers experience is not excellent. On 16 Sty, 18:58, Brandon Wirtz drak...@digerat.com wrote: I agree multiple imports is not supposed to be a problem, but I have seen it cause issues, or seen issues be resolved by not doing it. Remember that the Google Implementation of Python has its own Specialness and what is true in traditional python is not always quite the same in GAE land. From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of Karl Rosaen Sent: Monday, January 16, 2012 7:32 AM To: google-appengine@googlegroups.com Subject: Re: [google-appengine] Re: Why are several production issues related to DeadlineExceededErrors being ignored? Brandon, thanks so much for taking the time to put together the video, very helpful. The key insight seem to be: time spent in the queue waiting for a frontend counts towards the limit for a DeadlineExceedError. This seems silly - seems to me user visible latency, and framework level timeout enforcement should be decoupled in this case. But good insight and glad to better understand this behavior. This also makes me wonder what the benefit of having 'auto' for max pending latency would ever be - I'm going to slide mine down to ~1s. One quibble about your advice for 'avoid importing code more than once': this shouldn't be a major issue in python unless you are importing a module from within a function that is called several times: Although Python's interpreter is optimized to not import the same module multiple times, repeatedly executing an import statement can seriously affect performance in some circumstances. http://wiki.python.org/moin/PythonSpeed/PerformanceTips#Import_Statem... rhead Just wanted to clarify that one needn't fret about the same utility module being imported from two modules or anything like that. Karl -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visithttps://groups.google.com/d/msg/google-appengine/-/7FTyQ34tagsJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: many uncaused 500 status code, who to contact?
Same problem. On 12 Gru, 22:28, thstart thst...@gmail.com wrote: I have the same issue today - usually my app is very fast. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
