[google-appengine] Alternative Appengine Monitoring and Alerting
I've been using google appengine since 2009. I have no complaints except for one. The system health dashboard or status page (https://code.google.com/status/appengine) rarely reflect the real health of appengine. When I'm developing/deploying and got some error or the system is slow for some reason, is very frustrating when I realize that it's an appengine failure. To mitigate that problem I started using Nagios to also monitor a second app, and tell me when things are going slow on my production app, and in my control app. As matter of fact, I realized that this kind of problem exists in other PaaS providers. That's why I started the paas-monitor project (https://github.com/fbueno/paas-monitor/). I started with python only. You can see it in action at http://paas.mongu.ru/cgi-bin/nagios3/status.cgi?host=all or http://paas.mongu.ru/nagios3/. The idea is to provide plugable code for every language on AppEngine and others, to let people monitor using the preferred way/software. Does that make any sense ? I mean, would you use this kind of code in your apps ? Any kind of help/suggestion is appreciated. Cheers, -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Alternative Appengine Monitoring and Alerting
Out of interest how you verify the reliability of the 'control' app? It could be running in a completely different 'area' of appengine. It could be running in a different datacenter - so is completely isolated from the any issues the main app is or isnt seeing. Good question. I simply don't care about where apps are running. It's a shot in the dark. I mean, I'm monitoring both apps, and if I have one alert on both apps, I consider that it's an appengine problem. Thats why I say that I am mitigating the monitoring problem. Also, the code that I wrote so far, is monitoring specific operations on Appengine (ds read, ds write, memcache read/write etc), this way I can see what exactly is not Ok on AppEngine, like the official status page. Long story short, both (official status page, and my project) have the same issues. Thanks. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Web site completely down + appengine console not accessible
Costumer Portal for premier accounts is also Down. On Friday, October 26, 2012 1:18:00 PM UTC-2, Damian del Rivero Lagunes wrote: My Apps are also down. http://code.google.com/status/appengine is also down. Damian -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/g8OdwTiAUKEJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Request Headers Documentation [X-AppEngine-Region]
Would be great to have more detailed information about X-AppEngine-Region. I'm assuming it uses iso-3166-2, am I right ? Thanks -- Sent from my chair -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] 1.7.0 Prerelease Now Available
Logs API calls are now $.12/gigabyte for all data read from the Logs API over the first 100MB. Is it included my calls to logservice.fetch ? On Mon, Jun 18, 2012 at 9:00 PM, Marzia Niccolai marce+appeng...@google.com wrote: Hi, The 1.7.0 prerelease SDKs are now available to download for Python and Java here: http://code.google.com/p/googleappengine/downloads/list Please see release notes below. -Marzia Python Version 1.7.0 === - The Search API now contains support for storing and searching on GeoPoints. - The total size of all application versions is now limited to 1 GB. In the future, you'll be able to purchase additional storage for your application code. - Logs API calls are now $.12/gigabyte for all data read from the Logs API over the first 100MB. - You can now specify a time frame of up to 1 year for the retention of your application logs. All storage above 1 GB is billed based on the prices for logs storage. - You can now specify HTTP headers on static content for your application. - The HRD Blob Migration tool is now generally available. - After using the datastore backup utility, you can now restore that backup to a new app id. - It will not be possible to create new authorizations for M/S applications to access Cloud SQL instances. - You can now delete a Google Cloud Storage object using blobstore.delete(). - You can now fetch a Google Cloud Storage object using blobstore.fetch(). - You can now store keys for a Google Cloud Storage object in the datastore. - The create_upload_url call now works for Google Cloud Storage objects. - You can now use get_serving_url() and delete_serving_url() for Google Cloud Storage buckets. - Projection queries are now supported in NDB. - In NDB, app and namespace are now keyword arguments to get_by_id(). - Context().call_on_commit() added to NDB for adding a callback to be executed upon successful commit of a transaction. - NDB Context.memcache_* ops now accept unicode. - NDB has added support for storing protorpc.Message objects. - Improved error messaging for multiple repeated=True levels with StructuredProperty in NDB. - PyAMF is now generally available. - Fixed an issue in Full-text search panel where the Admin Console throws an error displaying non- ascii characters. - Fixed an issue in SDK admin viewer where a TemplateDoesNotExist error was thrown when clicking on any Full-Text Search index. - Fixed an issue where lxml did not support unicode parsing. http://code.google.com/p/googleappengine/issues/detail?id=7158 - Fixed a javascript syntax error in the Admin Console. http://code.google.com/p/googleappengine/issues/detail?id=7566 Java Version 1.7.0 = - The Search API now contains support for storing and searching on GeoPoints. - The total size of all application versions is now limited to 1 GB. In the future, you'll be able to purchase additional storage for your application code. - Logs API calls are now $.12/gigabyte for all data read from the Logs API over the first 100MB. - You can now specify a time frame of up to 1 year for the retention of your application logs. All storage above 1 GB is billed based on the prices for logs storage. - You can now specify HTTP headers on static content for your application. - The HRD Blob Migration tool is now generally available. - After using the datastore backup utility, you can now restore that backup to a new app id. - It will not be possible to create new authorizations for M/S applications to access Cloud SQL instances. - You can now delete a Google Cloud Storage object using delete() in the Blobstore Service API. - You can now fetch a Google Cloud Storage object using fetch() in the Blobstore Service API. - You can now store keys for a Google Cloud Storage object in the datastore. - The BlobstoreService.createUploadUrl() call now works for Google Cloud Storage buckets. - You can now use ImageService.getServingUrl() and ImageService.deleteServingUrl() for Google Cloud Storage objects. - You can now specify your own Security Provider in Java. http://code.google.com/p/googleappengine/issues/detail?id=1612 - The Java Datastore API now supports Or queries. - Fixed an issue in Full-text search panel where the Admin Console throws an error displaying non- ascii characters. - Fixed a javascript syntax error in the Admin Console. http://code.google.com/p/googleappengine/issues/detail?id=7566 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Sent from my chair -- You received this message
Re: [google-appengine] Very unstable and spike traffic pattern
same here On Wed, May 23, 2012 at 2:46 AM, gks liu...@gmail.com wrote: Starting from 7 hours age, my GAE application starts to receive unstable and spiky traffic pattern. Since there is no code change today in my application, is there a production issue with traffic routing? You can find the strange traffic pattern in the attachment. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/pxj9emONzdIJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Sent from my chair -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: appengine monitoring api
Hello Google AE Team, Is there any news on this ? http://goog_622033861/Life in App Engine Productionhttp://www.youtube.com/watch?v=rgQm1KEIIucfeature=player_detailpage#t=2984s . On Mon, Dec 5, 2011 at 7:54 PM, Brandon Wirtz drak...@digerat.com wrote: State of your AppEngine for monitoring. I'd upload code, but we change regularly, and our case would be specific to our functions. I would put this on more than one AppID so you can check errors against more than one app to see if your issue is localized. We do this to tell if GAE is broken or our code is. User or bot access Your Appid.Appspot.com/amiup?MyRandomString Using whatever language and version you are running do the following operations. Import every library you are using: Output (NOW!) Write Randomstring to Instance Memory Return instance memory if equal report Working Output (NOW!) Write Randomstring to memcache Return memcache if equal report Working Output (NOW!) Write Randomstring to datastore Return Datastore if equal report Working Output (NOW!) Fetch URL (google.com query Random string + OR The) If success return working Output (NOW!) Loop X = X*2 +3 500 times Output answer Output (NOW!) Do some Regex, or Django, or What ever imports you have things. Output (Now! After each one so you have the time it took to complete. -Original Message- From: google-appengine@googlegroups.com [mailto:google-appengine@googlegroups.com] On Behalf Of JH Sent: Monday, December 05, 2011 1:19 PM To: Google App Engine Subject: [google-appengine] Re: appengine monitoring api I remember this going into TT a LONG time ago... seems like a simple api, very curious that it hasn't surfaced yet On Dec 5, 3:02 pm, Felippe Bueno felippe.bu...@gmail.com wrote: Hello all, Anyone know something about the appengine monitoring api ? I don't have any URL. I saw Alan Green talking about it on http://goog_622033861/Life in App Engine Productionhttp://www.youtube.com/watch?v=rgQm1KEIIucfeature=player_d etailpage#... . In fact, I only have the form request link http://goo.gl/xcB1E. Thank you. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Outages?
Hello all. Only to share my information: My app is doing something like this: JS=xpto JS_OPTOUT=xpto1 if request.cookie.has_key(optout) or request.headers.has_key(DNT) response.write(JS_OPTOUT) else response.write(JS) The normal latency is ~3ms Now I'm seeing 13.9 ms Earlier this morning I saw ~1000ms milisec/req 24hours ago I saw ~2400ms milisec/req [image: Requests/Second (24 hrs)] I noticed this behavior on all my apps for at least the last 8 days. I'm using python 2.5/HRD. On Wed, Mar 14, 2012 at 5:35 AM, Nicanor Babula nicanor.bab...@gmail.comwrote: Now my app is working fine. What happened? I saw at some point my app's graphs reset and some huge values for instance hours values. Afterwards, the instance hours counters turned to normal and my app stpped raising errors. If there was the GAE team working on it, thank you very much, but I think you owe us at least an explanation. What should I say to my customers? The issue has been fixed or they should be expecting outages in the following days? My app is on HRD. Thanks, Cristian Il giorno martedì 6 marzo 2012 22:17:37 UTC+1, Adam Sherman ha scritto: Am I the only one seeing short duration outages? They are being reflected at: http://code.google.com/status/**appenginehttp://code.google.com/status/appengine But I don't see anyone else complaining anywhere, so it makes me worried. A. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/hw3niAzjSIAJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] My expirencie with python 2.7 and others
Hi Chris,
I just sent you a private message with the appids.
I tryed to change my instances class to F2 and F4, and I didn't noticed any
significant improvements.
I didn't gave up yet. Thanks for your answer.
Brandon,
Thanks for the explanation, things are clearer now.
Cheers
On Mon, Mar 12, 2012 at 2:08 AM, Chris Ramsdale cramsd...@google.comwrote:
Hey Felippe,
Have you considered bumping your instance class and enabling threadsafe?
We have seen a handful of customers that have had success doing just this.
Also, did you hear back from the premier account folks? If not, send me
your app IDs
(offline if you'd like) and I'll get the ball rolling here.
-- Chris
Product Manager, Google App Engine
On Thu, Mar 8, 2012 at 2:12 PM, Felippe Bueno felippe.bu...@gmail.comwrote:
Hi,
I will try to be objective:
The problems that I found:
1 - Seems that datetime.datetime.strptime is not threadsafe (
https://groups.google.com/group/google-appengine-python/browse_thread/thread/efbcffa181c32f33/48afebe467861674?pli=1
)
I needed to put a call to it on appengine_config.py following
http://bugs.python.org/issue7980
2 - webapp2 follow PEP333, it seems that's why you need to specify
str().encode('ascii') when sending response headers.
I mean, if you do not specify it, str() will be the default coding (utf8
in my case).
3 - I'm not sure if before python2.7/webapp2, it was ok send ',' on
cookie header. But, it was working on python2.5 and webapp.
With python2.7 and webapp2 it stoped working. I replace it with '_' on
cookie header.
Now, the real problems:
On python 2.5:
most requests to my app uses only memcache.incr()/get()/set(). Some times
the only thing that I need to do is an incr().
I'm using a global dict to cache things, and it was working pretty well.
My instances latency is something *from 120ms to 200ms.*
incr() is running* ~5ms,* same to get/set. Not more than *20ms*
My app is CPU intensive, and is consuming* ~180 CPU seconds/sec running
at 1300 req/sec*
When I turn on appstats I'm able to see that my code (between the rpc
calls) runs *from 80ms to 120ms, some times 20ms.*
After changing to python 2.7 I noticed that inc()/get()/set() (memcache)
takes *100ms+* to run.
My code takes *1000ms+ to run.*
Cpu seconds is* 350 CPU seconds/sec running at 1300 req/sec.*
Instances latency increased to ~500ms
In my opinion
http://code.google.com/p/googleappengine/issues/detail?id=6323 should be
reopened.
It's true that the latency is much better before issue 6323 be closed,
but still not acceptable.
Also, it's true that when using python 2.7 threadsafe=yes, the
scheduler starts half of instances when running on python 2.5.
But again, the latency is too high.
By the way, I still not comfortable with the instance scheduler.
Another thing that I noticed, is that when I change from python2.7 to
python2.5 (appengine admin/versions), I get strange memcache errors:
class Reference has no attribute '__new__'
Traceback (most recent call last):
File
/base/python_runtime/python_lib/versions/1/google/appengine/ext/webapp/_webapp25.py,
line 701, in __call__
handler.get(*groups)
File /base/data/home/apps/xxx/x/xxxviews.py, line 29,
in get
self._get()
File /base/data/home/apps/xxx/x/xxx/views.py, line
83, in _get
output = rules.Process(nid, h, data, r, self.request)
File /base/data/home/apps/xxx/x/xxx/rules.py, line
73, in Process
match, location_info = geoip.GeoIP_Org.match(params, rule, geoip_ck)
File
/base/data/home/apps/xxx/x/xxx/matchers/geoip.py, line
101, in match
return klass.compute_match(params, rule, cookie,
storageclass=models.GeoIPOrg)
File
/base/data/home/apps/xxx/x/xxx/matchers/geoip.py, line
38, in compute_match
geoip_row = klass.fetch_row(storageclass, params)
File
/base/data/home/apps/xxx/x/xxx/matchers/geoip.py, line
68, in fetch_row
cached_row = memcache.get(klass._row_key(addr))
File
/base/python_runtime/python_lib/versions/1/google/appengine/api/memcache/__init__.py,
line 563, in get
results = rpc.get_result()
File
/base/python_runtime/python_lib/versions/1/google/appengine/api/apiproxy_stub_map.py,
line 592, in get_result
return self.__get_result_hook(self)
File
/base/python_runtime/python_lib/versions/1/google/appengine/api/memcache/__init__.py,
line 628, in __get_hook
self._do_unpickle)
File
/base/python_runtime/python_lib/versions/1/google/appengine/api/memcache/__init__.py,
line 271, in _decode_value
return do_unpickle(value)
File
/base/python_runtime/python_lib/versions/1/google/appengine/api/memcache/__init__.py,
line 404, in _do_unpickle
return unpickler.load()
File /base/python_runtime/python_dist/lib/python2.5/pickle.py, line
852, in load
dispatch[key](self)
File /base/python_runtime/python_dist/lib
[google-appengine] amount increases on billing report
Hello All, Just checking... Not sure if I'm missing something. But, is it only with my appids, or any of you noticed a increase of amounts on billing history since March 05 ? I can confirm that it is happening, on 2 of my appids. I did not notice any traffic increase or anything that would justify the amount increase. In fact, I noticed a decrease on traffic on both appids. python2.5 HRD Thank you very much. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] My expirencie with python 2.7 and others
Hi,
I will try to be objective:
The problems that I found:
1 - Seems that datetime.datetime.strptime is not threadsafe (
https://groups.google.com/group/google-appengine-python/browse_thread/thread/efbcffa181c32f33/48afebe467861674?pli=1
)
I needed to put a call to it on appengine_config.py following
http://bugs.python.org/issue7980
2 - webapp2 follow PEP333, it seems that's why you need to specify
str().encode('ascii') when sending response headers.
I mean, if you do not specify it, str() will be the default coding (utf8
in my case).
3 - I'm not sure if before python2.7/webapp2, it was ok send ',' on cookie
header. But, it was working on python2.5 and webapp.
With python2.7 and webapp2 it stoped working. I replace it with '_' on
cookie header.
Now, the real problems:
On python 2.5:
most requests to my app uses only memcache.incr()/get()/set(). Some times
the only thing that I need to do is an incr().
I'm using a global dict to cache things, and it was working pretty well.
My instances latency is something *from 120ms to 200ms.*
incr() is running* ~5ms,* same to get/set. Not more than *20ms*
My app is CPU intensive, and is consuming* ~180 CPU seconds/sec running at
1300 req/sec*
When I turn on appstats I'm able to see that my code (between the rpc
calls) runs *from 80ms to 120ms, some times 20ms.*
After changing to python 2.7 I noticed that inc()/get()/set() (memcache)
takes *100ms+* to run.
My code takes *1000ms+ to run.*
Cpu seconds is* 350 CPU seconds/sec running at 1300 req/sec.*
Instances latency increased to ~500ms
In my opinion
http://code.google.com/p/googleappengine/issues/detail?id=6323should
be reopened.
It's true that the latency is much better before issue 6323 be closed, but
still not acceptable.
Also, it's true that when using python 2.7 threadsafe=yes, the scheduler
starts half of instances when running on python 2.5.
But again, the latency is too high.
By the way, I still not comfortable with the instance scheduler.
Another thing that I noticed, is that when I change from python2.7 to
python2.5 (appengine admin/versions), I get strange memcache errors:
class Reference has no attribute '__new__'
Traceback (most recent call last):
File
/base/python_runtime/python_lib/versions/1/google/appengine/ext/webapp/_webapp25.py,
line 701, in __call__
handler.get(*groups)
File /base/data/home/apps/xxx/x/xxxviews.py, line 29,
in get
self._get()
File /base/data/home/apps/xxx/x/xxx/views.py, line 83,
in _get
output = rules.Process(nid, h, data, r, self.request)
File /base/data/home/apps/xxx/x/xxx/rules.py, line 73,
in Process
match, location_info = geoip.GeoIP_Org.match(params, rule, geoip_ck)
File /base/data/home/apps/xxx/x/xxx/matchers/geoip.py,
line 101, in match
return klass.compute_match(params, rule, cookie,
storageclass=models.GeoIPOrg)
File /base/data/home/apps/xxx/x/xxx/matchers/geoip.py,
line 38, in compute_match
geoip_row = klass.fetch_row(storageclass, params)
File /base/data/home/apps/xxx/x/xxx/matchers/geoip.py,
line 68, in fetch_row
cached_row = memcache.get(klass._row_key(addr))
File
/base/python_runtime/python_lib/versions/1/google/appengine/api/memcache/__init__.py,
line 563, in get
results = rpc.get_result()
File
/base/python_runtime/python_lib/versions/1/google/appengine/api/apiproxy_stub_map.py,
line 592, in get_result
return self.__get_result_hook(self)
File
/base/python_runtime/python_lib/versions/1/google/appengine/api/memcache/__init__.py,
line 628, in __get_hook
self._do_unpickle)
File
/base/python_runtime/python_lib/versions/1/google/appengine/api/memcache/__init__.py,
line 271, in _decode_value
return do_unpickle(value)
File
/base/python_runtime/python_lib/versions/1/google/appengine/api/memcache/__init__.py,
line 404, in _do_unpickle
return unpickler.load()
File /base/python_runtime/python_dist/lib/python2.5/pickle.py, line
852, in load
dispatch[key](self)
File /base/python_runtime/python_dist/lib/python2.5/pickle.py, line
1077, in load_newobj
obj = cls.__new__(cls, *args)
AttributeError: class Reference has no attribute '__new__'
I'm also trying to contact premier account sales team, but without success.
It is very frustrating when you don't have to who ask for help.
I know that there are a lot of good souls here :-) but most of time people
are busy trying to solve their own problems.
Making long story short,
I need to choose between, save money (half of instances) or run fast. That
should make sense, but in my opinion,
python 2.7 should comes to save us money, running at same speed of python
2.5.
Am I wrong ?
Thank you for listening me :-)
Cheers
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
Re: [google-appengine] My expirencie with python 2.7 and others
Thanks for your answer Brandon. Let me see if I understand. I'm like only 0.1% API calls CPU. You are saying that threadsafe is not a good idea to me ? I mean, instances were cuted to half, but latency was the double of python 2.5. Thanks again. On Thu, Mar 8, 2012 at 7:27 PM, Brandon Wirtz drak...@digerat.com wrote: I need to choose between, save money (half of instances) or run fast. That should make sense, but in my opinion, python 2.7 should comes to save us money, running at same speed of python 2.5. Am I wrong ? ** ** Yes you are wrong. Thread safe only saves you money if you are waiting on API’s enough to save money. ** ** If you look at your Dashboard and 85% of your CPU usage is API’s you will likely go faster and save money with Thread safe. if you are 85% CPU, unless you always have 10 instances you may save a little money but you will go slower. ** ** If you are at 50% API’s and always have 20 instances, thread safe will make you a lot faster and cut your bill in half. ** ** ** ** -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] More than 1800 QPS
in python: http://code.google.com/appengine/docs/python/datastore/functions.html#create_config On Wed, Feb 22, 2012 at 11:19 PM, Scott Murphy sc...@pixoto.com wrote: One suggestion would be to figure out what the typical response time is then set a lower deadline, such as 5 seconds. How do you lower the deadline? Best, Scott -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/57BZHFj8zPMJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: is app engine down? I'm seeing a huge number of deadline errors and our app failing to server, hr datastore
same here DeadlineExceededError: The API call datastore_v3.Put() took too long to respond and was cancelled. Python 2.5/HR On Fri, Jan 27, 2012 at 12:34 PM, Tom Willis tom.wil...@gmail.com wrote: I'm seeing it too actually. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/uU9Sw0wDP1sJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] hidden appengine alerts
Hello all, Anyone here is subscribed to http://code.google.com/status/appengine rss feed ? It's common to me to get messages like: (title unknown) http://code.google.com/status/appengine by appengine.noreply 2012-01-13T02:13:23Z 2012-01-13T02:13:23Z Online Investigation Complete - This alert is hidden from users because the title is blank. Today I got 14 of this What that means ? the rss feed is: http://code.google.com/status/appengine/alert_feed.xml -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] strange behavior memcache/taskqueue/datastore
Hello friends,
I'm getting a strange task queue/datastore/memcache behavior.
I have something like the following code:
report = memcache.get(id)
if not report:
try:
if not deferred.defer(self.addindex, id=id):
logging.error('cannot store task for report index')
report = False
else:
memcache.set(id, 1)
except:
logging.error('cannot store task for report index')
report=False
def addindex(id)
reportindex=Foo(id=id)
try:
reportindex.put()
except Exception, e:
logging.error('can not put report index')
When I can not put 'reportindex' I'm getting the logging.error as expected.
But some times, I don't get the error, and don't have related id into the
DS.
To prove that was an error, I wrote to run every hour something like:
for x in range(startid, lastid):
if memcache.get('%s' % x) and not Foo.all().filter('id', x).fetch(1):
logging.error('there is no register for id %s' %x)
a=Foo(id=x)
a.put()
The problem is that I need Foo() to index memcache.
Is this an expected behavior ?
Should I trust on deferred.defer() ?
Thanks a lot
Felippe Bueno
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] strange behavior memcache/taskqueue/datastore
Hi Nicholas,
Thanks for your reply.
This was one of my concerns. Even running my loop only one time per hour.
So, to prove again that there is a strange behavior , I changed the loop to:
for x in range(startid, lastid):
r=memcache.get('%s' % x)
if r and r 50 and not Foo.all().filter('id', x).fetch(1):
logging.error('there is no register for id %s' %x)
a=Foo(id=x)
a.put()
It's ok to assume that I will not have 50 requests (each request do a
memcache.incr()) in less than 3 minutes.
Doing this way, it seems even more, that there is something wrong. I'm not
sure if it is me that doing it wrong :-).
thatnks again.
On Wed, Jan 4, 2012 at 6:26 PM, Nicholas Verne nve...@google.com wrote:
How long after the call to deferred.defer are you running the loop
that checks that datastore has a record for each value in memcache?
Perhaps you're running the loop before a deferred task has had a
chance to run, in some cases?
Nick Verne
On Thu, Jan 5, 2012 at 4:09 AM, Felippe Bueno felippe.bu...@gmail.com
wrote:
Hello friends,
I'm getting a strange task queue/datastore/memcache behavior.
I have something like the following code:
report = memcache.get(id)
if not report:
try:
if not deferred.defer(self.addindex, id=id):
logging.error('cannot store task for report index')
report = False
else:
memcache.set(id, 1)
except:
logging.error('cannot store task for report index')
report=False
def addindex(id)
reportindex=Foo(id=id)
try:
reportindex.put()
except Exception, e:
logging.error('can not put report index')
When I can not put 'reportindex' I'm getting the logging.error as
expected.
But some times, I don't get the error, and don't have related id into the
DS.
To prove that was an error, I wrote to run every hour something like:
for x in range(startid, lastid):
if memcache.get('%s' % x) and not Foo.all().filter('id', x).fetch(1):
logging.error('there is no register for id %s' %x)
a=Foo(id=x)
a.put()
The problem is that I need Foo() to index memcache.
Is this an expected behavior ?
Should I trust on deferred.defer() ?
Thanks a lot
Felippe Bueno
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] strange behavior memcache/taskqueue/datastore
Hi Nick.
I sent it to you in a private message.
Thank you very much.
On Wed, Jan 4, 2012 at 6:55 PM, Nicholas Verne nve...@google.com wrote:
What's your app id?
Nick Verne
On Thu, Jan 5, 2012 at 7:44 AM, Felippe Bueno felippe.bu...@gmail.com
wrote:
Hi Nicholas,
Thanks for your reply.
This was one of my concerns. Even running my loop only one time per hour.
So, to prove again that there is a strange behavior , I changed the loop
to:
for x in range(startid, lastid):
r=memcache.get('%s' % x)
if r and r 50 and not Foo.all().filter('id', x).fetch(1):
logging.error('there is no register for id %s' %x)
a=Foo(id=x)
a.put()
It's ok to assume that I will not have 50 requests (each request do a
memcache.incr()) in less than 3 minutes.
Doing this way, it seems even more, that there is something wrong. I'm
not
sure if it is me that doing it wrong :-).
thatnks again.
On Wed, Jan 4, 2012 at 6:26 PM, Nicholas Verne nve...@google.com
wrote:
How long after the call to deferred.defer are you running the loop
that checks that datastore has a record for each value in memcache?
Perhaps you're running the loop before a deferred task has had a
chance to run, in some cases?
Nick Verne
On Thu, Jan 5, 2012 at 4:09 AM, Felippe Bueno felippe.bu...@gmail.com
wrote:
Hello friends,
I'm getting a strange task queue/datastore/memcache behavior.
I have something like the following code:
report = memcache.get(id)
if not report:
try:
if not deferred.defer(self.addindex, id=id):
logging.error('cannot store task for report index')
report = False
else:
memcache.set(id, 1)
except:
logging.error('cannot store task for report index')
report=False
def addindex(id)
reportindex=Foo(id=id)
try:
reportindex.put()
except Exception, e:
logging.error('can not put report index')
When I can not put 'reportindex' I'm getting the logging.error as
expected.
But some times, I don't get the error, and don't have related id into
the
DS.
To prove that was an error, I wrote to run every hour something like:
for x in range(startid, lastid):
if memcache.get('%s' % x) and not Foo.all().filter('id',
x).fetch(1):
logging.error('there is no register for id %s' %x)
a=Foo(id=x)
a.put()
The problem is that I need Foo() to index memcache.
Is this an expected behavior ?
Should I trust on deferred.defer() ?
Thanks a lot
Felippe Bueno
--
You received this message because you are subscribed to the Google
Groups
Google App Engine group.
To post to this group, send email to
google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
--
You received this message because you are subscribed to the Google
Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: DeadlineExceededError on HRD and sky-high latency (python27+threadsafe)
Hello All, Someone has any work around for this, or aren't you using python27+threadsafe ? Thank you very much. Hello Googlers, Any progress or prevision on this ? It is very frustrating having python 2.7 without thread safe. I'm also trying to contact premier account's email but without success. I'd like to get real support. About 6323, is it really medium priority ? I think this is a high priority issue. Any way. Thanks On Wed, Dec 7, 2011 at 7:11 PM, sergio.jar...@gmail.com sergio.jar...@gmail.com wrote: Hi, Brian, Gregory Thanks for your valuable insights! I did know about the issue 6323 and had stared it. However I was not sure it was the same as the issue mentioned CPU bound requests. My app is very much RPC bound. I've added a comment to this thread to the issue and I've set threadsafe: no and will monitor. So far latency seems Ok and the number of instances is 5x-6x of when I had threadsafe: yes. I do agree with Felippe, we should be able to maintain the 50% discount until python27 and threadsafe are fully supported. This is also making things worse - it seems the minimum latency is not being enforced correctly, I also have this. http://code.google.com/p/googleappengine/issues/detail?id=5765can=5sort=-statuscolspec=ID%20Type%20Component%20Status%20Stars%20Summary%20Language%20Priority%20Owner%20Log Sérgio On Dec 7, 5:12 am, Gregory D'alesandre gr...@google.com wrote: Hi Felippe, As you noted Python 2.7 is released. While Python 2.7 is still experimental it is working well for some but indeed there are still issues before it will be fully GA. There was a concern that we were abandoning Python because there was no solution for concurrent requests. Python 2.7, even in its current state, shows that we are not abandoning Python. We tried our best to make appropriate trade-offs with the new pricing model but at some point we needed to roll it out for the reasons we've discussed at length in the past. For instance, when this was written we were also going to launch the new pricing 1.5 months earlier than we actually released it, which likely saved you quite a bit of money, as opposed to this which is costing you more. While my guess is you'd still rather that the 50% discount persisted I hope that answers your question, Greg On Tue, Dec 6, 2011 at 5:29 PM, Felippe Bueno felippe.bu...@gmail.com wrote: On Tue, Dec 6, 2011 at 8:56 PM, Brian Quinlan bquin...@google.com wrote: There is a known bug where the combination of Python 2.7 and enabling concurrent requests causes large latency increases. The Python 2.7 runtime is still experimental and bugs like this are expected. Ok, I understand that. Greg, could you please let us know why we have the new full-sized instance hour for python and still not have python concurrent requests ? I'm asking because you wrote http://groups.google.com/group/google-appengine/browse_thread/thread/... : Q: Will there be a solution for Python concurrency? Will this require any code changes? Python concurrency will be handled by our release of Python 2.7 on App Engine. We’ve heard a lot of feedback from our Python users who are worried that the incentive is to move to Java because of its support for concurrent requests, so we’ve made a change to the new pricing to account for that. *While Python 2.7 support is currently in progress it is not yet done *so we will be ** providing a half-sized instance for Python (at half the price) until Python 2.7 is released.* * Ok, I know. It was already released (as experimental), but I thought that the purpose to holding full-sized instances was to give to python users the concurrent requests. Thanks -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: URGENT: Re posting, Google Please respond
If you are calling the same memcache key too much, you can have contention. You could try to use memcache key sharding, or global dicts before geting data from memcache. Global variables are cached, so this could help if your problem is memcache contention. On Thu, Dec 8, 2011 at 1:25 AM, smwatch showm...@gmail.com wrote: Our main calls are just to memcache api, url fetch calls are 1 per million in the code. It there a way to timeout the requests, or block the number of max instances, This problem of high instance happened all days today and our billing ran out. As we said the code never changed, how can we control this and be able to use the service normally. Are our application settings correct in terms of open instance and timeout settings. Current we have disabled the memcahce calls in code (making the code useless) and the instances are running at 30 instead of 400 On Dec 7, 6:39 pm, Jon McAlister jon...@google.com wrote: I took a look. Not yet sure what the cause was, but perhaps these data will help you. First thing was to zoom-in on the relationship between latency and instances. Attached is the graph. You can see there that first latencies shoot up, and then subsequently the scheduler is adding instances, and then latencies drop. Then, the scheduler starts releasing instances. There are two clear examples of this multi-phased-reaction-cycle in the graph. Zooming in on the logs at 16:40 (an interesting point because the latency just shot up) you can see many examples where ms= is around 3-4 seconds and pending_ms= is near zero: https://appengine.google.com/logs?app_id=showmypcversion_id=1.355223... Which suggests that the app code is stuck doing something, but since cpu_ms=0 it must just be waiting on an api call. Now, the app primarily uses the memcache api, but it also uses the urlfetch api to make requests to service1.showmypc.com. One possible explanation is that this remote website went down, causing all your instances to hang, further incoming requests to go to the pending queue, and the scheduler to go into reactive mode. At present, the scheduler doesn't try to specifically diagnose that the app is down in a way where more instances wouldn't help, it just keeps adding. But I don't have concrete proof that this explains what happened in these time periods, it's just what stands out in the data. On Wed, Dec 7, 2011 at 6:29 PM, smwatch showm...@gmail.com wrote: We are using Python 2.6 and not yet on HRD Please suggest what else could it be, can someone from google see into our application console , why suddenly after months of running, so many instances came and blew the top of our daily limits. As I said no new traffic at all, this is a usual controlled traffic. The only thing I can see was the maintenance google did yesterday. On Dec 7, 5:12 pm, Felippe Bueno felippe.bu...@gmail.com wrote: Are you using python 2.7 ? HRD ? Python 2.7 has a known issue in combination with threadsafe: yes see issue 6323 On Wed, Dec 7, 2011 at 11:03 PM, smwatch showm...@gmail.com wrote: NOW our billing rate out. Today we are seeing upto 400 Frontend Instances , with the usual normal traffic and our daily billing is ready to expire. Our usual number of Instances that are shown on any average day are 6 instance, we have a Limit of maximum 1 idle instance. Traffic is normal, but we see a lot of errors reported in last 6 hours. No new code has been deployed in last many days, no other billing errors. Anyone from Google please suggest whats going on? What can we do here in this case. We just try to do a dummy deployment with minor valid change in the code to see if the instances kill themselves but still the problem remains and our money is running out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com . To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group athttp:// groups.google.com/group/google-appengine?hl=en. Screenshot-8.png 37KViewDownload -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr
[google-appengine] monitoring quotas
Hello all. I'm writing to ask how you guys monitor the GAE quota. I mean, I was parsing the quota details page... which is ugly and not so effective, to pass to zabbix or nagios. I know that are plans to launch an official api to do that (google-appengine-monitoring-api) but don't know when it will be released. So, I was wondering how do you do this monitoring work. Also if you grab some kind of data to plot graphics. Thanks -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Premier Accounts
Hello all, I'm trying to contact appengine_premier_reque...@google.com, but I'm not getting answers any more. So, I was wondering if some of you could help me with my doubts. Hi, I have 3 differents domains. Could I setup only one premier account for all my apps ? I have 4 apps, and only 3 of them use domains. The rest uses .appspot.com domain. How to proceed in this situation ? Thanks a lot :) -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Premier Accounts
I went here http://code.google.com/appengine/docs/premier/index.html... I think that apps must be associated with some domain on google apps. That's why I'm asking if I need 3 differents premier accounts to my 3 apps on diferents domains. Also, how to proceed with 1 app that don't have any google apps domain associated with it ? Thanks On Thu, Dec 8, 2011 at 7:01 PM, Brandon Wirtz drak...@digerat.com wrote: Premiere accounts can have unlimited apps underneath. That is a selling point. You no longer pay the $2.10 a week per app, you only pay for the resources you use. ** ** ** ** *From:* google-appengine@googlegroups.com [mailto: google-appengine@googlegroups.com] *On Behalf Of *Felippe Bueno *Sent:* Thursday, December 08, 2011 12:50 PM *To:* google-appengine@googlegroups.com; google-appengine-pyt...@googlegroups.com *Subject:* [google-appengine] Premier Accounts ** ** Hello all, ** ** I'm trying to contact appengine_premier_reque...@google.com, but I'm not getting answers any more. ** ** So, I was wondering if some of you could help me with my doubts. ** ** Hi, I have 3 differents domains. Could I setup only one premier account for all my apps ? I have 4 apps, and only 3 of them use domains. The rest uses .appspot.com domain. How to proceed in this situation ? ** ** ** ** Thanks a lot :) ** ** -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] URGENT: Re posting, Google Please respond
Are you using python 2.7 ? HRD ? Python 2.7 has a known issue in combination with threadsafe: yes see issue 6323 On Wed, Dec 7, 2011 at 11:03 PM, smwatch showm...@gmail.com wrote: NOW our billing rate out. Today we are seeing upto 400 Frontend Instances , with the usual normal traffic and our daily billing is ready to expire. Our usual number of Instances that are shown on any average day are 6 instance, we have a Limit of maximum 1 idle instance. Traffic is normal, but we see a lot of errors reported in last 6 hours. No new code has been deployed in last many days, no other billing errors. Anyone from Google please suggest whats going on? What can we do here in this case. We just try to do a dummy deployment with minor valid change in the code to see if the instances kill themselves but still the problem remains and our money is running out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: DeadlineExceededError on HRD and sky-high latency (python27+threadsafe)
On Tue, Dec 6, 2011 at 8:56 PM, Brian Quinlan bquin...@google.com wrote: There is a known bug where the combination of Python 2.7 and enabling concurrent requests causes large latency increases. The Python 2.7 runtime is still experimental and bugs like this are expected. Ok, I understand that. Greg, could you please let us know why we have the new full-sized instance hour for python and still not have python concurrent requests ? I'm asking because you wrotehttp://groups.google.com/group/google-appengine/browse_thread/thread/a1bfa432e0c002a7/739169f799d8e69a : Q: Will there be a solution for Python concurrency? Will this require any code changes? Python concurrency will be handled by our release of Python 2.7 on App Engine. We’ve heard a lot of feedback from our Python users who are worried that the incentive is to move to Java because of its support for concurrent requests, so we’ve made a change to the new pricing to account for that. *While Python 2.7 support is currently in progress it is not yet done *so we will be ** providing a half-sized instance for Python (at half the price) until Python 2.7 is released.* * Ok, I know. It was already released (as experimental), but I thought that the purpose to holding full-sized instances was to give to python users the concurrent requests. Thanks -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] datastore admin
Hello all,
I'm not sure if I'm missing something, but I can't use datastore admin
features.
I have enabled it on app.yaml.
When I try to copy or delete entities I got the errors bellow:
On datastore admin page:
Copy Job Status
There was a problem kicking off the jobs. The error was:
'module' object has no attribute 'dumps'
On logs page:
2011-10-11 17:14:36.604
Handling exception.
Traceback (most recent call last):
File
/base/python_runtime/python_lib/versions/1/google/appengine/ext/datastore_admin/copy_handler.py,
line 164, in post
mapper_params)
File
/base/python_runtime/python_lib/versions/1/google/appengine/ext/datastore_admin/utils.py,
line 501, in RunMapForKinds
operation, job_name, handler_spec, reader_spec, mapper_params))
File
/base/python_runtime/python_lib/versions/1/google/appengine/ext/datastore_admin/utils.py,
line 471, in StartMap
return db.run_in_transaction(tx)
File
/base/python_runtime/python_lib/versions/1/google/appengine/api/datastore.py,
line 2355, in RunInTransaction
return RunInTransactionOptions(None, function, *args, **kwargs)
File
/base/python_runtime/python_lib/versions/1/google/appengine/api/datastore.py,
line 2477, in RunInTransactionOptions
ok, result = _DoOneTry(new_connection, function, args, kwargs)
File
/base/python_runtime/python_lib/versions/1/google/appengine/api/datastore.py,
line 2499, in _DoOneTry
result = function(*args, **kwargs)
File
/base/python_runtime/python_lib/versions/1/google/appengine/ext/datastore_admin/utils.py,
line 469, in tx
transactional=True)
File
/base/python_runtime/python_lib/versions/1/google/appengine/ext/mapreduce/control.py,
line 110, in start_map
transactional=transactional)
File
/base/python_runtime/python_lib/versions/1/google/appengine/ext/mapreduce/handlers.py,
line 832, in _start_map
kickoff_params = {mapreduce_spec: mapreduce_spec.to_json_str()}
File
/base/python_runtime/python_lib/versions/1/google/appengine/ext/mapreduce/model.py,
line 95, in to_json_str
return simplejson.dumps(json, sort_keys=True)
AttributeError: 'module' object has no attribute 'dumps'
Is there anyone having this issue ?
Thank you.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Can't deploy and errors 500 on admin console
+1 On Tue, Oct 4, 2011 at 6:12 PM, Jason Collins jason.a.coll...@gmail.com wrote: Very slow and/or 500 pages for me on the console. On Oct 4, 3:05 pm, voscausa robert@gmail.com wrote: I have the same problem : During application deployment the logs says : Rolling back the update. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: New Pricing ROCKS! for Small apps
I had significant pricing changes on my apps. I have 3 apps appid1 ~1500 rec/sec dropped from ~$170 to ~$75 (per day) appid2 ~150 rec/sec dropped from ~$11 to $7 (per day) appid3 ~4 rec/sec increases from $0 to ~$0.13 (per day) All data store reads operation are made using key_names. I use global variables in conjuction with memcache, and all data store writes are made using tasks. Still, I don't use datastore so much. I know that, for my tiny appid3 the price will increase. But in my case it will compensate by the price drop for the other 2 appids. On Sun, Sep 18, 2011 at 2:21 PM, Bay troels...@gmail.com wrote: lets also keep in mind that your app will be slower and have more latency than before. You had enabled 3 instances always on. If you aim for that under the new pricing regime you will pay a lot more than .09/day... You might not be comparing apples and oranges. But you are comparing one apple with three apples - and pretending it is the same amount of apples. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/fgnBQoETYP0J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] error on ds admin
When trying to delete entities
/_ah/datastore_admin/delete.do
Could not serialize JSON: {'mapreduce_id': '1586385529922B7DDED38',
'mapper_spec': {'mapper_shard_count': 32, 'mapper_params': {'entity_kind':
u'ReportIndex'}, 'mapper_input_reader':
'google.appengine.ext.mapreduce.input_readers.DatastoreKeyInputReader',
'mapper_handler_spec':
'google.appengine.ext.datastore_admin.delete_handler.DeleteEntity'},
'params': {'force_writes': 'True', 'datastore_admin_operation':
'ag1zfmJ0YnVja2V0c2hyciULEhxfQUVfRGF0YXN0b3JlQWRtaW5fT3BlcmF0aW9uGI-2zSwM',
'done_callback': '/_ah/datastore_admin/mapreduce_done'}, 'name': u'Delete
all ReportIndex objects', 'hooks_class_name': None} Traceback (most recent
call last): File
/base/python_runtime/python_lib/versions/1/google/appengine/ext/mapreduce/model.py,
line 95, in to_json_str return simplejson.dumps(json, sort_keys=True)
AttributeError: 'module' object has no attribute 'dumps'
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: error on ds admin
same when trying to copy entities to another appid.
I forgot to say that I see the messagem below after clicking delete
entities or copy entities:
There was a problem kicking off the jobs. The error was:
'module' object has no attribute 'dumps'
ps - python env
On Wed, Sep 14, 2011 at 12:27 PM, Felippe Bueno felippe.bu...@gmail.comwrote:
When trying to delete entities
/_ah/datastore_admin/delete.do
Could not serialize JSON: {'mapreduce_id': '1586385529922B7DDED38',
'mapper_spec': {'mapper_shard_count': 32, 'mapper_params': {'entity_kind':
u'ReportIndex'}, 'mapper_input_reader':
'google.appengine.ext.mapreduce.input_readers.DatastoreKeyInputReader',
'mapper_handler_spec':
'google.appengine.ext.datastore_admin.delete_handler.DeleteEntity'},
'params': {'force_writes': 'True', 'datastore_admin_operation':
'ag1zfmJ0YnVja2V0c2hyciULEhxfQUVfRGF0YXN0b3JlQWRtaW5fT3BlcmF0aW9uGI-2zSwM',
'done_callback': '/_ah/datastore_admin/mapreduce_done'}, 'name': u'Delete
all ReportIndex objects', 'hooks_class_name': None} Traceback (most recent
call last): File
/base/python_runtime/python_lib/versions/1/google/appengine/ext/mapreduce/model.py,
line 95, in to_json_str return simplejson.dumps(json, sort_keys=True)
AttributeError: 'module' object has no attribute 'dumps'
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Quota debugger needed
+1 On Thu, Sep 1, 2011 at 11:11 AM, Rohan Chandiramani masterxr...@gmail.comwrote: +1 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/G9TxhV2P4dUJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: delaying pricing change
+1 google On Thu, Sep 1, 2011 at 2:31 PM, Angke manc...@gmail.com wrote: +1984 On Sep 1, 9:28 am, bFlood bfl...@spatialdatalogic.com wrote: +100 On Sep 1, 12:23 pm, Mark Bucciarelli mkb...@gmail.com wrote: i assume you guys must be getting some serious pressure from upper management to start making some money here. but asking us to: (1) convert to HR to get the SLA and (2) convert to multithreading is asking a lot. asking it in a short time frame is not realistic, especially for someone running a large app in production with many users. threads suck. they introduce a ton of complexity---race conditions that are hard to imagine, and mostly impossible to reproduce in a reliable way during unit testing. is there any possibility you can delay the price increase until after 2.7 is out and you have published some good docs on how to safely move to multi-threading and HR? thanks, m -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Fontend instance hours seem to be a bit overcharged
Max idle instances only sets the maximum number of idle instances that will be running to prepare for traffic, *not the number of total instances that can run at any one time.* Would be possible to do that some day ? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] A comparison of your current bill against the new pricing model is now available in the Billing History page.
appid1 ~50% appid2 ~340% appid3 ~3200% I just limited my idle instances (to 3). It seems that are some thing wrong *Instances *[image: help]http://code.google.com/appengine/docs/adminconsole/instances.html QPS*Latency*RequestsErrorsAgeMemoryAvailability *0.000* *0.0 ms* *104* 0 *18:39:24* 14.9 MBytes [image: Resident Icon] Resident *0.000* *0.0 ms* *82* 0 *18:44:27* 12.2 MBytes [image: Resident Icon]Resident 0.017 78.0 ms 297 0 18:38:45 15.4 MBytes [image: Resident Icon]Resident 0.317 24.5 ms 1468 0 0:44:29 15.9 MBytes [image: Dynamic Icon]Dynamic 0.617 14.7 ms 9641 0 3:51:11 24.4 MBytes [image: Dynamic Icon] Dynamic 0.700 15.5 ms 2742 0 0:55:25 16.1 MBytes [image: Dynamic Icon] Dynamic It seems that 3 instances would be enough to serve my app, but appengine starts extra instances, and don't send requests to my resident instances. On Wed, Aug 31, 2011 at 5:28 PM, Waleed Abdulla wal...@ninua.com wrote: It's 300% for me (3x what I pay now). Most of the cost is datastore writes and reads, followed by instance hours. On Wed, Aug 31, 2011 at 1:26 PM, pdknsk pdk...@googlemail.com wrote: It's an about 50% increase for me, because of datastore writes. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: A comparison of your current bill against the new pricing model is now available in the Billing History page.
Greg, How could us start using it (reserved instance) before new pricing ? I'm asking because I think that what increases the instance hours is the 15-min startup penalization, am I wrong ? On Wed, Aug 31, 2011 at 5:56 PM, Gregory D'alesandre gr...@google.comwrote: Hey Robert, the simplest thing that will reduce your bill will be to use reserved instance hours. The bill estimates are for full priced instance-hours. Are most of the apps java or python? If java, are you using concurrent requests? If python, do you want to participate in the python2.7 trusted tester to try out concurrent requests and give us feedback? https://docs.google.com/spreadsheet/viewform?formkey=dDVaelk0NkhHMVA2NU5kS1hfajNfM0E6MQ Thanks! Greg On Wed, Aug 31, 2011 at 1:51 PM, Robert Kluin robert.kl...@gmail.comwrote: My apps *are* quite optimized. They are extremely fast, consume, minimal RAM and very little CPU -- but there isn't much I can do about the number of instances used. I consistently see well under 2 QPS / instance -- for requests that always return in under 200ms. Seems like the scheduler is performing quite poorly. On Wed, Aug 31, 2011 at 15:36, Alon (Google) al...@google.com wrote: Please make sure to look at the strategies outlined in our new article to try to optimize your app's resource usage: http://code.google.com/appengine/articles/managing-resources.html On Aug 31, 1:33 pm, Robert Kluin robert.kl...@gmail.com wrote: Instance hours are the killer here too, seeing between 2x and 4x depending on the app (with 50% discount). On Wed, Aug 31, 2011 at 15:28, Waleed Abdulla wal...@ninua.com wrote: It's 300% for me (3x what I pay now). Most of the cost is datastore writes and reads, followed by instance hours. On Wed, Aug 31, 2011 at 1:26 PM, pdknsk pdk...@googlemail.com wrote: It's an about 50% increase for me, because of datastore writes. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: A comparison of your current bill against the new pricing model is now available in the Billing History page.
+1 On Wed, Aug 31, 2011 at 6:26 PM, Vivek Puri v...@vivekpuri.com wrote: My bill is up by almost 3 times. I dont think i have the money to pay for that. And the mid-september date is too near to be able to do anything about it. While Greg's reserved instance idea is great, but i dont think it can push down the bill as much for a app owner since you might be either under utilizing or over buying, either way loosing money. Besides that, in the past 2 weeks i have seen random upward and downward trends in instance count for my app, which make no sense to me at all. I have observed my app using 100 instances and then climbing to 200+ and then coming back to 130-140 range for pretty much similar number of requests/sec. I dont think the scheduler is ready for prime time pricing change. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Time for a community-sourced Google App Status page?
Sounds good. +1 ps - I also had problems yesterday. On Thu, Aug 25, 2011 at 4:34 PM, Mike Lawrence m...@systemsplanet.comwrote: https://lh5.googleusercontent.com/-9Pc3z3hf7bM/Tlad9xaPGoI/ABo/rxXUUy89RUI/appstats1.jpg Hope this post doesn't get me in trouble with my Google friends, but I've about had it with the Google App Engine System Status page. http://code.google.com/status/appengine Yesterday my app was unreachable four times with 500 error pages, but the System Status page above shows no issues. *Google Enterprise Support:* *I can confirm that we had a transient infrastructure issue that caused a temporary increase of latency that affected your application instances. This should now be fixed as traffic has been moved to different datacenters. * I'd prefer Google fix/enhance their App Status page so we have more visibility to what's really going on. But, It's probably not in Googles best interest since Amazon will likely use it against them for marketing FUD. So, how about we build our own App Status page that transparently collects and reports app status? We could: 1. build and publish source to a simple custom servlet that Java developers could add to their apps eg: http://appid.appspot.com/appstatus that returns json data that we can aggregate into a community-sourced system status page. 2. build an app engine site a. for registering your app engine URL and how often you want it tested b. viewing the current combined status of all sites c. polling the registered sites for status We'd probably want to add an entity (eg dual) that we could hit for testing db operations. Thoughts? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/jBAGlQh-VPcJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Receiving a memory address(?) when pulling data from datastore
Try this:
if stguess == 'new':
thisanswer = random.randint(1, 100)
answer=Answer(ans = thisanswer)
answer.put()
elif stguess != 'new':
try:
stguess = int(stguess)
q = db.GqlQuery(SELECT * FROM Answer)
q = q.fetch(1)
answer = q*[0]*
if stguess answer:
msg = ('Your guess ' + str(stguess) + ' is too
low' + str(answer*.**ans*))
You also need to deal with a possible index error when answer = q*[0]*
On Tue, Aug 16, 2011 at 9:09 PM, Matt mpiechow...@gmail.com wrote:
I'm working on my first webapp, it's a simple guess the number game
and I'm confused on using the data store. I use the datastore to store
and retrieve the current answer.
I have this which stores the current answer
class Answer(db.Model):
ans = db.IntegerProperty()
If the user enters 'new' then the new answer is created and stored in
the database
if stguess == 'new':
thisanswer = random.randint(1, 100)
answer=Answer(ans = thisanswer)
answer.put()
If they don't want a new game then take the current answer to compare
to users guess
elif stguess != 'new':
try:
stguess = int(stguess)
q = db.GqlQuery(SELECT * FROM Answer)
q = q.fetch(1)
answer = q
When I guess it always shows up as an answer of too low. I wrote this
to check what answer was when I pulled from the datastore -
if stguess answer:
msg = ('Your guess ' + str(stguess) + ' is too
low' + str(answer))
msg is displayed on screen and I get this -
Your guess 33 is too low[__main__.Answer object at
0x03C0EF98]
Does anyone know what that part following low is? It looks like a
memory address to me. And does anyone know why I cannot pull out the
random number as an integer in my example... any idea of what I can
change?
Thanks in advance.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Tradoff alias from master/slave to hrd
Hi Robert, You are right. There is no reason to let my Master/Slave appid online. Only to be sure, do you know if is it possible that some one take my master slave id while it is aliased to my HRD appid ? The migration process to HRD was smooth and easy. I used the datastore admin to copy all my data, after that, I configured a 302 redirect to my new appid. I'm using HRD for 2 days, and it seems better than M/S in terms of DeadLineExeecedError. I did not get significant changes on billing. Thank you, Felippe Bueno On Fri, Aug 12, 2011 at 1:13 PM, Robert Kluin robert.kl...@gmail.comwrote: Hey Felippe, If you've already aliased your M/S appid to your nice new HR app, what is the point in keeping the old M/S app (since you're wanting to trash the data)? Have you been happy with how your app is running since switching to HR? Any specific issues? Robert On Thu, Aug 11, 2011 at 15:28, Felippe Bueno felippe.bu...@gmail.com wrote: Hello Guys, My master/slave appid is aliased to my HRD appid (thanks). And I'd like to keep using my master/slave appid. 1 - Could I disable billing and remove all my old data from master/slave appid ? 2 - Also, is there any trad-off to my visitors/users, using this alias solution ? Thank you all. Felippe Bueno -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Tradoff alias from master/slave to hrd
Hello Guys, My master/slave appid is aliased to my HRD appid (thanks). And I'd like to keep using my master/slave appid. 1 - Could I disable billing and remove all my old data from master/slave appid ? 2 - Also, is there any trad-off to my visitors/users, using this alias solution ? Thank you all. Felippe Bueno -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] GAE Datastore Admin cannot be reached
Same here. It works for a while, and then stops working (show a blank page using google chrome). But using FF (and not chrome) it works 100%. On Sun, Jul 24, 2011 at 3:42 PM, Robert Kluin robert.kl...@gmail.comwrote: Have you redeployed your app? Is that new version default? Robert On Fri, Jul 22, 2011 at 19:18, manuela andersso...@gmail.com wrote: I have uppdated app.yaml with builtins: - datastore_admin: on but when I click on datastore admin, the web page does not display. Is this an unresolved GAE issue or have I misunderstood something? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Updated App Engine Pricing FAQ!
I was wondering, what about if I use db.create_rpc(deadline=1) Will I be charged if the deadline is reached, and I get nothing from db.get(), or db.put() ? Thanks On Wed, Jun 29, 2011 at 11:02 AM, mscwd01 mscw...@gmail.com wrote: Ikai (or any other Googler), before the new pricing begins and we are charged on a per Instance basis could you please take a look at this bug and fix it. http://code.google.com/p/googleappengine/issues/detail?id=4834 Needless, to say it's SUPER important it's fixed. I've had to set thread-safe to false to stop JDO getObjectByID() throwing an UnsupportedOperationException. Thanks On Jun 29, 4:13 am, Ikai Lan (Google) ika...@google.com wrote: Vivek, I think you are confused about the economics of competing with $5 PHP/MySQL VPSs. Ikai Lan Developer Programs Engineer, Google App Engine Blog:http://googleappengine.blogspot.com Twitter:http://twitter.com/app_engine Reddit:http://www.reddit.com/r/appengine On Tue, Jun 28, 2011 at 8:22 PM, vivpuri v...@vivekpuri.com wrote: @VInuth, if you have 5-10 requests per second and as many urls, it might be easy to calculate cost. But large applications with 100s of instances with as many requests per second and urls getting loaded, its hard to say where you will end up. I agree on latency part. For instance, the urlfetch latency is really dependent on the url being called. Besides that, such calls dont necessarily mean high memory usage or CPU usage. As Waleed said earlier, instance should be optimized to process requests when urlfetch is waiting for the response. Charging for such instances is very much an Amazon way of thinking, which was the only reason we picked AppEngine over AWS. On the whole, AppEngine team is looking for their hockey stick growth in revenues and pageviews. Not sure if their internal metric of growth was met, but going by this huge change they are making, they might be lagging. And to fix that, we have this drastic change to deal with. In my opinion, simpler change would have been supporting PHP and get tons and tons of new developers for free. For all the AppEngine team bias for PHP, PHP has the ability and volume to make and break a product like AppEngine. As for success of AWS, i think it might be more to do with the fact that you can grab a server and put PHP on it and get going, which besides Amazon, each and every hosting company has realized over the years except for Google. On Jun 28, 8:02 am, Vinuth Madinur vinuth.madi...@gmail.com wrote: I think it is fairly easy to calculate what your costs will be based purely on the latency of your requests and the number of requests you are getting. The new scheduler will anyway not affect this and based on scheduler knobs + front end instance resources, you can somewhat predict the no.of instances you might require. My gripe is, the new pricing brings latency into focus, while the developers have nothing but their app code to optimize it. The responsibility for latency is both on the application as well as underlying infrastructure. On Tue, Jun 28, 2011 at 5:04 PM, Albert albertpa...@gmail.com wrote: I'm holding 2 workshops for Google AppEngine next month. I used to look forward to encourage developers to use GAE as a development platform, but due to this new pricing changes, I'm not that excited anymore. It's not because I don't like GAE anymore. I believe that the GAE infrastructure offers a lot of value as an infrastructure. However, I really think that the pricing changes announcement was announced to early. The early announcement has caused a lot of confusion over a long period of time even until now. The most basic question that needs to be answered is How much will our apps cost to run now? Maybe sample apps and their corresponding prices will help us visualize if we should really worry about the upcoming changes. Something like... -- Sample App 1 (datastore intensive app) Average Response Time: 200ms Average # of users per day: 100K Cost / day: ??? -- Sample App 2 (Compute intensive app) Average Response Time: 800ms Average # of users per day: 100K Cost / day: ??? -- and so on... -- At least I can get a kind of official idea of the costs of running apps under the new pricing scheme. Thanks and enjoy! Albert On Jun 28, 1:23 am, vivpuri v...@vivekpuri.com wrote: There is one more option - Application just has to shutdown since there is no money to pay. If a bill of $2k per month suddenly becomes $10k per month, there are not many who can pay that. Just for comparison sake, in the US mortgage crisis, at the end of 5ARM a sudden increase in 1% of
Re: [google-appengine] App Engine 1.5.1 is out!
Nice release +1 I'm trying to use X-AppEngine-country, but I can't find any thing like it, in the headers dict (python). Is every thing ok ? Thanks On Tue, Jun 21, 2011 at 2:13 PM, Robert Kluin robert.kl...@gmail.comwrote: Nice release. Any docs online about app_identity? I quickly glanced over the app config, Users and OAuth sections, but didn't notice anything about it. Robert On Tue, Jun 21, 2011 at 05:10, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Hey guys, App Engine 1.5.1 is out! Get it while it's hot! Blog post: http://googleappengine.blogspot.com/2011/06/app-engine-151-release.html Release notes: Python ProtoRPC is a new experimental library that provides a simple method for creating a well-defined and easy-to-use web-based RPC service. The development server's datastore implementation now contains logic that closely replicates the consistency guarantees of the High Replication datastore. To use, run the dev_appserver with the flag --high_replication set to True. All user request have an X-AppEngine?-Country header which contains the ISO-3166-1 alpha-2 country code for the user, based on the IP address of the client request. Applications are now associated with an app_identity, which can be used to authenticate requests originating from the app to other services. The Channel API can now provide user presence, this can be configured by adding channel_presence to the list of inbound services for your application. The Images API now supports the WebP format. Due to limitations in PIL, the SDK does not support the WebP format. You can switch the timezone for App Engine logs in the Admin Console. http://code.google.com/p/googleappengine/issues/detail?id=734 Fixed an issue in the SDK where leased tasks had the POST method. They now have a PULL method. Fixed an issue where the Channel API didn't work with non-default versions of applications using the High Replication datastore. When displaying corrupt data in the Admin Console dataviewer, a useful error will be displayed, instead of a 500. http://code.google.com/p/googleappengine/issues/detail?id=4945 Java The development server's datastore and testing service implementations now contains logic that closely replicates the consistency guarantees of the High Replication datastore. To use, run the dev_appserver with the flag -Ddatastore.default_high_rep_job_policy_unapplied_job_pct=20. All user request have an X-AppEngine?-Country header which contains the ISO-3166-1 alpha-2 country code for the user, based on the IP address of the client request. Applications are now associated with an app_identity, which can be used to authenticate requests originating from the app to other services. The Channel API can now provide user presence, this can be configured by adding channel_presence to the list of inbound services for your application. The Images API now supports the WebP format. You can switch the timezone for App Engine logs in the Admin Console. http://code.google.com/p/googleappengine/issues/detail?id=734 Added javax.xml.ws.Service$Mode to the whitelist. http://code.google.com/p/googleappengine/issues/detail?id=4770 You can configure your application to asynchronously write https session data by adding lt;async-session-persistence enabled=true/gt; to your appengine-web.xml. http://code.google.com/p/googleappengine/issues/detail?id=1692 The local task queue unit testing API now supports Deferred Tasks. Fixed an issue where using reserved URLs did not cause an error in the SDK. Fixed an issue where having a backends.xml configuration file caused logging to stdout to fail in the SDK. Fixed an issue where the Channel API didn't work with non-default versions of applications using the High Replication datastore. Fixed an issue where the Remote API rtok comparison was broken for some users, causing appfcg download data to fail. Fixed an issue with the SDK where you could not apply a transform to PNG images.http://code.google.com/p/googleappengine/issues/detail?id=3458 When displaying corrupt data in the Admin Console dataviewer, a useful error will be displayed, instead of a 500. http://code.google.com/p/googleappengine/issues/detail?id=4945 Fixed an issue with the SDK where non-string index names caused an error upon upload. http://code.google.com/p/googleappengine/issues/detail?id=5004 Datanucleus now supports polymorphic relationships. http://code.google.com/p/datanucleus-appengine/issues/detail?id=153 Datanucleus now supports PreparedQuery?#countEntities(FetchOptions?). http://code.google.com/p/datanucleus-appengine/issues/detail?id=225 Fixed an issue with datanucleus where recursive relation did not work. http://code.google.com/p/datanucleus-appengine/issues/detail?id=80 -- Ikai Lan Developer Programs Engineer, Google App
Re: [google-appengine] App Engine 1.5.1 is out!
Thanks Greg. On Tue, Jun 21, 2011 at 3:21 PM, Gregory D'alesandre gr...@google.comwrote: Sorry about that, we are in the process of turning this on, I'll let you know when it is complete. Greg On Tue, Jun 21, 2011 at 10:50 AM, Felippe Bueno felippe.bu...@gmail.comwrote: Nice release +1 I'm trying to use X-AppEngine-country, but I can't find any thing like it, in the headers dict (python). Is every thing ok ? Thanks On Tue, Jun 21, 2011 at 2:13 PM, Robert Kluin robert.kl...@gmail.comwrote: Nice release. Any docs online about app_identity? I quickly glanced over the app config, Users and OAuth sections, but didn't notice anything about it. Robert On Tue, Jun 21, 2011 at 05:10, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Hey guys, App Engine 1.5.1 is out! Get it while it's hot! Blog post: http://googleappengine.blogspot.com/2011/06/app-engine-151-release.html Release notes: Python ProtoRPC is a new experimental library that provides a simple method for creating a well-defined and easy-to-use web-based RPC service. The development server's datastore implementation now contains logic that closely replicates the consistency guarantees of the High Replication datastore. To use, run the dev_appserver with the flag --high_replication set to True. All user request have an X-AppEngine?-Country header which contains the ISO-3166-1 alpha-2 country code for the user, based on the IP address of the client request. Applications are now associated with an app_identity, which can be used to authenticate requests originating from the app to other services. The Channel API can now provide user presence, this can be configured by adding channel_presence to the list of inbound services for your application. The Images API now supports the WebP format. Due to limitations in PIL, the SDK does not support the WebP format. You can switch the timezone for App Engine logs in the Admin Console. http://code.google.com/p/googleappengine/issues/detail?id=734 Fixed an issue in the SDK where leased tasks had the POST method. They now have a PULL method. Fixed an issue where the Channel API didn't work with non-default versions of applications using the High Replication datastore. When displaying corrupt data in the Admin Console dataviewer, a useful error will be displayed, instead of a 500. http://code.google.com/p/googleappengine/issues/detail?id=4945 Java The development server's datastore and testing service implementations now contains logic that closely replicates the consistency guarantees of the High Replication datastore. To use, run the dev_appserver with the flag -Ddatastore.default_high_rep_job_policy_unapplied_job_pct=20. All user request have an X-AppEngine?-Country header which contains the ISO-3166-1 alpha-2 country code for the user, based on the IP address of the client request. Applications are now associated with an app_identity, which can be used to authenticate requests originating from the app to other services. The Channel API can now provide user presence, this can be configured by adding channel_presence to the list of inbound services for your application. The Images API now supports the WebP format. You can switch the timezone for App Engine logs in the Admin Console. http://code.google.com/p/googleappengine/issues/detail?id=734 Added javax.xml.ws.Service$Mode to the whitelist. http://code.google.com/p/googleappengine/issues/detail?id=4770 You can configure your application to asynchronously write https session data by adding lt;async-session-persistence enabled=true/gt; to your appengine-web.xml. http://code.google.com/p/googleappengine/issues/detail?id=1692 The local task queue unit testing API now supports Deferred Tasks. Fixed an issue where using reserved URLs did not cause an error in the SDK. Fixed an issue where having a backends.xml configuration file caused logging to stdout to fail in the SDK. Fixed an issue where the Channel API didn't work with non-default versions of applications using the High Replication datastore. Fixed an issue where the Remote API rtok comparison was broken for some users, causing appfcg download data to fail. Fixed an issue with the SDK where you could not apply a transform to PNG images.http://code.google.com/p/googleappengine/issues/detail?id=3458 When displaying corrupt data in the Admin Console dataviewer, a useful error will be displayed, instead of a 500. http://code.google.com/p/googleappengine/issues/detail?id=4945 Fixed an issue with the SDK where non-string index names caused an error upon upload. http://code.google.com/p/googleappengine/issues/detail?id=5004 Datanucleus now supports polymorphic relationships. http://code.google.com/p/datanucleus-appengine/issues/detail?id=153 Datanucleus now supports PreparedQuery
[google-appengine] High cpu_ms since the past 5 days
Definitely there is a strange behaviour on cpu_ms. Few days ago we start seeing a lot if request with cpu_ms ~2000ms. We mostly do re.search, read/write to memcache, and read datastore (no HR). After decreasing about 10% of re.search we were able to see that the cpu_ms decreased dramatically (to ~150ms). We tried to increase it again, and the result was increased cpu_ms again and Miliseconds/Request as you can see bellow: [image: Requests/Second (24 hrs)] We were obliged to decrease the re.search again. We did not change any code, app configuration, our had any change on our data. As matter of fact, the only data that we manipulate is the report stuff. Incrementing, getting and flushing it. Today we were to take a closer look, and saw very strange things: I'm doing the same request (while true ; do lynx -source .), same data, same api calls, as bellow: 1st - memcache.get() Data (dict) 2nd - memcache.get() Report stuff (dict) 3rd - Process stuff passing Data and Report do a lot of re.search 4th - memcache.set() to report stuff The strange behaviour: 1st When I start doing about 164 re.search on each request the cpu_ms is about 2000ms at the beggining. While I continue doing the requests, the time will decreasing to ~200ms. Now, if I request for any URI (even a 404) while I'm doing the request described above the cpu_ms It increases again to ~2000ms. And then it starts decreasing again to ~200ms 2nd If I go from 164 re.search to about 145 re.search on each request, I immediatly see cpu_ms ~150ms. And it is not affected if I do any parallel request, as described in the 1st case. Still, sporadically on both cases I can see cpu_ms ~2000ms, even without doing any parallel request. I also did the following tests: Each re.search takes at maximum 10 megacycles to run when every thing is normal, so I put on the code: if re_cycles = 20: logging.error(my re.search_id: ...) So, as expected but not desired, I saw that some times the re.search takes more cycles then normal( from max of 10 to 200 megacycles). The re.searchs that takes more then 20 megacyles to run are the same 80 almost every time (of 160). In fact they are the greatest on my re.search list. Is anyone seeing this behaviour ? 3 big questions: 1 - Why in name of God, appengine consumes ~2000ms (some times 5000ms) to process the same data after a parallel request in other URI ?!? 2 - Why if I increase only 10% of my re.search() it increases more then 1000% on cpu_ms ? 3 - Could someone, please explain me, why the same request takes so different times to run ? PS - I'm using python without HR. Thanks. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Poor performance since the past 2-3 days
BTW, is there any reason to see that the same request with same data, doing the same thing, and same api calls, has different cpu_ms ? 2011-05-23 12:35:00.009 GET /?... 200real=*127ms cpu=257ms api=0ms* overhead=0ms (3 RPCs) 2011-05-23 12:34:58.763 GET /?. 200real=*818ms cpu=1884ms api=0ms *overhead=0ms (3 RPCs) 2011-05-23 12:34:57.495 GET /?xxx 200real=*814ms cpu=1873ms* api=0ms overhead=0ms (3 RPCs) 2011-05-23 12:34:56.917 GET /? 200real=*135ms cpu=260ms* api=0ms overhead=0ms (3 RPCs) On Mon, May 23, 2011 at 5:03 PM, Brandon Wirtz drak...@digerat.com wrote: Pay for always on, it will go away. *From:* google-appengine@googlegroups.com [mailto: google-appengine@googlegroups.com] *On Behalf Of *Sarang *Sent:* Monday, May 23, 2011 12:52 PM *To:* google-appengine@googlegroups.com *Subject:* [google-appengine] Poor performance since the past 2-3 days I have a python/django app that works blazing fast on the dev_appserver locally, but is taking painfully long to load on GAE since the last 2-3 days. Can anyone please let me know how to resolve it? Here are the issues: 1. I routinely get 1.2011-05-23 12:17:06.505 / 200 373876ms 793cpu_ms 15kb AppEngine-Google; (+http://code.google.com/appengine) 0.1.0.1 - - [23/May/2011:12:17:06 -0700] GET / HTTP/1.1 200 15939 - AppEngine-Google; ... 2.I2011-05-23 12:17:06.505 This request caused a new process to be started for your application, and thus caused your application code to be loaded for the first time. This request may thus take longer and use more CPU than a typical request for your application. See more within the half hour: 2011-05-23 12:18:09.581 / 200 3062ms 653cpu_ms 15kb AppEngine-Google; (+ http://code.google.com/appengine) 2011-05-23 12:17:06.505 / 200 373876ms 793cpu_ms 15kb AppEngine-Google; (+ http://code.google.com/appengine) 2011-05-23 12:12:43.657 / 500 167275ms 70cpu_ms 1kb Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534.24 (KHTML, like Gecko) Chrome/11.0.696.65 Safari/534.24,gzip(gfe),gzip(gfe),gzip(gfe) 2011-05-23 11:43:12.087 / 200 503348ms 746cpu_ms 15kb AppEngine-Google; (+ http://code.google.com/appengine) all these for my landing page which loads in a few milliseconds on the local server. I have taken all the precautions documented: cron job, main() in python code, etc. I have the keep_alive cron job running every 1 minute. However, I have observed that many times it does not start every minute and that leads to high load times. Example: 2011-05-23 12:07:49.777 / 200 2999ms 23cpu_ms 15kb AppEngine-Google; (+ http://code.google.com/appengine) 2011-05-23 12:06:46.769 / 200 13ms 0cpu_ms 15kb AppEngine-Google; (+ http://code.google.com/appengine) 2011-05-23 12:05:46.749 / 200 11ms 23cpu_ms 15kb AppEngine-Google; (+ http://code.google.com/appengine) You can observe that the when the spacing between cron jobs is 1minute, the load times suddenly increase. My 2 key questions: 1. Any way for me to profile and find out where the app engine gets stuck when I get those enormously large load times? 2. Any way to ensure cron is fired within a minute? Appreciate any help. Regards, Sarang -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] High execution time
What could be happening ? I'm getting too high execution time, and a lot of errors. I can see a lot of deadline execeed error. I have not changed any thing today. It is happening in 2 different applications: [image: Requests/Second (24 hrs)] [image: Requests/Second (24 hrs)] CPU Seconds Used/Second: [image: Requests/Second (24 hrs)] [image: Requests/Second (24 hrs)] Errors/Second: [image: Requests/Second (24 hrs)] -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] older version data showing in default version
Senderrp, Are you seeing something like this ? http://groups.google.com/group/google-appengine-python/browse_thread/thread/15c2b4f8a8998ee8/cdc06e9b81849ec0?lnk=gstq=old+instances#cdc06e9b81849ec0 On Mon, May 16, 2011 at 4:27 AM, Brandon Wirtz drak...@digerat.com wrote: Are they Static? Did you set the App.yaml to have too long an expire? Are you on HR or MS? If you put ?1234 at the end of the file do you get the wrong one? The Mark up of your page should have the version number of the file in the CSS…. Either as CacheBuster my.css?v1234 or as the file name my-v1234.css This is just a general best practice for programming. *From:* google-appengine@googlegroups.com [mailto: google-appengine@googlegroups.com] *On Behalf Of *Sandeep Koduri *Sent:* Monday, May 16, 2011 12:14 AM *To:* google-appengine@googlegroups.com *Subject:* Re: [google-appengine] older version data showing in default version sorry, by data i mean to say files in app like css and templates. on every refresh the the css or templates or static files of other version is showing up. this is the concern the data from the store is stable.. On Mon, May 16, 2011 at 12:36 PM, Brandon Wirtz drak...@digerat.com wrote: All versions share a data store, if you versioned your data store you need to assign a new kind. *From:* google-appengine@googlegroups.com [mailto: google-appengine@googlegroups.com] *On Behalf Of *Sandeep Koduri *Sent:* Sunday, May 15, 2011 11:08 PM *To:* google-appengine@googlegroups.com *Subject:* [google-appengine] older version data showing in default version Hello, We are facing some abnormal behavior at appengine, We have one default version, which is showing data from different version at each refresh. We made lot of work considering it as a bug in our code but could not find any flaw. I am not able to explain wt the error is to either the client or the management. *Any one having any idea about this please respond to this post. * We cant handle this with appengine if the live mode is some kinds of errors like this... also some times there is abnormal usage of quotas even if there is no traffic to the site.. -- Regards Sandeep Koduri -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Regards Sandeep Koduri Phone: +91- 99 666 02 456 Gtalk: sandeep.koduri | Skype: sandeep.koduri -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Prerelease SDK 1.5.0 available for download
Really great job :) Congrats Appengine Team. Ikai, any news about http://code.google.com/p/googleappengine/issues/detail?id=4374 (HR Datastore Applications cannot use remote_api, appengine_console.py or Bulkloader due to s~ App ID) ?? I did not test it again. Thanks. On Tue, May 3, 2011 at 2:20 PM, Ikai Lan (Google) ikai.l+gro...@google.comwrote: Hey everyone, Prerelease SDK 1.5.0 is ready for download! There are a ton of bug fixes in this release as well as some pretty big features. Check it out. You can get the SDKs here: http://code.google.com/p/googleappengine/downloads/list The release notes are below. You'll notice that they're much longer than usual. We've listed out many of the bugs in the public issues tracker we've addressed. Python == - Support for Backends which allow developers to create infrastructure components that complement the existing dynamic apps which App Engine already provides. Instances of a backend can maintain state, be addressed individually, and are not subject to per-request time limits. They can also be configured to consume more memory and CPU than ordinary dynamic instances. - Task Queues support pull mode, allowing for more control over task queue work rates. To use pull queues, include the 'mode' argument in your queue.yaml. - Pull queues are supported by a REST API, allowing access from outside App Engine. To use the REST API, you must also include a valid ACL section specifying which users can lease tasks from the pull queue. - Task Queue payload limits have been increased. Push queues now support 100KB per task, pull queues support 1MB per task. Within App Engine, the new limit is 32 MB per batch of tasks. With the REST API the limit is 1 MB per batch. - HTTP request and response sizes have been increased to 32 MB. - We have removed the rate quotas for requests, datastore operations, memcache operations, and image API operations. Resource quotas still apply. - When creating new applications, developers will now see the High Replication Datastore as the default configuration option. Developers that still wish to use the Master/Slave configuration must explicitly choose this option at application creation time. - The Task Queue maximum configurable processing rate has been increased to 500/s. - All application Owners, as listed in the Admin Console, can download the app's code, unless code download is disabled for the application. - Added db.py support for making calls to the datastore asynchronously. Available functions are get_async(), put_async(), delete_async(), allocate_ids_async(). Call get_result on the return value of asynchronous datastore functions to block on the call. - Metadata queries can now get all namespaces, kinds, and properties in a given range. - The Testbed API now supports the Channel API. - Users can provide Django settings to be loaded in webapp's django_setup. - Modified Dashboard latency graphs to indicate they only include dynamic requests. - Fixed an issue where Federated User data didn't survive a get-put-delete operation cycle. - Fixed an issue where metadata queries did not support unicode characters. - Fixed an issue where HTTP headers could contain new line characters. - A warning message is shown when the Python version used to run the SDK is different than the Python version used in production. - Fixed an issue with Federated Users causing the Admin Console dataviewer to fail. http://code.google.com/p/googleappengine/issues/detail?id=384 - MacOS and Windows style newlines are now supported for logging in the SDK. http://code.google.com/p/googleappengine/issues/detail?id=560 - Fixed an issue where sending mail with smtp_host set did not work. http://code.google.com/p/googleappengine/issues/detail?id=626 - Fixed the file permissions for appinfo_errors.py and appinfo.py in the SDK. http://code.google.com/p/googleappengine/issues/detail?id=725 - Fixed an issue deploying an app with version set to 0. http://code.google.com/p/googleappengine/issues/detail?id=735 - Fixed an issue where the SDK allowed GET or DELETE with a body, which does not work in production. http://code.google.com/p/googleappengine/issues/detail?id=983 - Fixed an issue where URLFetch/urllib did not work with MacOS and Python 2.6.0-2.6.3. http://code.google.com/p/googleappengine/issues/detail?id=985 - Fixed the an issue in the SDK where the mail body was incorrectly generated when the sendmail option was enabled. http://code.google.com/p/googleappengine/issues/detail?id=1061 - Fixed an issue in the SDK dataviewer where editing a ListProperty(db.Category) resulted in a BadValueError. http://code.google.com/p/googleappengine/issues/detail?id=1139 - Fixed an issue in the SDK where the signal module could be imported, as it is not supported.
Re: [google-appengine] Re: Prerelease SDK 1.5.0 available for download
Great, Thanks Matthew. I will test it and let you know :). On Tue, May 3, 2011 at 4:09 PM, Matthew Blain matthew.bl...@google.comwrote: Hi Felippe, Thanks for asking. I've updated that bug with the following comment: In 1.5.0 (prerelease available today), we have added the functionality to get the application ID from the URL more easily. The recommendation is to, instead of specifying an application, specify a URL to remote_api. The tool will then read the application ID from remote_api. This also works well for applications behind custom domains (e.g. if you've set up yourapp.example.com/_ah/ remote_api, you can simply use that.) For appcfg.py (or bulkloader.py) specify --url http://yourapplicationid.appspot.com/_ah/remote_api . For remote_api_shell.py specify -s yourapplicationid.appspot.com . (I'm not sure what appengine_console.py is, if it's the example in the remote_api article you can consider using remote_api_shell instead). For custom usage, if you pass the 'servername' to ConfigureRemoteApi you can pass None for the app_id. --Matthew On May 3, 11:26 am, Felippe Bueno felippe.bu...@gmail.com wrote: Really great job :) Congrats Appengine Team. Ikai, any news abouthttp:// code.google.com/p/googleappengine/issues/detail?id=4374(HR Datastore Applications cannot use remote_api, appengine_console.py or Bulkloader due to s~ App ID) ?? I did not test it again. Thanks. On Tue, May 3, 2011 at 2:20 PM, Ikai Lan (Google) ikai.l+gro...@google.comwrote: Hey everyone, Prerelease SDK 1.5.0 is ready for download! There are a ton of bug fixes in this release as well as some pretty big features. Check it out. You can get the SDKs here: http://code.google.com/p/googleappengine/downloads/list The release notes are below. You'll notice that they're much longer than usual. We've listed out many of the bugs in the public issues tracker we've addressed. Python == - Support for Backends which allow developers to create infrastructure components that complement the existing dynamic apps which App Engine already provides. Instances of a backend can maintain state, be addressed individually, and are not subject to per-request time limits. They can also be configured to consume more memory and CPU than ordinary dynamic instances. - Task Queues support pull mode, allowing for more control over task queue work rates. To use pull queues, include the 'mode' argument in your queue.yaml. - Pull queues are supported by a REST API, allowing access from outside App Engine. To use the REST API, you must also include a valid ACL section specifying which users can lease tasks from the pull queue. - Task Queue payload limits have been increased. Push queues now support 100KB per task, pull queues support 1MB per task. Within App Engine, the new limit is 32 MB per batch of tasks. With the REST API the limit is 1 MB per batch. - HTTP request and response sizes have been increased to 32 MB. - We have removed the rate quotas for requests, datastore operations, memcache operations, and image API operations. Resource quotas still apply. - When creating new applications, developers will now see the High Replication Datastore as the default configuration option. Developers that still wish to use the Master/Slave configuration must explicitly choose this option at application creation time. - The Task Queue maximum configurable processing rate has been increased to 500/s. - All application Owners, as listed in the Admin Console, can download the app's code, unless code download is disabled for the application. - Added db.py support for making calls to the datastore asynchronously. Available functions are get_async(), put_async(), delete_async(), allocate_ids_async(). Call get_result on the return value of asynchronous datastore functions to block on the call. - Metadata queries can now get all namespaces, kinds, and properties in a given range. - The Testbed API now supports the Channel API. - Users can provide Django settings to be loaded in webapp's django_setup. - Modified Dashboard latency graphs to indicate they only include dynamic requests. - Fixed an issue where Federated User data didn't survive a get-put-delete operation cycle. - Fixed an issue where metadata queries did not support unicode characters. - Fixed an issue where HTTP headers could contain new line characters. - A warning message is shown when the Python version used to run the SDK is different than the Python version used in production. - Fixed an issue with Federated Users causing the Admin Console dataviewer to fail. http://code.google.com/p/googleappengine/issues/detail?id=384 - MacOS and Windows
Re: [google-appengine] Thanks for increasing Free Quota, Google!
what is happening ? do I missed something ? On Tue, Apr 12, 2011 at 8:55 PM, Robert Kluin robert.kl...@gmail.comwrote: I'm at 15,254,688 of 9,223,372,036,854,775,808 requests for the day, I might need a quota increase On Tue, Apr 12, 2011 at 17:24, 张天翔 sres...@gmail.com wrote: that's too much! On Tue, Apr 12, 2011 at 10:48 AM, Gopal Patel patelgo...@gmail.com wrote: lol...its for one day onlyso use it or it will not be there tomorrow... :P On Tue, Apr 12, 2011 at 8:04 AM, pdknsk pdk...@googlemail.com wrote: I've got generous free quotas in my dashboard :D Datastore API Calls 0% 7,405 of 9,223,372,036,854,775,808 Okay Datastore Queries0% 132 of 9,223,372,036,854,775,808Okay Data Sent to Datastore API 0% 0.07 of 8,589,934,592.00 GBytes Okay Data Received from Datastore API 0% 0.13 of 8,589,934,592.00 GBytes Okay Datastore CPU Time 0% 0.03 of 2,135,039,823,346.01 CPU hours Okay -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- Regards, Tianxiang -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Is app engine down?
Same here On Tue, Mar 8, 2011 at 11:30 AM, andreas schmid a.schmi...@gmail.comwrote: its really not cool. clients are getting angry... On Mar 8, 2011, at 3:21 PM, Ludvig Ericson wrote: On Mar 8, 3:03 pm, Scott sderick...@gmail.com wrote: The email recently sent out said things were going normally for the past half hour, but my app is still generating instances throwing these ImportErrors. Application: skrit Also not fixed for my application, type 'exceptions.ImportError': cannot import name blobstore appid: din-skolmat -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Create an Application fails
Hi guys. I'm trying to create an application with a google account that is not @ gmail.com. (ad...@mygoogleappsdomain.com) After creating the application, I'm redirected to the create application page. Without any application. Can I use any google account to create an application, or only @gmail.comaccounts ? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Data sent/received to apis quota
Hi Robert, Thank you very much for your suggestions. I will try them, and post the results. About your question, yes, I tried. And they grew up the quotas (thank you Google). But I don't want to bother they again if my traffic increases. Thanks again. Felippe On Sun, Jan 23, 2011 at 1:44 AM, Robert Kluin robert.kl...@gmail.comwrote: Hi Felippe, If your queues are backing up try increasing the rate / bucket size and possibly using more queues. If they are still backing up try doing less work in each task; the shorter your tasks run time, the more willing app engine is to run more of your tasks (iow they will be run faster). As for the quota, have you tried submitting a billing support issue? Robert On Fri, Jan 21, 2011 at 10:40, Felippe Bueno felippe.bu...@gmail.com wrote: Hi Guys, For the second time, I'm having problems with the Data Received from API (memcache). I decreases my reports data (which is recorded on memcache), but I needed to increase again (more 4 bytes). Now I'm reaching the quota limit again. I thought to use shard counter on datastore, but the problem would persist, because datastore also has this quota limit. When using tasks queues, I have other problem. The queues increases faster than decreases. I mean, tasks queues are not consumed. Sugestions ? Thank you guys, very much. Felippe -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2bunsubscr...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Data sent/received to apis quota
Hi Guys, For the second time, I'm having problems with the Data Received from API (memcache). I decreases my reports data (which is recorded on memcache), but I needed to increase again (more 4 bytes). Now I'm reaching the quota limit again. I thought to use shard counter on datastore, but the problem would persist, because datastore also has this quota limit. When using tasks queues, I have other problem. The queues increases faster than decreases. I mean, tasks queues are not consumed. Sugestions ? Thank you guys, very much. Felippe -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Deployment failing
+1 On Wed, Jan 12, 2011 at 2:49 PM, Ryan Goldstein r...@moberg.com wrote: Spoke too soon; deployment is failing again. -Ryan On Jan 12, 11:16 am, Ryan Goldstein r...@moberg.com wrote: ... and now it's working again. Problem solved! -Ryan On Jan 12, 11:14 am, Ryan Goldstein r...@moberg.com wrote: Update: On my subsequent attempt, the console showed the following after Initiating update. -- javax.net.ssl.SSLHandshakeException: Remote host closed connection during handshake -- -Ryan On Jan 12, 11:06 am, Ryan Goldstein r...@moberg.com wrote: I've been updating and redeploying my app today (appid: mobergdrmserver). It took progressively longer to deploy, and my most recent attempt failed. From my Eclipse console during my most recent deployment attempt: ... Creating staging directory Scanning for jsp files. Scanning files on local disk. Initiating update. Cloning 29 static files. Cloning 66 application files. Uploading 1 files. Uploaded 1 files. Initializing precompilation... Deploying new version. Will check again in 1 seconds. Will check again in 2 seconds. Will check again in 4 seconds. Will check again in 8 seconds. Will check again in 16 seconds. Will check again in 32 seconds. Will check again in 60 seconds. Will check again in 60 seconds. Will check again in 60 seconds. Will check again in 60 seconds. Will check again in 60 seconds. Will check again in 60 seconds. Will check again in 60 seconds. Will check again in 60 seconds. Will check again in 60 seconds. Will check again in 60 seconds. Will check again in 60 seconds. Will check again in 60 seconds. Will check again in 60 seconds. Rolling back the update. java.lang.RuntimeException: Version not ready. The debug logs are as follows: Unable to update: java.lang.RuntimeException: Version not ready. at com.google.appengine.tools.admin.AppVersionUpload.commit(AppVersionUpload.j ava: 516) at com.google.appengine.tools.admin.AppVersionUpload.doUpload(AppVersionUpload .java: 129) at com.google.appengine.tools.admin.AppAdminImpl.update(AppAdminImpl.java: 56) at com.google.appengine.eclipse.core.proxy.AppEngineBridgeImpl.deploy(AppEngin eBridgeImpl.java: 271) at com.google.appengine.eclipse.core.deploy.DeployProjectJob.runInWorkspace(De ployProjectJob.java: 146) at org.eclipse.core.internal.resources.InternalWorkspaceJob.run(InternalWorksp aceJob.java: 38) at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54) Thanks, -Ryan -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] 500 error
I'm receiving some error 500 - Internal Server Error for my applications, today. I can't see any alarm on status page. Some one are having problems too ? Thanks -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Prerelease SDK 1.4.0 is out!
- The developer who uploaded an app version can download that version's code using the appcfg.py download_app command. This feature can be disabled on a per application basis in the admin console, under the 'Permissions' tab. Once disabled, code download for the application CANNOT be re-enabled. good catch -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Unable to deploy due to 500 server error
same here for the admin On Thu, Nov 18, 2010 at 9:06 PM, Alexander W. startupw...@googlemail.com wrote: here too... -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Unable to deploy due to 500 server error
(admin is working now) On Thu, Nov 18, 2010 at 9:19 PM, Ikai Lan (Google) ikai.l+gro...@google.com wrote: What error are you guys seeing? I am seeing this log: Creating staging directory Scanning for jsp files. Scanning files on local disk. Initiating update. java.lang.RuntimeException: Bad authentication response: 500 Internal Server Error I just want to verify that we are all seeing the same error. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_engine On Thu, Nov 18, 2010 at 3:07 PM, Felippe Bueno felippe.bu...@gmail.com wrote: same here for the admin On Thu, Nov 18, 2010 at 9:06 PM, Alexander W. startupw...@googlemail.com wrote: here too... -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Lots of 500ers
Ikai, Since 11/07, I don't see any errors for my applications (500 or DeadlineExceededError). Thank you guys, very much. On Mon, Nov 8, 2010 at 5:21 PM, Ikai Lan (Google) ikai.l+gro...@google.com wrote: Are you guys still seeing these issues? Do you have any times for when this was taking place? -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_engine On Mon, Nov 8, 2010 at 10:21 AM, Robert Kluin robert.kl...@gmail.com wrote: Hey Daniel, I've been seeing periodic bursts of 500 errors for requests that never reach my app (ie no requests logged). Aside from that my apps are running very fast, and I have not had any errors. Are you getting errors in your logs? Robert On Mon, Nov 8, 2010 at 11:11, dflorey daniel.flo...@gmail.com wrote: Hi, I get tons of 500ers when using our application today, even when accessing the start page. Any ideas why? Daniel -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Memcache capacity
Hello All, I'd like to ask, what can I do if I reach the memcache quota limit? Specifically the Data Received from API and Memcache API Calls. Right now I have 57% used of Data Received from API. My next reset is 10h. I have about 500 req/sec, and I do intensive use of memcache. Also, is there any easy way to know how much memcache stored data my application is using ? Thanks. On Tue, Oct 5, 2010 at 4:12 PM, Ikai Lan (Google) ikai.l+gro...@google.com wrote: You can read our program policies here: http://code.google.com/appengine/program_policies.html There is a list of the type of content you can and cannot store on our servers. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_engine On Mon, Oct 4, 2010 at 9:38 PM, SivaTumma sivatu...@gmail.com wrote: Ikai, Can We build applications those serve religions or Porn on appengine ? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Prerelease SDK 1.3.8 is out!
+1 On Wed, Oct 6, 2010 at 12:12 PM, Mike Wesner mike.wes...@webfilings.com wrote: +1 On Oct 6, 9:59 am, mscwd01 mscw...@gmail.com wrote: +1 On Oct 6, 10:48 am, Greg g.fawc...@gmail.com wrote: On Oct 6, 1:28 pm, Ikai Lan (Google) ikai.l+gro...@google.com wrote: - The developer who uploaded an app version can download that version's code using the appcfg.py download_app command. I'm not at all happy about this. I know how frequent plaintive I lost my code how can I get it back? messages are in this group, but the write-only nature of appengine gave me a lot of confidence that our source code is safe. Now a single password is all that stands between our competitors and our IP. Why expose ALL users to risk (and open Google to lawsuits) for the sake of a few inexperienced developers? Star this post if you agree. I guess one solution would be to make downloading optional. A setting to disable source downloading in app.yaml would be safe, because uploading a new version would destroy the existing code. Greg. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Memcache capacity
hindsight, it would make sense to have a 558gb limit in memcache, when we have a lower limit on the datastore. I think its a good idea let this clear in the documentation. On Fri, Oct 1, 2010 at 4:28 PM, powera pow...@google.com wrote: 558 GB is the quota for how much data you can send for memcache in a day. Memcache will evict data that has not been read recently to stay within memory limits. The numbers I gave are more rules of thumb about how the LRU cache generally behaves, and when you will start to see decreased retention times as a result of the amount of data stored in memcache. On Oct 1, 10:30 am, Felippe Bueno felippe.bu...@gmail.com wrote: Sorry, but I don't understand. The limit are not 558.00 GB for stored data, and 1MB for each memcache record ? On Thu, Sep 30, 2010 at 5:45 PM, powera pow...@google.com wrote: Hi -- Memcache is limited, though there isn't a particular hard limit. In general, if you have more than 50MB of data in memcache you will start to see decreased LRU eviction times; 1 GB is about the limit a single app can store without adjustments regardless of usage. I've made an adjustment to your app's memcache config allowing it to store more data. Hopefully this will help. On Sep 30, 3:58 am, sahid sahid.ferdja...@gmail.com wrote: I store my users sessions in memcache (like jaikuengine) but when site traffic is the highest my users are disconnected, i suppose the probleme comes from memcache, because memcache removes old items if the max size is exceeded. Now i use about 900mega of memcache but at the night (i'm in france) i can use more... may be 1giga, i would know if memcache is limited? APPID: devel-inchallah Cordially, Sahid -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Memcache capacity
I agree. What I was saying is, there is no sense to have more 'stored' quota for memcache, than for datastore. Any way, forget about it. I understand, now, the soft limit of 50mb for memcache stored data :) Thanks On Fri, Oct 1, 2010 at 6:15 PM, Ikai Lan (Google) ikai.l+gro...@google.com wrote: In an application where you are doing lots of traffic, it absolutely makes sense to have a higher quota for Memcache. You can't make best use of your resources without caching. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_engine On Fri, Oct 1, 2010 at 12:36 PM, Felippe Bueno felippe.bu...@gmail.com wrote: hindsight, it would make sense to have a 558gb limit in memcache, when we have a lower limit on the datastore. I think its a good idea let this clear in the documentation. On Fri, Oct 1, 2010 at 4:28 PM, powera pow...@google.com wrote: 558 GB is the quota for how much data you can send for memcache in a day. Memcache will evict data that has not been read recently to stay within memory limits. The numbers I gave are more rules of thumb about how the LRU cache generally behaves, and when you will start to see decreased retention times as a result of the amount of data stored in memcache. On Oct 1, 10:30 am, Felippe Bueno felippe.bu...@gmail.com wrote: Sorry, but I don't understand. The limit are not 558.00 GB for stored data, and 1MB for each memcache record ? On Thu, Sep 30, 2010 at 5:45 PM, powera pow...@google.com wrote: Hi -- Memcache is limited, though there isn't a particular hard limit. In general, if you have more than 50MB of data in memcache you will start to see decreased LRU eviction times; 1 GB is about the limit a single app can store without adjustments regardless of usage. I've made an adjustment to your app's memcache config allowing it to store more data. Hopefully this will help. On Sep 30, 3:58 am, sahid sahid.ferdja...@gmail.com wrote: I store my users sessions in memcache (like jaikuengine) but when site traffic is the highest my users are disconnected, i suppose the probleme comes from memcache, because memcache removes old items if the max size is exceeded. Now i use about 900mega of memcache but at the night (i'm in france) i can use more... may be 1giga, i would know if memcache is limited? APPID: devel-inchallah Cordially, Sahid -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.comgoogle-appengine%2Bunsubscrib e...@googlegroups.com . For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Monitoring/Ploting quotas
Hi, I was thinking if is it possible to get the quotas and the used quotas using a python program. I need a URL to provide me informations about my requests/second, milisecond/request, apis calls and more, to plot graphics using my internal graphic tool, like cacti, mrtg or other. I could use https://appengine.google.com/dashboard/quotadetails, but I don't want to parse the informations, it is kind of ugly I think. I prefer write a python to provide me this informations. Is it possible ? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Query.filter() questions
2. Is it possible to pass some thing like 'or' to filter ?
Some thing like this:
articles = Article.all().filter('author =',
user.get_current_user()).or('user =', user.get_current_user())
No, the datastore doesn't support OR queries. You'll need to execute
multiple queries and join the results yourself.
Ok, Thanks.
I just find one way to 'join' the results:
entries = list(chain(Article.all().filter('public =',
False).filter('status =', True).filter('author =', user),
Article.all().filter('public =', True)))
trying:
entries = Article.all().filter('public =', False).filter('status =',
True).filter('author =', user)
entries += Article.all().filter('public =', True)
don't work.
There is a better way to join the results ?
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Query.filter() questions
Hello people.
3 questions:
1. is it possible to filter an property inside the Entity property?
For example:
Article(author = users.get_current_user(), skey='monmon').save()
Invite(author = users.get_current_user(), entry = Article.get('monmon')).save()
##here is the filter
invites = Invite.all().filter('entry.author =', user.get_current_user())
2. Is it possible to pass some thing like 'or' to filter ?
Some thing like this:
articles = Article.all().filter('author =',
user.get_current_user()).or('user =', user.get_current_user())
3. (not a query question). Some one know if GAE offers some kind of
facility to an invite/collaboration system ?
I need to invite google users to edit or comment on my system.
Thanks
Cheers
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: datastore keys security question
datastore_types.Key.from_path(u'Issue', 31L, _app=u'epubpub2') How you did it ? You simply asked for db.Key(mykey)? Is it possible to get other informations for this entity, from another app-id ? Jeff, I can't find the key's id using datastore view or in documentation. The idea is to have 4 commands /add/application, edit, remove and view. the 'view' command will be used to display content to my visitors (unauthenticated). add/edit/remove will verify if that key belongs to that user How you guys do something like that ? I mean, pass an identification parameter to your application, in a safe way ? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] datastore keys security question
Hi, I'm using python/django and I'm planing to use the following URL design: /application/edit/content/KEY/ where KEY is the datastore key of 'content'. Ex: /application/edit/content/aghlcHVicHViMnILCxIFSXNzdWUYHww/ Is there any security problem ? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
