Re: [google-appengine] Datastore latency?
Taking a guess: You are writing to a highly contended entity group. Remember GAE gives you 1 transaction per second per EG, and regular nontransactional writes will automatically retry. So contention will produce long delays like this. Think about your data model and make sure you aren't overloading a single EG. Either reorganize the data or come up with a sharding scheme. Unfortunately this is a difficult thing to do when you are already under load. Jeff On Sun, Apr 28, 2013 at 11:04 AM, Panayiotis Papadopoulos i...@bugsense.com wrote: Hi all my app is experiencing some heavy loads x2 traffic but GAE has spawned 1450 instances instead of my avg 17! I also get a lot timeouts for db.put! Do you experience any similar problem? I already (in 11 hours) at $400 when I am usually at $50 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Datastore latency?
Hi all my app is experiencing some heavy loads x2 traffic but GAE has spawned 1450 instances instead of my avg 17! I also get a lot timeouts for db.put! Do you experience any similar problem? I already (in 11 hours) at $400 when I am usually at $50 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Datastore latency?
All fine on my side. Are you with HDR or master/slave? Try making a new deploy to reboot everything. thanks rafa On Sun, Apr 28, 2013 at 11:04 AM, Panayiotis Papadopoulos i...@bugsense.com wrote: Hi all my app is experiencing some heavy loads x2 traffic but GAE has spawned 1450 instances instead of my avg 17! I also get a lot timeouts for db.put! Do you experience any similar problem? I already (in 11 hours) at $400 when I am usually at $50 -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] DATASTORE latency
Hi, Is it just me or is the datastore latency shooting through the roof? My app is literally standing still for 10 seconds per request. Why is everything so unstable with App Engine? There's no pricing stability and there's no service stability? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/m6jVFw8UTH8J. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Datastore Latency Improved?!
Hi Guys, I see that datastore latency has much improved since 6th November 1pm and my apps running pretty fast now! Is it because of recent maintenance? http://code.google.com/status/appengine/detail/datastore/2010/11/06#ae-trust-detail-datastore-get-latency -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] DataStore Latency affecting SEO?
Hi, I was just wondering how the ongoing DataStore issue is going to affect page rank since PageRank is going to be affected by the sites speed. I put as much as possible into memcache for my site but my site's speed has dropped from being faster than 70% of sites to being faster than 50% of sites according to Google Webmaster Tools. There is a few little tricks that I can do client side but don't think I can optimize my backend code anymore since its a simple get data and display. David -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Datastore latency spike of May 11th _did_ affect availability of applications
Today, May 11th there was a spike in latency on the Datastore (according to http://code.google.com/status/appengine/detail/datastore/2010/05/11#ae-trust-detail-datastore-get-latency). The note attached to this spike (B) says that Investigation Complete - Issue Resolved - We have determined that this spike did not affect the performance or uptime of applications. If you feel we have incorrectly diagnosed this issue please inform us by posting in our developer forum. I am here writing to say that it did (like previous spikes). I have rows of errorlogs between 05-11 05:43AM and 05-11 05:54AM that indicate there was an amount of requests dropped on my app (appid=macbay-base) as a result of the spike mentioned. Please look into the indicators that caused you to believe that the spike did not affect the performance or uptime of applications. Thank you. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Datastore Latency issues?
I am unable to do even a single get() command in my application. I
don't think I've reached any quota, and I am even paying now so I
don't think i have any short-term limitations, here is my code (I
already tried switching .fetch(100) to .get() and still it fails on
the first get attempt before deleting).
class DeleteKeywords(webapp.RequestHandler):
def get(self):
try:
trackers = Tracking.all().filter('delete_track',True)
for x in trackers:
keys = db.Query(keys_only=True).ancestor(x).filter
(datastore_types._KEY_SPECIAL_PROPERTY + ' ', x.key()).fetch(100)
while keys:
db.delete(keys)
keys = db.Query(keys_only=True).ancestor(x).filter
(datastore_types._KEY_SPECIAL_PROPERTY + ' ', x.key()).fetch(100)
x.delete()
except (DeadlineExceededError, Timeout):
queue = taskqueue.Queue(name='delete-tasks')
queue.add(taskqueue.Task(url='/tasks/delete_tracks',
method='GET'))
self.response.out.write(Ran out of time, need to delete
more!)
This piece of code was running fine earlier today. What's even more
odd is that the error stopped showing up in my logs around 9:43pm, so
maybe something broke at that time?
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---
