On Nov 14, 1:32 pm, Stephen Johnson <onepagewo...@gmail.com> wrote: > Why do you say that's silly? If your map reduce task does bulk deletes and > let's say they do 100 at a time, then those 100 deletes are done in > parallel. So that's 100x. So for each second of delete real time you're > getting 100 seconds of CPU time. You should be pleased that instead of your > task taking 11 hours to delete all your data it took only 15 minutes. Isn't > that scalability? Isn't that what you're looking for? How many entities did > you delete? How many indexes did you have (composite and single property)?
This was using only 1 shard per kind that was being deleted, so effectively there should be no parallelism occurring, unless there is something I am missing? Deleted about ~300k entities, each with a single indexed collection. > On Sun, Nov 14, 2010 at 10:29 AM, Erik <erik.e.wil...@gmail.com> wrote: > > > If you check in the datastore viewer you might be able to find and > > delete your jobs from one of the tables. You may also need to go into > > your task queues and purge the default. > > > On this topic, why does deleting data have such a large difference > > between actual time spent and billed time? > > > For instance, I had two mapreduce shards running to delete data, which > > took a combined a total of 15 minutes, but I was actually charged for > > 11(!) hours. I know there isn't a 1:1 correlation but a >40x > > difference is a little silly! > > > On Nov 14, 4:25 am, Justin <justin.worr...@gmail.com> wrote: > > > I've been trying to bulk delete data from my application as described > > > here > > > >http://code.google.com/appengine/docs/python/datastore/creatinggettin... > > > > This seems to have kicked off a series of mapreduce workers, whose > > > execution is killing my CPU - approximately 5 mins later I have > > > reached 100% CPU time and am locked out for the rest of the day. > > > > I figure I'll just delete by hand; create some appropriate :delete > > > controllers and wait till the next day. > > > > Unfortunately the mapreduce process still seems to be running - 10 > > > past midnight and my CPU has reached 100% again. > > > > Is there some way to kill these processes and get back control of my > > > app? > > > -- > > You received this message because you are subscribed to the Google Groups > > "Google App Engine" group. > > To post to this group, send email to google-appeng...@googlegroups.com. > > To unsubscribe from this group, send email to > > google-appengine+unsubscr...@googlegroups.com<google-appengine%2bunsubscr...@googlegroups.com> > > . > > For more options, visit this group at > >http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
