Hi Takashi, <https://lh5.googleusercontent.com/-6hxKP1JDfeU/UOUifTEC7KI/AAAAAAAAAYE/KFldMXpMZ1g/s1600/Screen+Shot+2013-01-02+at+10.16.01+PM.png> Thank you again for the fast response and direct details. You are being very helpful. There are Datastore buttons and controls which we are using in the *GAE Dashboard* under *Datastore Admin* section. Are we to understand that those are not honored with the Migration Path? If this is the case it was a massive mistake that we made: May ask for a refund? We are using these buttons (as shown in the screenshot).
On Wednesday, January 2, 2013 10:05:38 PM UTC-8, Takashi Matsuo (Google) wrote: > > > On Wed, Jan 2, 2013 at 9:48 PM, Stephen Blum <blum.s...@gmail.com<javascript:> > > wrote: > >> Hi Takashi, >> >> Thank you for the details! We are in the process of migrating now, and I >> expect that is cause. However it was my understanding that the migration >> was a free process as per the docs. Why is it incurring such a high >> charge? Those tasks queues are old and from long ago that has not changed >> for about a year. However now that we are starting the migration the >> billing has overblown! It's almost at *$2,000.00* for just a few hours. >> > > Yes, our migration > tool<https://developers.google.com/appengine/docs/adminconsole/migration?hl=en>doesn't > cost you for the migration process itself. If you're using our > migration tool, I believe that the high usage of the datastore is caused by > other reasons(it is very likely the infinite retry loop I mentioned before). > > Can you tell me how you're migrating your app? If you're using any other > tools for the migration, it will very likely cost you for the migration > process itself. > > -- Takashi > > >> >> >> On Wednesday, January 2, 2013 9:37:16 PM UTC-8, Takashi Matsuo (Google) >> wrote: >> >>> >>> Hi Stephen, >>> >>> All of your tasks in the 'default' task queue are retrying more than 17 >>> times. I suspect these tasks contribute to the high usage of the datastore. >>> >>> If that's the case, maybe you can stop your 'default' queue first, and >>> fix the settings for your 'default' queue to prevent the infinite loop(see >>> the taskqueue settings >>> doc[Python<https://developers.google.com/appengine/docs/python/config/queue#Configuring_Retry_Attempts_for_Failed_Tasks> >>> |Java<https://developers.google.com/appengine/docs/java/config/queue#Configuring_Retry_Attempts_for_Failed_Tasks>]), >>> >>> and then fix the root cause, and then finally you can restart the default >>> queue. >>> >>> I also noticed that you're using deprecated M/S datastore, which is very >>> susceptible to just a small failure in a single datacenter. I strongly >>> recommend migrating your app to HRD. >>> >>> -- Takashi >>> >>> >>> On Wed, Jan 2, 2013 at 9:06 PM, Stephen Blum <blum.s...@gmail.com>wrote: >>> >>>> Hi Takashi! >>>> >>>> App ID: See Screenshot Below >>>> >>>> >>>> <https://lh6.googleusercontent.com/-SvGzC9LkOVc/UOURu-OdYqI/AAAAAAAAAXs/qZydTwPBjss/s1600/Screen+Shot+2013-01-02+at+9.05.47+PM.png> >>>> Full Usage Stats: See Screenshot Below >>>> >>>> >>>> <https://lh6.googleusercontent.com/-OjhWSnMFZgo/UOUR3x01BJI/AAAAAAAAAX0/yAaPAEHMGKY/s1600/Screen+Shot+2013-01-02+at+9.05.10+PM.png> >>>> >>>> >>>> On Wednesday, January 2, 2013 8:47:20 PM UTC-8, Takashi Matsuo (Google) >>>> wrote: >>>> >>>>> >>>>> Hi Stephen, >>>>> >>>>> What is your app-id? Can you share the error message? I don't think >>>>> anyone can help you without knowing more. >>>>> >>>>> Few things came to mind though: >>>>> How big is the traffic to your app now? Doesn't your app just have a >>>>> big spike? >>>>> If you're running erroneous tasks on the task queue, you can pause the >>>>> queue from the admin console for a band-aid purpose. >>>>> If you have some error-handling implementations which can lead to an >>>>> infinite retry loop(with or without task queue), you need to fix the >>>>> implementation. >>>>> >>>>> -- Takashi >>>>> >>>>> >>>>> On Wed, Jan 2, 2013 at 8:03 PM, Stephen Blum <blum.s...@gmail.com>wrote: >>>>> >>>>>> Help! We are bing charged *$30/per minute*! *A major datastore >>>>>> error. * Help! Keeps increasing! Help! >>>>>> >>>>>> >>>>>> <https://lh3.googleusercontent.com/-7aDiJuaWEQM/UOUCx3GKmCI/AAAAAAAAAXc/DFYTgLtqSHI/s1600/Screen+Shot+2013-01-02+at+8.01.41+PM.png> >>>>>> >>>>>> -- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "Google App Engine" group. >>>>>> To view this discussion on the web visit https://groups.google.com/d/ >>>>>> **ms**g/google-appengine/-/**mCpqsBgvS**kcJ<https://groups.google.com/d/msg/google-appengine/-/mCpqsBgvSkcJ> >>>>>> . >>>>>> To post to this group, send email to google-a...@googlegroups.**com. >>>>>> To unsubscribe from this group, send email to google-appengi...@** >>>>>> googlegroups**.com. >>>>>> >>>>>> For more options, visit this group at http://groups.google.com/** >>>>>> group**/google-appengine?hl=en<http://groups.google.com/group/google-appengine?hl=en> >>>>>> . >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> Takashi Matsuo | Developers Advocate | tma...@google.com >>>>> >>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "Google App Engine" group. >>>> To view this discussion on the web visit https://groups.google.com/d/** >>>> msg/google-appengine/-/**HO4kpXH_AAQJ<https://groups.google.com/d/msg/google-appengine/-/HO4kpXH_AAQJ> >>>> . >>>> >>>> To post to this group, send email to google-a...@googlegroups.**com. >>>> To unsubscribe from this group, send email to google-appengi...@** >>>> googlegroups.com. >>>> For more options, visit this group at http://groups.google.com/** >>>> group/google-appengine?hl=en<http://groups.google.com/group/google-appengine?hl=en> >>>> . >>>> >>> >>> >>> >>> -- >>> Takashi Matsuo | Developers Advocate | tma...@google.com >>> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To view this discussion on the web visit >> https://groups.google.com/d/msg/google-appengine/-/nIwnzB7DlQIJ. >> >> To post to this group, send email to >> google-a...@googlegroups.com<javascript:> >> . >> To unsubscribe from this group, send email to >> google-appengi...@googlegroups.com <javascript:>. >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> > > > > -- > Takashi Matsuo | Developers Advocate | tma...@google.com <javascript:> > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/AVBE4004J_YJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.