Hi Mike! I just checked and it seems the job completed at some point over the weekend. It was however stuck at 100,000 ops for at least 40 minutes (which is the longest we'll poll for), and most healthy jobs of the same size don't seem to do this.
So we're good on our end for now, but it's not the last time we're doing this and we'd love guidance on avoiding this problem. Splitting the job is feasible but would require considerable refactoring, so we'd do it only if it's a very good chance it'll fix the problem. Thanks you so much for your assistance! - Adrian. On Monday, November 7, 2016 at 7:51:47 AM UTC-5, Michael Cloonan (AdWords API Team) wrote: > > Hello, > > I've passed along the ID you gave, and the team will check whether that's > the same issue as the previous one you encountered. > > I believe that you may be able to reduce risk of this occurring by > splitting jobs into multiple smaller batches, but I am confirming with the > team about whether or not that will actually help, and if there are any > other actions you can take to minimize the chances. > > Regards, > Mike, AdWords API Team > > On Friday, November 4, 2016 at 5:14:50 PM UTC-4, Adrian Ghizaru wrote: >> >> Thank you so much, we've been able to upload all batches... except the >> last one (job id 397817899). It seems to be stuck at 100,000 ops executed. >> >> Could you please give us a hint as to what edge case we're tripping? >> Given that it's happened on 3 separate occasions, it's probably worth it >> for us to invest some effort in avoiding this case in our scripts. >> >> Cheers, and apologies for pestering you! >> - Adrian. >> >> On Friday, November 4, 2016 at 8:28:59 AM UTC-4, Michael Cloonan (AdWords >> API Team) wrote: >>> >>> Hello, >>> >>> We have cleared out the current queue of stalled jobs for your account, >>> and have generated download URLs for those jobs so you can fetch results >>> for each one. >>> >>> Please let me know if this issue recurs while we're working on fixing >>> the underlying problem. >>> >>> Regards, >>> Mike, AdWords API Team >>> >>> On Wednesday, November 2, 2016 at 8:43:35 AM UTC-4, Michael Cloonan >>> (AdWords API Team) wrote: >>>> >>>> Hello, >>>> >>>> I apologize for the slow response. I will see what we can do about the >>>> currently running jobs to clear things up and let you run new ones. >>>> >>>> Regards, >>>> Mike, AdWords API Team >>>> >>>> On Monday, October 31, 2016 at 9:46:11 AM UTC-4, Adrian Ghizaru wrote: >>>>> >>>>> Hi Mike! >>>>> >>>>> Thank you so much for looking into it! Unfortunately, we're unable to >>>>> start any new jobs due to DISK_QUOTA_EXCEEDED errors. It doesn't seem >>>>> like >>>>> we can do anything about it on our end, whenever I try to cancel one of >>>>> those jobs it stays stuck in a CANCELING state. Would you be able to >>>>> remove >>>>> them from your end please? >>>>> >>>>> Thanks again for your assistance, >>>>> - Adrian. >>>>> >>>>> On Monday, October 31, 2016 at 8:55:09 AM UTC-4, Michael Cloonan >>>>> (AdWords API Team) wrote: >>>>>> >>>>>> Hello, >>>>>> >>>>>> These jobs actually ran into a very rare issue that caused the stall. >>>>>> My suggestion is to retry these specific operations, and it will likely >>>>>> not >>>>>> recur. You may be able to reduce the likeliness even more by splitting >>>>>> the >>>>>> job into a few smaller batches. >>>>>> >>>>>> Engineering is planning a fix for this issue as well, although I >>>>>> don't have a timeframe for when it might be available. For now, you >>>>>> should >>>>>> take the steps I mentioned above if you run into more cases like this. >>>>>> >>>>>> Regards, >>>>>> Mike, AdWords API Team >>>>>> >>>>>> On Friday, October 28, 2016 at 12:39:04 PM UTC-4, Michael Cloonan >>>>>> (AdWords API Team) wrote: >>>>>>> >>>>>>> Hello, >>>>>>> >>>>>>> Thanks for the report. I'm going to look into it and let you know >>>>>>> what I find. >>>>>>> >>>>>>> Regards, >>>>>>> Mike, AdWords API Team >>>>>>> >>>>>>> On Friday, October 28, 2016 at 11:28:03 AM UTC-4, Adrian Ghizaru >>>>>>> wrote: >>>>>>>> >>>>>>>> Hello! >>>>>>>> >>>>>>>> We are experiencing problems similar to the stalling batch jobs >>>>>>>> from May - July of this year [1]. On our test account at Busbud >>>>>>>> (760-779-2587) we have 4 jobs stalled for over a week and 2 more since >>>>>>>> last >>>>>>>> night: >>>>>>>> >>>>>>>> 387400054 - CANCELING - 23% - 80000 ops executed >>>>>>>> 387460843 - ACTIVE - 0% - 0 ops executed >>>>>>>> 387571183 - CANCELING - 0% - 0 ops executed >>>>>>>> 387643878 - ACTIVE - 0% - 0 ops executed >>>>>>>> >>>>>>>> 393500269 - ACTIVE - 19% - 65000 ops executed >>>>>>>> 393620888 - ACTIVE - 2% - 5000 ops executed >>>>>>>> >>>>>>>> I cancelled the first job after about 4 days of being stuck at 80K >>>>>>>> ops, and the second one after about 7 days because we started >>>>>>>> getting DISK_QUOTA_EXCEEDED errors. >>>>>>>> >>>>>>>> Thank you for your help. >>>>>>>> >>>>>>>> [1] >>>>>>>> https://groups.google.com/forum/#!topic/adwords-api/J6fDOsLQkpc/discussion >>>>>>>> >>>>>>> -- -- =~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~ Also find us on our blog and Google+: https://googleadsdeveloper.blogspot.com/ https://plus.google.com/+GoogleAdsDevelopers/posts =~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~=~ You received this message because you are subscribed to the Google Groups "AdWords API Forum" group. To post to this group, send email to adwords-api@googlegroups.com To unsubscribe from this group, send email to adwords-api+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/adwords-api?hl=en --- You received this message because you are subscribed to the Google Groups "AdWords API Forum" group. To unsubscribe from this group and stop receiving emails from it, send an email to adwords-api+unsubscr...@googlegroups.com. Visit this group at https://groups.google.com/group/adwords-api. To view this discussion on the web visit https://groups.google.com/d/msgid/adwords-api/fe09a84a-c213-4533-bfc6-10218f495d2f%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
